{"id":26683,"date":"2016-09-12T08:34:12","date_gmt":"2016-09-12T06:34:12","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=26683"},"modified":"2016-09-12T08:34:12","modified_gmt":"2016-09-12T06:34:12","slug":"400000-github-repositories-1-billion-files-14-terabytes-of-code-spaces-or-tabs","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2016\/09\/12\/400000-github-repositories-1-billion-files-14-terabytes-of-code-spaces-or-tabs\/","title":{"rendered":"400,000 GitHub repositories, 1 billion files, 14 terabytes of code: Spaces or Tabs?"},"content":{"rendered":"\n

Here is an interesting bit of research<\/a> – do people prefer tabs or spaces when programming the most popular languages?<\/p>\n

Tabs or spaces. We are going to parse a billion files among 14 programming languages to decide which one is on top.<\/p><\/blockquote>\n

The results are not very surprising and somewhat disappointing (for all of us, tab fans):<\/p>\n

\"tabs<\/a><\/p>\n

As far as PHP goes, I’m sure the choice of spaces has to do with the PSR-2 coding style guide<\/a>, which states:<\/p>\n

Code MUST use 4 spaces for indenting, not tabs.<\/p><\/blockquote>\n

On a more technical note, I think this is also related to the explosion of editors and IDEs in the recent years, which, as good as they are, aren’t as good as Vim<\/a>. \u00a0Vim allows for a very flexible configuration, where your code can be formatted and re-formatted any way you like, making tabs or spaces a non-issue at all.<\/p>\n

Regardless of the results of the study, what’s more interesting is the method and tools used. \u00a0I’ve had my eye on the Google Big Query<\/a> for a while now, but I’m too busy these days to give it a try. \u00a0The article gives a few insights, into how awesome the tool is. \u00a01.6 terabytes of data processed in 864.6 seconds:<\/p>\n

That query took a relative long time since it involved joining a 190 million rows table with a 70 million rows one, and over 1.6 terabytes of contents. But don\u2019t worry about having to run it, since I left the result publicly available at [fh-bigquery:github_extracts.contents_top_repos_top_langs<\/a>].<\/p><\/blockquote>\n

and:<\/p>\n

Analyzing each line of 133 GBs of code in 16 seconds? That\u2019s why I love BigQuery.<\/p><\/blockquote>\n

If you enjoyed this article, also have a look at “Analyzing GitHub issues and comments with BigQuery<\/a>“, which works with a similar-sized data, trying to figure out how to write bug reports and pull request comments, so that they would be acted upon faster.<\/p>\n\n","protected":false},"excerpt":{"rendered":"\n

Here is an interesting bit of research – do people prefer tabs or spaces when programming the most popular languages? Tabs or spaces. We are going to parse a billion files among 14 programming languages to decide which one is on top. The results are not very surprising and somewhat disappointing (for all of us, … Continue reading 400,000 GitHub repositories, 1 billion files, 14 terabytes of code: Spaces or Tabs?<\/span><\/a><\/p>\n\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"400,000 GitHub repositories, 1 billion files, 14 terabytes of code: Spaces or Tabs? #GitHub #BigQuery #stats #WebDev #programming","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false,"_links_to":"","_links_to_target":""},"categories":[1,18,62,1334],"tags":[3198,2243,2809,3444,38,1117,1041,1330],"keyring_services":[],"class_list":["post-26683","post","type-post","status-publish","format-standard","hentry","category-general","category-programming","category-technology","category-web-work","tag-big-data","tag-coding-style","tag-github","tag-google-bigquery","tag-php","tag-research","tag-statistics","tag-web-development"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t