{"id":28504,"date":"2018-04-20T08:09:50","date_gmt":"2018-04-20T06:09:50","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=28504"},"modified":"2018-04-20T08:09:50","modified_gmt":"2018-04-20T06:09:50","slug":"registry-of-open-data-on-aws","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2018\/04\/20\/registry-of-open-data-on-aws\/","title":{"rendered":"Registry of Open Data on AWS"},"content":{"rendered":"<!-- google_ad_section_start -->\n<p><a href=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"28505\" data-permalink=\"https:\/\/mamchenkov.net\/wordpress\/2018\/04\/20\/registry-of-open-data-on-aws\/aws-open-data\/\" data-orig-file=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?fit=783%2C521&amp;ssl=1\" data-orig-size=\"783,521\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"aws open data\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?fit=660%2C439&amp;ssl=1\" class=\"aligncenter size-medium wp-image-28505\" src=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data-500x333.png?resize=500%2C333&#038;ssl=1\" alt=\"\" width=\"500\" height=\"333\" srcset=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?resize=500%2C333&amp;ssl=1 500w, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?resize=768%2C511&amp;ssl=1 768w, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/04\/aws-open-data.png?w=783&amp;ssl=1 783w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/aws.amazon.com\/blogs\/aws\/\">AWS News Blog<\/a> covers the <a href=\"https:\/\/aws.amazon.com\/blogs\/aws\/new-registry-of-open-data-on-aws-roda\/\">Registry of Open Data on AWS<\/a>:<\/p>\n<blockquote><p>Almost a decade ago, my colleague Deepak Singh introduced the AWS Public Datasets in his post\u00a0<a href=\"https:\/\/aws.amazon.com\/blogs\/aws\/paging-researchers-analysts-and-developers\/\">Paging Researchers, Analysts, and Developers<\/a>. I\u2019m happy to report that Deepak is still an important part of the AWS team and that the Public Datasets program is still going strong!<\/p>\n<p>Today we are announcing a new take on open and public data, the\u00a0<a href=\"https:\/\/registry.opendata.aws\/\">Registry of Open Data on AWS<\/a>, or RODA. This registry includes existing Public Datasets and allows anyone to add their own datasets so that they can be accessed and analyzed on AWS.<\/p><\/blockquote>\n<p>Currently, there are 53 data sets in the registry.\u00a0 Each provides a tonne of data.\u00a0 Subjects vary from satellite imagery and weather monitoring to political and financial information.<\/p>\n<p>Hopefully, this will grow and expand with time.<\/p>\n<!-- google_ad_section_end -->\n","protected":false},"excerpt":{"rendered":"<!-- google_ad_section_start -->\n<p>AWS News Blog covers the Registry of Open Data on AWS: Almost a decade ago, my colleague Deepak Singh introduced the AWS Public Datasets in his post\u00a0Paging Researchers, Analysts, and Developers. I\u2019m happy to report that Deepak is still an important part of the AWS team and that the Public Datasets program is still going &hellip; <a href=\"https:\/\/mamchenkov.net\/wordpress\/2018\/04\/20\/registry-of-open-data-on-aws\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Registry of Open Data on AWS<\/span><\/a><\/p>\n<!-- google_ad_section_end -->\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Registry of Open Data on AWS #AWS #BigData #research #databases","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_links_to":"","_links_to_target":""},"categories":[1,62,1334],"tags":[3270,3198,1559,1117],"keyring_services":[],"class_list":["post-28504","post","type-post","status-publish","format-standard","hentry","category-general","category-technology","category-web-work","tag-amazon-aws","tag-big-data","tag-databases","tag-research"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":36094,"url":"https:\/\/mamchenkov.net\/wordpress\/2019\/02\/25\/how-to-build-a-serverless-ci-cd-pipeline-on-aws\/","url_meta":{"origin":28504,"position":0},"title":"How To Build a Serverless CI\/CD Pipeline On AWS","author":"Leonid Mamchenkov","date":"February 25, 2019","format":false,"excerpt":"\"How To Build a Serverless CI\/CD Pipeline On AWS\" is a nice guide to some of the newer Amazon AWS services, targeted at developers and DevOps. It shows how to tie together the following: Amazon EC2 (server instances)Docker (containers)Amazon ECR (Elastic Container Registry)Amazon S3 (storage)Amazon IAM (Identity and Access Management)Amazon\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/aws.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":25946,"url":"https:\/\/mamchenkov.net\/wordpress\/2016\/03\/16\/aws-database-migration-service\/","url_meta":{"origin":28504,"position":1},"title":"AWS Database Migration Service","author":"Leonid Mamchenkov","date":"March 16, 2016","format":false,"excerpt":"AWS Database Migration Service is yet another one of those tools that you always wished that somebody created, but never actually got to checking if it exists. \u00a0Here is a recent blog post showcasing the functionality. Do you currently store relational data in an on-premises Oracle, SQL Server, MySQL, MariaDB,\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"AWS Database Migration Service","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2016\/03\/dms_connect_endpoints_filled_3-500x409.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":28187,"url":"https:\/\/mamchenkov.net\/wordpress\/2017\/11\/06\/how-did-you-significantly-reduce-your-aws-cost\/","url_meta":{"origin":28504,"position":2},"title":"How did you significantly reduce your AWS cost?","author":"Leonid Mamchenkov","date":"November 6, 2017","format":false,"excerpt":"This Hacker News thread is full of tips, tricks, and references to reducing Amazon AWS costs.\u00a0 There is plenty of good advice from cleaning up the data and releasing unused resources, to monitoring the reserved instances usage, to moving data from elastic volumes to the Amazon S3 for cheaper storage\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28969,"url":"https:\/\/mamchenkov.net\/wordpress\/2018\/11\/12\/using-aws-cli-query-option-to-simplify-output\/","url_meta":{"origin":28504,"position":3},"title":"Using aws-cli &#8211;query Option To Simplify Output","author":"Leonid Mamchenkov","date":"November 12, 2018","format":false,"excerpt":"Eric Hammond shares a super-handy tip for those of us who work with Amazon AWS via the command line: I just learned about a recent addition to aws-cli: The\u00a0--query\u00a0option lets you specify what parts of the response data structure you want output. Instead of wading through pages of JSON output,\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":27706,"url":"https:\/\/mamchenkov.net\/wordpress\/2017\/06\/20\/5-fancy-reasons-and-7-funky-uses-for-the-aws-cli\/","url_meta":{"origin":28504,"position":4},"title":"5 Fancy Reasons and 7 Funky Uses for the AWS CLI","author":"Leonid Mamchenkov","date":"June 20, 2017","format":false,"excerpt":"5 Fancy Reasons and 7 Funky Uses for the AWS CLI\u00a0has a few good examples of AWS CLI usage: AWS CLI Multiple Profiles AWS CLI Autocomplete Formatting AWS CLI Output Filtering AWS CLI Output Using Waiters in the AWS CLI Using Input Files to Commands Using Roles to Access Resources\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24797,"url":"https:\/\/mamchenkov.net\/wordpress\/2015\/10\/02\/inside-amazons-cloud-computing-infrastructure\/","url_meta":{"origin":28504,"position":5},"title":"Inside Amazon\u2019s Cloud Computing Infrastructure","author":"Leonid Mamchenkov","date":"October 2, 2015","format":false,"excerpt":"Here's a little insight into the Amazon's cloud computing infrastructure: Amazon operates at least 30 data centers in its global network, with another 10 to 15 on the drawing board. How big is a data center? A key decision in planning and deploying cloud capacity is how large a data\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"aws regions","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2015\/10\/aws_regions-500x274.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"jetpack_sharing_enabled":true,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/28504","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/comments?post=28504"}],"version-history":[{"count":0,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/28504\/revisions"}],"wp:attachment":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/media?parent=28504"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/categories?post=28504"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/tags?post=28504"},{"taxonomy":"keyring_services","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/keyring_services?post=28504"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}