{"id":29023,"date":"2018-11-24T19:01:19","date_gmt":"2018-11-24T17:01:19","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=29023"},"modified":"2018-11-24T19:01:19","modified_gmt":"2018-11-24T17:01:19","slug":"specification-gaming-examples-in-ai","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2018\/11\/24\/specification-gaming-examples-in-ai\/","title":{"rendered":"Specification gaming examples in AI"},"content":{"rendered":"<!-- google_ad_section_start -->\n<p>Here&#8217;s a super fun <a href=\"https:\/\/docs.google.com\/spreadsheets\/u\/1\/d\/e\/2PACX-1vRPiprOaC3HsCf5Tuum8bRfzYUiKLRqJmbOoC-32JorNdfyTiRRsR7Ea5eWtvsWzuxo8bjOxCG84dAg\/pubhtml\">list of things<\/a> that artificial intelligence figured out by gaming the rules, like inconsistent and incomplete specifications, bugs, and other bits that humans frequently assume and ignore.<\/p>\n<p>Some examples to get you started are:<\/p>\n<ul>\n<li>Aircraft landing: evolved algorithm for landing aircraft exploited overflow errors in the physics simulator by creating large forces that were estimated to be zero, resulting in a perfect score.<\/li>\n<li>Block moving: a\u00a0robotic arm trained to slide a block to a target position on a table achieves the goal by moving the table itself.<\/li>\n<li>Data ordering patterns:\u00a0neural nets evolved to classify edible and poisonous mushrooms took advantage of the data being presented in alternating order, and didn&#8217;t actually learn any features of the input images.<\/li>\n<li>Road runner: agent kills itself at the end of level 1 to avoid losing in level 2.<\/li>\n<li>Ruler detector:\u00a0AI trained to classify skin lesions as potentially cancerous learns that lesions photographed next to a ruler are more likely to be malignant.<\/li>\n<li>Tetris: agent pauses the game indefinitely to avoid losing.<\/li>\n<\/ul>\n<p>This is truly thinking outside the box!<\/p>\n<!-- google_ad_section_end -->\n","protected":false},"excerpt":{"rendered":"<!-- google_ad_section_start -->\n<p>Here&#8217;s a super fun list of things that artificial intelligence figured out by gaming the rules, like inconsistent and incomplete specifications, bugs, and other bits that humans frequently assume and ignore. Some examples to get you started are: Aircraft landing: evolved algorithm for landing aircraft exploited overflow errors in the physics simulator by creating large &hellip; <a href=\"https:\/\/mamchenkov.net\/wordpress\/2018\/11\/24\/specification-gaming-examples-in-ai\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Specification gaming examples in AI<\/span><\/a><\/p>\n<!-- google_ad_section_end -->\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Specification gaming examples in AI #AI #MachineLearning #research","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_links_to":"","_links_to_target":""},"categories":[1,62],"tags":[1462,1192,3493,1117],"keyring_services":[],"class_list":["post-29023","post","type-post","status-publish","format-standard","hentry","category-general","category-technology","tag-artificial-intelligence","tag-computer-science","tag-machine-learning","tag-research"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":29139,"url":"https:\/\/mamchenkov.net\/wordpress\/2018\/12\/27\/data-science-cheatsheets\/","url_meta":{"origin":29023,"position":0},"title":"Data Science Cheatsheets","author":"Leonid Mamchenkov","date":"December 27, 2018","format":false,"excerpt":"Here's a good collection of cheatsheets for anyone involved with Big Data and machine learning. Whether you are already well versed in the subject, or just starting, I'm sure you'll find something useful. And while we are on the subject of machine learning, check out this repository for examples in\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2018\/12\/ml_map_scikit_learn.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":35049,"url":"https:\/\/mamchenkov.net\/wordpress\/2019\/02\/18\/periodic-table-of-amazon-web-services\/","url_meta":{"origin":29023,"position":1},"title":"Periodic Table of Amazon Web Services","author":"Leonid Mamchenkov","date":"February 18, 2019","format":false,"excerpt":"A lot has been said about the wide range of Amazon Web Services (AWS). They are plenty and cover a whole lot of technologies - from low level infrastructure to artificial intelligence. It is difficult to grasp just how big and complex the AWS feature set. But I think the\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2019\/02\/Periodic-Table-of-Amazon-Web-Services.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":7527,"url":"https:\/\/mamchenkov.net\/wordpress\/2004\/05\/25\/getting-ready-for-artificial-intelligence-again\/","url_meta":{"origin":29023,"position":2},"title":"Getting ready for Artificial Intelligence &#8230; again","author":"Leonid Mamchenkov","date":"May 25, 2004","format":false,"excerpt":"Being a lazy bastard and a horrible student such as I am, there is no surprise in that I failed so many courses in the college. I am currently standing at 3 courses left for my Bachelor's degree. One of these three courses - Artificial Intelligence - seems to be\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28383,"url":"https:\/\/mamchenkov.net\/wordpress\/2018\/02\/15\/how-to-analyze-tweet-sentiments-with-php-machine-learning\/","url_meta":{"origin":29023,"position":3},"title":"How to Analyze Tweet Sentiments with PHP Machine Learning","author":"Leonid Mamchenkov","date":"February 15, 2018","format":false,"excerpt":"Machine learning is rarely mentioned in the same sentence (or article, for that matter) with PHP, so each time this happens, I'm all ears.\u00a0 Here's one that I came across recently -\u00a0How to Analyze Tweet Sentiments with PHP Machine Learning. Unlike many other \"hello world\" kind of examples, this article\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":27949,"url":"https:\/\/mamchenkov.net\/wordpress\/2017\/09\/06\/grakn-and-graql-a-database-for-ai\/","url_meta":{"origin":29023,"position":4},"title":"Grakn and Graql &#8211; a database for AI","author":"Leonid Mamchenkov","date":"September 6, 2017","format":false,"excerpt":"From the grakn.ai website: Grakn\u00a0is a distributed\u00a0hyper-relational\u00a0database for knowledge-oriented systems. Grakn enables machines to manage complex data that serves as a knowledge base for cognitive\/AI systems. Graql\u00a0is Grakn's reasoning (through OLTP) and analytics (through OLAP) query language. Graql is a much higher level abstraction over traditional query language - SQL,\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24717,"url":"https:\/\/mamchenkov.net\/wordpress\/2015\/09\/10\/free-data-science-books\/","url_meta":{"origin":29023,"position":5},"title":"Free Data Science Books","author":"Leonid Mamchenkov","date":"September 10, 2015","format":false,"excerpt":"I came across\u00a0a collection of free data science books: Pulled from the web, here is a great collection of eBooks (most of which have a physical version that you can purchase on Amazon) written on the topics of Data Science, Business Analytics, Data Mining, Big Data, Machine Learning, Algorithms, Data\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/29023","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/comments?post=29023"}],"version-history":[{"count":0,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/29023\/revisions"}],"wp:attachment":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/media?parent=29023"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/categories?post=29023"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/tags?post=29023"},{"taxonomy":"keyring_services","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/keyring_services?post=29023"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}