{"id":12891,"date":"2010-07-29T16:16:21","date_gmt":"2010-07-29T14:16:21","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=12891"},"modified":"2010-07-29T16:16:21","modified_gmt":"2010-07-29T14:16:21","slug":"robots-disallow","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/","title":{"rendered":"Robots disallow"},"content":{"rendered":"\n

Andrey<\/a> forwarded me a link to last.fm robots.txt file<\/a>, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. \u00a0This one however does a little bit of more. \u00a0For machines, it serves as the reminder of Three Rules of Robotics<\/a> by Isaac Asimov. \u00a0For humans, it provides a tiny bit of geek humor. \u00a0Here is a screenshot, in case it disappears over time.<\/p>\n

\"\"<\/a><\/p>\n\n","protected":false},"excerpt":{"rendered":"\n

Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. \u00a0This one however does a little bit of more. \u00a0For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. \u00a0For humans, it provides a … Continue reading Robots disallow<\/span><\/a><\/p>\n\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_links_to":"","_links_to_target":""},"categories":[1,62,1334],"tags":[2418,335],"keyring_services":[],"class_list":["post-12891","post","type-post","status-publish","format-standard","hentry","category-general","category-technology","category-web-work","tag-humor","tag-search"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":7927,"url":"https:\/\/mamchenkov.net\/wordpress\/2004\/09\/20\/list-of-user-agents\/","url_meta":{"origin":12891,"position":0},"title":"List of User-Agents","author":"Leonid Mamchenkov","date":"September 20, 2004","format":false,"excerpt":"If for some reason you need a list of all sorts of different web user agents (spiders, robots, crawlers, browsers), then you can check the list here. These are separated into three huge pages with descriptions, and links to the vendors' sites. This might be useful when writing a robots.txt\u2026","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":9515,"url":"https:\/\/mamchenkov.net\/wordpress\/2005\/10\/01\/daily-del-icio-us-bookmarks\/","url_meta":{"origin":12891,"position":1},"title":"Daily del.icio.us bookmarks","author":"Leonid Mamchenkov","date":"October 1, 2005","format":false,"excerpt":"A huge list of blogging services was bookmarked today. Some of these are very well known, others are not. Planet Of The Blogs -- Irish blogs aggregator Tagged as: aggregator atom blog blogging blogs rss search syndication tools web xml Bitacle -- Blog search engine Tagged as: atom blog blogging\u2026","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16329,"url":"https:\/\/mamchenkov.net\/wordpress\/2012\/06\/06\/goodluck-jonathan\/","url_meta":{"origin":12891,"position":2},"title":"Goodluck Jonathan","author":"Leonid Mamchenkov","date":"June 6, 2012","format":false,"excerpt":"For years Google has been working hard to bring relevant information to the user faster and faster. \u00a0One of the many features they've implemented was a quick look-up of a country's president. \u00a0Just search for \"russia president\" or \"chine president\" and you'll get name right there, on the first page\u2026","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2012\/06\/Goodluck-Jonathan-500x313.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":11614,"url":"https:\/\/mamchenkov.net\/wordpress\/2009\/07\/01\/funny-gymnastics-by-paul-hunt\/","url_meta":{"origin":12891,"position":3},"title":"Funny gymnastics by Paul Hunt","author":"Leonid Mamchenkov","date":"July 1, 2009","format":false,"excerpt":"I love it when people who can do something really well start to fool around.\u00a0 Here is a good example, a discovery of the week, so to speak - comedy gymnastics by Paul Hunt. There is more on YouTube if you search for Paul Hunt.\u00a0 Here is another example.","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/tu-YAMiS5wA\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":12141,"url":"https:\/\/mamchenkov.net\/wordpress\/2010\/02\/12\/youtube-shenanigans\/","url_meta":{"origin":12891,"position":4},"title":"Youtube shenanigans","author":"Leonid Mamchenkov","date":"February 12, 2010","format":false,"excerpt":"Browsing around YouTube for more videos to watch I got redirected to an empty page that was saying \"I call shenanigans\". \u00a0It looked like this. Obviously, something went wrong. \u00a0But shenanigans? \u00a0Really? \u00a0What's that? \u00a0A brief Google search suggested an explanation from the Urban Dictionary: Once a person calls shenanigans,\u2026","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/02\/youtube_shenanigans.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":10872,"url":"https:\/\/mamchenkov.net\/wordpress\/2007\/10\/30\/the-future-of-sql\/","url_meta":{"origin":12891,"position":5},"title":"The future of SQL","author":"Leonid Mamchenkov","date":"October 30, 2007","format":false,"excerpt":"Slashdot lets us know that Google contributes code to MySQL.\u00c2\u00a0 Among the comments to that post, there is this one, which is while being rather funny holds some truth to it: They need to add a GOOGLE function to allow queries to be searched nicer. SELECT * FROM articles WHERE\u2026","rel":"","context":"In "All"","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/12891","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/comments?post=12891"}],"version-history":[{"count":0,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/12891\/revisions"}],"wp:attachment":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/media?parent=12891"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/categories?post=12891"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/tags?post=12891"},{"taxonomy":"keyring_services","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/keyring_services?post=12891"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}