{"id":12891,"date":"2010-07-29T16:16:21","date_gmt":"2010-07-29T14:16:21","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=12891"},"modified":"2010-07-29T16:16:21","modified_gmt":"2010-07-29T14:16:21","slug":"robots-disallow","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/","title":{"rendered":"Robots disallow"},"content":{"rendered":"<!-- google_ad_section_start -->\n<p><a href=\"http:\/\/j4vk.com\/\">Andrey<\/a> forwarded me a link to <a href=\"http:\/\/www.last.fm\/robots.txt\">last.fm robots.txt file<\/a>, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. \u00a0This one however does a little bit of more. \u00a0For machines, it serves as the reminder of <a href=\"http:\/\/en.wikipedia.org\/wiki\/Three_Laws_of_Robotics\">Three Rules of Robotics<\/a> by Isaac Asimov. \u00a0For humans, it provides a tiny bit of geek humor. \u00a0Here is a screenshot, in case it disappears over time.<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"12892\" data-permalink=\"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/last_fm_robots\/\" data-orig-file=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?fit=332%2C341&amp;ssl=1\" data-orig-size=\"332,341\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"Last.fm robots.txt\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?fit=332%2C341&amp;ssl=1\" class=\"aligncenter size-full wp-image-12892\" title=\"Last.fm robots.txt\" src=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?resize=332%2C341&#038;ssl=1\" alt=\"\" width=\"332\" height=\"341\" srcset=\"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?w=332&amp;ssl=1 332w, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?resize=155%2C160&amp;ssl=1 155w, https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?resize=73%2C75&amp;ssl=1 73w\" sizes=\"auto, (max-width: 332px) 100vw, 332px\" \/><\/a><\/p>\n<!-- google_ad_section_end -->\n","protected":false},"excerpt":{"rendered":"<!-- google_ad_section_start -->\n<p>Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. \u00a0This one however does a little bit of more. \u00a0For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. \u00a0For humans, it provides a &hellip; <a href=\"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Robots disallow<\/span><\/a><\/p>\n<!-- google_ad_section_end -->\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false,"_links_to":"","_links_to_target":""},"categories":[1,62,1334],"tags":[2418,335],"keyring_services":[],"class_list":["post-12891","post","type-post","status-publish","format-standard","hentry","category-general","category-technology","category-web-work","tag-humor","tag-search"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.8 - aioseo.com -->\n\t<meta name=\"description\" content=\"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Leonid Mamchenkov\"\/>\n\t<meta name=\"google-site-verification\" content=\"VHvdD0_usx1_4DzKy_QCVcICVgX2EgA2ybELT-wl7kQ\" \/>\n\t<link rel=\"canonical\" href=\"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.8\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Leonid Mamchenkov - Life, universe, and everything else\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"Robots disallow - Leonid Mamchenkov\" \/>\n\t\t<meta property=\"og:description\" content=\"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2010-07-29T14:16:21+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2010-07-29T14:16:21+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/MamchenkovBlog\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@mamchenkov\" \/>\n\t\t<meta name=\"twitter:title\" content=\"Robots disallow - Leonid Mamchenkov\" \/>\n\t\t<meta name=\"twitter:description\" content=\"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a\" \/>\n\t\t<meta name=\"twitter:creator\" content=\"@mamchenkov\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BlogPosting\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#blogposting\",\"name\":\"Robots disallow - Leonid Mamchenkov\",\"headline\":\"Robots disallow\",\"author\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/author\\\/leonid\\\/#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/#person\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/mamchenkov.net\\\/wordpress\\\/wp-content\\\/uploads\\\/2010\\\/07\\\/last_fm_robots.png?fit=332%2C341&ssl=1\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#articleImage\",\"width\":332,\"height\":341},\"datePublished\":\"2010-07-29T16:16:21+02:00\",\"dateModified\":\"2010-07-29T16:16:21+02:00\",\"inLanguage\":\"en-US\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#webpage\"},\"articleSection\":\"All, Technology, Web work, humor, search\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/#listItem\",\"name\":\"Technology\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/#listItem\",\"position\":2,\"name\":\"Technology\",\"item\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/web-work\\\/#listItem\",\"name\":\"Web work\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/web-work\\\/#listItem\",\"position\":3,\"name\":\"Web work\",\"item\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/web-work\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#listItem\",\"name\":\"Robots disallow\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/#listItem\",\"name\":\"Technology\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#listItem\",\"position\":4,\"name\":\"Robots disallow\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/category\\\/technology\\\/web-work\\\/#listItem\",\"name\":\"Web work\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/#person\",\"name\":\"Leonid Mamchenkov\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#personImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3cf6df002a284d78fb6e9d8222ca4d102e0832035ed6bc8447008bd234e131a4?s=96&d=identicon&r=g\",\"width\":96,\"height\":96,\"caption\":\"Leonid Mamchenkov\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/author\\\/leonid\\\/#author\",\"url\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/author\\\/leonid\\\/\",\"name\":\"Leonid Mamchenkov\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#authorImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3cf6df002a284d78fb6e9d8222ca4d102e0832035ed6bc8447008bd234e131a4?s=96&d=identicon&r=g\",\"width\":96,\"height\":96,\"caption\":\"Leonid Mamchenkov\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#webpage\",\"url\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/\",\"name\":\"Robots disallow - Leonid Mamchenkov\",\"description\":\"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/2010\\\/07\\\/29\\\/robots-disallow\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/author\\\/leonid\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/author\\\/leonid\\\/#author\"},\"datePublished\":\"2010-07-29T16:16:21+02:00\",\"dateModified\":\"2010-07-29T16:16:21+02:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/#website\",\"url\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/\",\"name\":\"Blog of Leonid Mamchenkov\",\"description\":\"Life, universe, and everything else\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/mamchenkov.net\\\/wordpress\\\/#person\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"Robots disallow - Leonid Mamchenkov","description":"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a","canonical_url":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"google-site-verification":"VHvdD0_usx1_4DzKy_QCVcICVgX2EgA2ybELT-wl7kQ","miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BlogPosting","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#blogposting","name":"Robots disallow - Leonid Mamchenkov","headline":"Robots disallow","author":{"@id":"https:\/\/mamchenkov.net\/wordpress\/author\/leonid\/#author"},"publisher":{"@id":"https:\/\/mamchenkov.net\/wordpress\/#person"},"image":{"@type":"ImageObject","url":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/07\/last_fm_robots.png?fit=332%2C341&ssl=1","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#articleImage","width":332,"height":341},"datePublished":"2010-07-29T16:16:21+02:00","dateModified":"2010-07-29T16:16:21+02:00","inLanguage":"en-US","mainEntityOfPage":{"@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#webpage"},"isPartOf":{"@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#webpage"},"articleSection":"All, Technology, Web work, humor, search"},{"@type":"BreadcrumbList","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress#listItem","position":1,"name":"Home","item":"https:\/\/mamchenkov.net\/wordpress","nextItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/#listItem","name":"Technology"}},{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/#listItem","position":2,"name":"Technology","item":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/","nextItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/#listItem","name":"Web work"},"previousItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/#listItem","position":3,"name":"Web work","item":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/","nextItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#listItem","name":"Robots disallow"},"previousItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/#listItem","name":"Technology"}},{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#listItem","position":4,"name":"Robots disallow","previousItem":{"@type":"ListItem","@id":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/#listItem","name":"Web work"}}]},{"@type":"Person","@id":"https:\/\/mamchenkov.net\/wordpress\/#person","name":"Leonid Mamchenkov","image":{"@type":"ImageObject","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#personImage","url":"https:\/\/secure.gravatar.com\/avatar\/3cf6df002a284d78fb6e9d8222ca4d102e0832035ed6bc8447008bd234e131a4?s=96&d=identicon&r=g","width":96,"height":96,"caption":"Leonid Mamchenkov"}},{"@type":"Person","@id":"https:\/\/mamchenkov.net\/wordpress\/author\/leonid\/#author","url":"https:\/\/mamchenkov.net\/wordpress\/author\/leonid\/","name":"Leonid Mamchenkov","image":{"@type":"ImageObject","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#authorImage","url":"https:\/\/secure.gravatar.com\/avatar\/3cf6df002a284d78fb6e9d8222ca4d102e0832035ed6bc8447008bd234e131a4?s=96&d=identicon&r=g","width":96,"height":96,"caption":"Leonid Mamchenkov"}},{"@type":"WebPage","@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#webpage","url":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/","name":"Robots disallow - Leonid Mamchenkov","description":"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/mamchenkov.net\/wordpress\/#website"},"breadcrumb":{"@id":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/#breadcrumblist"},"author":{"@id":"https:\/\/mamchenkov.net\/wordpress\/author\/leonid\/#author"},"creator":{"@id":"https:\/\/mamchenkov.net\/wordpress\/author\/leonid\/#author"},"datePublished":"2010-07-29T16:16:21+02:00","dateModified":"2010-07-29T16:16:21+02:00"},{"@type":"WebSite","@id":"https:\/\/mamchenkov.net\/wordpress\/#website","url":"https:\/\/mamchenkov.net\/wordpress\/","name":"Blog of Leonid Mamchenkov","description":"Life, universe, and everything else","inLanguage":"en-US","publisher":{"@id":"https:\/\/mamchenkov.net\/wordpress\/#person"}}]},"og:locale":"en_US","og:site_name":"Leonid Mamchenkov - Life, universe, and everything else","og:type":"article","og:title":"Robots disallow - Leonid Mamchenkov","og:description":"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a","og:url":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/","og:image":"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg","og:image:secure_url":"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg","og:image:width":1024,"og:image:height":1024,"article:published_time":"2010-07-29T14:16:21+00:00","article:modified_time":"2010-07-29T14:16:21+00:00","article:publisher":"https:\/\/www.facebook.com\/MamchenkovBlog","twitter:card":"summary_large_image","twitter:site":"@mamchenkov","twitter:title":"Robots disallow - Leonid Mamchenkov","twitter:description":"Andrey forwarded me a link to last.fm robots.txt file, which, as many other robots.txt files, forbids search engine bots to access certain areas of the site. This one however does a little bit of more. For machines, it serves as the reminder of Three Rules of Robotics by Isaac Asimov. For humans, it provides a","twitter:creator":"@mamchenkov","twitter:image":"https:\/\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2026\/03\/leonid-sailing-beer.jpg"},"aioseo_meta_data":{"post_id":"12891","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"breadcrumb_settings":null,"limit_modified_date":false,"ai":null,"created":"2023-07-19 22:12:40","updated":"2026-01-15 05:52:51","seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mamchenkov.net\/wordpress\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/\" title=\"Technology\">Technology<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/\" title=\"Web work\">Web work<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tRobots disallow\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/mamchenkov.net\/wordpress"},{"label":"Technology","link":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/"},{"label":"Web work","link":"https:\/\/mamchenkov.net\/wordpress\/category\/technology\/web-work\/"},{"label":"Robots disallow","link":"https:\/\/mamchenkov.net\/wordpress\/2010\/07\/29\/robots-disallow\/"}],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":7927,"url":"https:\/\/mamchenkov.net\/wordpress\/2004\/09\/20\/list-of-user-agents\/","url_meta":{"origin":12891,"position":0},"title":"List of User-Agents","author":"Leonid Mamchenkov","date":"September 20, 2004","format":false,"excerpt":"If for some reason you need a list of all sorts of different web user agents (spiders, robots, crawlers, browsers), then you can check the list here. These are separated into three huge pages with descriptions, and links to the vendors' sites. This might be useful when writing a robots.txt\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":9515,"url":"https:\/\/mamchenkov.net\/wordpress\/2005\/10\/01\/daily-del-icio-us-bookmarks\/","url_meta":{"origin":12891,"position":1},"title":"Daily del.icio.us bookmarks","author":"Leonid Mamchenkov","date":"October 1, 2005","format":false,"excerpt":"A huge list of blogging services was bookmarked today. Some of these are very well known, others are not. Planet Of The Blogs -- Irish blogs aggregator Tagged as: aggregator atom blog blogging blogs rss search syndication tools web xml Bitacle -- Blog search engine Tagged as: atom blog blogging\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16329,"url":"https:\/\/mamchenkov.net\/wordpress\/2012\/06\/06\/goodluck-jonathan\/","url_meta":{"origin":12891,"position":2},"title":"Goodluck Jonathan","author":"Leonid Mamchenkov","date":"June 6, 2012","format":false,"excerpt":"For years Google has been working hard to bring relevant information to the user faster and faster. \u00a0One of the many features they've implemented was a quick look-up of a country's president. \u00a0Just search for \"russia president\" or \"chine president\" and you'll get name right there, on the first page\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2012\/06\/Goodluck-Jonathan-500x313.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":11614,"url":"https:\/\/mamchenkov.net\/wordpress\/2009\/07\/01\/funny-gymnastics-by-paul-hunt\/","url_meta":{"origin":12891,"position":3},"title":"Funny gymnastics by Paul Hunt","author":"Leonid Mamchenkov","date":"July 1, 2009","format":false,"excerpt":"I love it when people who can do something really well start to fool around.\u00a0 Here is a good example, a discovery of the week, so to speak - comedy gymnastics by Paul Hunt. There is more on YouTube if you search for Paul Hunt.\u00a0 Here is another example.","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/tu-YAMiS5wA\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":12141,"url":"https:\/\/mamchenkov.net\/wordpress\/2010\/02\/12\/youtube-shenanigans\/","url_meta":{"origin":12891,"position":4},"title":"Youtube shenanigans","author":"Leonid Mamchenkov","date":"February 12, 2010","format":false,"excerpt":"Browsing around YouTube for more videos to watch I got redirected to an empty page that was saying \"I call shenanigans\". \u00a0It looked like this. Obviously, something went wrong. \u00a0But shenanigans? \u00a0Really? \u00a0What's that? \u00a0A brief Google search suggested an explanation from the Urban Dictionary: Once a person calls shenanigans,\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mamchenkov.net\/wordpress\/wp-content\/uploads\/2010\/02\/youtube_shenanigans.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":10872,"url":"https:\/\/mamchenkov.net\/wordpress\/2007\/10\/30\/the-future-of-sql\/","url_meta":{"origin":12891,"position":5},"title":"The future of SQL","author":"Leonid Mamchenkov","date":"October 30, 2007","format":false,"excerpt":"Slashdot lets us know that Google contributes code to MySQL.\u00c2\u00a0 Among the comments to that post, there is this one, which is while being rather funny holds some truth to it: They need to add a GOOGLE function to allow queries to be searched nicer. SELECT * FROM articles WHERE\u2026","rel":"","context":"In &quot;All&quot;","block_context":{"text":"All","link":"https:\/\/mamchenkov.net\/wordpress\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/12891","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/comments?post=12891"}],"version-history":[{"count":0,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/posts\/12891\/revisions"}],"wp:attachment":[{"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/media?parent=12891"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/categories?post=12891"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/tags?post=12891"},{"taxonomy":"keyring_services","embeddable":true,"href":"https:\/\/mamchenkov.net\/wordpress\/wp-json\/wp\/v2\/keyring_services?post=12891"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}