{"id":63818,"date":"2026-06-09T06:11:01","date_gmt":"2026-06-09T06:11:01","guid":{"rendered":"http:\/\/flwnet.com\/index.php\/2026\/06\/09\/reuters-and-time-adopt-bot-blocking-whitelists-to-rein-in-ai-crawlers\/"},"modified":"2026-06-09T06:11:01","modified_gmt":"2026-06-09T06:11:01","slug":"reuters-and-time-adopt-bot-blocking-whitelists-to-rein-in-ai-crawlers","status":"publish","type":"post","link":"http:\/\/flwnet.com\/index.php\/2026\/06\/09\/reuters-and-time-adopt-bot-blocking-whitelists-to-rein-in-ai-crawlers\/","title":{"rendered":"Reuters and Time adopt bot-blocking whitelists to rein in AI crawlers"},"content":{"rendered":"<p>Reuters and Time are taking a new approach to bot blocking. Both publishers have recently started blocking all AI bots by default, and created whitelists of approved bots to access content on their sites.<\/p>\n<p>It\u2019s a strategy already adopted by publishers like <a href=\"https:\/\/digiday.com\/media\/people-incs-jon-roberts-on-the-ai-licensing-boom-and-the-revenue-lag\/\">People Inc.<\/a> at the beginning of this year and <a href=\"https:\/\/digiday.com\/media\/inside-the-atlantics-ai-bot-blocking-strategy\/\">The Atlantic<\/a> at the end of last year. Reuters and Time made the decision to block bots by default last month.<\/p>\n<p>\u201cWe saw that there was an imbalance between the value that publishers like Reuters provide and the value\u2026 that Reuters receives in kind, and so instead we went from a default allow-all to a default disallow all,\u201d said Josh London, head of Reuters Professional, who oversees the direct-to-consumer and direct-to-professional businesses. \u201cOur content costs money to create. It has significant value, and the access to it, we feel, must be earned.\u201d<\/p>\n<p><em>Continue reading this article on <a href=\"https:\/\/digiday.com\/media\/reuters-and-time-adopt-bot-blocking-whitelists-to-rein-in-ai-crawlers\/?utm_campaign=digidaydis&amp;utm_medium=rss&amp;utm_source=general-rss\">digiday.com<\/a>. Sign up for <a href=\"https:\/\/digiday.com\/newsletters\/?utm_campaign=digidaydis&amp;utm_medium=rss&amp;utm_source=general-rss\">Digiday newsletters<\/a> to get the latest on media, marketing and the future of TV.<\/em><\/p>","protected":false},"excerpt":{"rendered":"<p>Reuters and Time are taking a new approach to bot blocking. Both publishers have recently started blocking all AI bots by default, and created whitelists of approved bots to access content on their sites. It\u2019s a strategy already adopted by publishers like People Inc. at the beginning of this year and The Atlantic at the [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[],"class_list":["post-63818","post","type-post","status-publish","format-standard","hentry","category-media-entertainment"],"_links":{"self":[{"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/posts\/63818","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/comments?post=63818"}],"version-history":[{"count":0,"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/posts\/63818\/revisions"}],"wp:attachment":[{"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/media?parent=63818"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/categories?post=63818"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/flwnet.com\/index.php\/wp-json\/wp\/v2\/tags?post=63818"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}