<![CDATA[Xeiaso blog: Amazonbot is finally respecting robots.txt]]>About time! One down, twenty more to go (give or take 1000)

https://xeiaso.net/notes/2026/amazonbot-respecting-robots-txt/

@cadey@pony.social does this mean default bot policy will now let them through? Neat.

]]>https://fedi.wiki/topic/397dc688-e2a5-48ec-b338-d622705d707b/xeiaso-blog-amazonbot-is-finally-respecting-robots.txtRSS for NodeMon, 25 May 2026 01:49:45 GMTFri, 15 May 2026 01:41:35 GMT60