Posts

All the articles I've posted.

• Using Cloudflare Workers to serve custom robots.txt

  18 May, 2024

  Using cloudflare workers to serve a custom Robots.txt and blocking AI bots scrapping your website content