Cloudflare
Controlling AI Crawlers with robots.txt - How to Allow Search, Training and Agents Separately
AI crawlers have added more to write in robots.txt. A rundown of per-purpose bot names, Google-Extended and Content-Signal.
Blocking AI Bots with Cloudflare - Managed robots.txt and AI Crawl Control
Cloudflare writes robots.txt on your behalf and blocks AI bots at the edge. It also shows you which bots took how much.
Cloudflare Workers Static Site Guide - From Deployment to SEO
Putting a static site on Cloudflare, then layering code in front of it to improve SEO. A signpost for a four-part series.
Cloudflare Workers Static Site Hosting - Request Flow and Billing
What Workers Static Assets is and the order in which a request flows. When the Worker runs and when you get billed. What you need to know before layering dynamic processing onto a static site.
How to Improve React SPA SEO - From Meta Tags to SSR with Cloudflare Workers
Put a React SPA on static hosting and the raw HTML is an empty shell. A record of improving it step by step with nothing but Cloudflare Workers — no new server.
