Seo

Controlling AI Crawlers with robots.txt - How to Allow Search, Training and Agents Separately
AI crawlers have added more to write in robots.txt. A rundown of per-purpose bot names, Google-Extended and Content-Signal.

Blocking AI Bots with Cloudflare - Managed robots.txt and AI Crawl Control
Cloudflare writes robots.txt on your behalf and blocks AI bots at the edge. It also shows you which bots took how much.

Cloudflare Workers Static Site Guide - From Deployment to SEO
Putting a static site on Cloudflare, then layering code in front of it to improve SEO. A signpost for a four-part series.

How to Improve React SPA SEO - From Meta Tags to SSR with Cloudflare Workers
Put a React SPA on static hosting and the raw HTML is an empty shell. A record of improving it step by step with nothing but Cloudflare Workers — no new server.
Building a Hugo Blog - From Start to SEO
A step-by-step guide to building a blog with Notion→Hugo→GitHub Pages, connecting a custom domain, adding multilingual support, and applying security headers.

