Chapter 33 — Key Takeaways
Programmatic and Enterprise SEO at Scale — the one-page card.
The core claims
- Programmatic SEO is a neutral technique. Template + structured dataset = many pages, one per record. The same machine builds the web's most valuable properties and its worst doorway farms. The difference is entirely whether each page carries real value.
- Method is invisible to Google; value is everything. Google crawls and judges the finished page. There is no penalty for templating (or for AI assistance) — only for thin, near-duplicate, valueless results at scale ("scaled content abuse," doorway pages).
- A doorway page is a named spam violation. Pages built mainly to rank for a query/location while offering no value of their own, funneling users onward. The line between a location page and a doorway is real local content, not spun text. You cannot spin your way across it.
- Crawl budget is only a real concern at genuine scale. Most sites never need to think about it. It matters for sites with hundreds of thousands to millions of URLs, or large fast-changing ones.
- Enterprise SEO is a coordination problem, not a knowledge problem. At scale you recommend; others implement. Tickets, prioritization, and governance are the job.
- At scale, leverage cuts both ways. One template change improves — or breaks — every page built from it, all at once.
The quality bar — the four honest questions (apply to every generated page)
- Would this page be useful if it were the only page on the site?
- Does removing it make the web meaningfully worse for some real searcher?
- Does it carry information gain — something specific to this slice a generic page lacks?
- Could a competitor produce a byte-for-byte equal by running the same find-and-replace? (If yes → doorway.)
Doorway spam vs. legitimate location page
| Doorway (don't build) | Legitimate location page | |
|---|---|---|
| Local content | Spun; city name swapped in | Real, sourced, differentiated per city |
| Reason to exist | Catch "{service} {city}" traffic | Genuinely serve that service in that place |
| Duplication | ~95% identical across siblings | Shared service layer + unique local layer |
| Outcome | Demotion / manual-action risk | Localized organic rankings; supports GBP |
Crawl budget — the two forces (Google's own model)
| Force | What it is | Lever |
|---|---|---|
| Crawl capacity limit | How much crawling your server tolerates | Faster, more reliable server raises it |
| Crawl demand | How much Google wants to crawl you | Popularity, freshness, perceived quality |
Common crawl waste → fix: parameter/facet URLs → canonical + noindex then robots.txt; redirect chains →
flatten to one hop; 404s/soft 404s → honest status codes; duplicates → rel="canonical"; deep pages →
stronger internal links.
Log-file analysis — the ground truth of crawling
Reveals what Search Console's summary can't: exactly which URLs Googlebot fetches, how often, the status codes it meets, crawl latency of new pages, and where crawl is wasted. Verify Googlebot (reverse/forward DNS) first. Worth the effort at large scale only; small sites use Search Console → Crawl stats instead.
Scaling safely — the rules
- Subtract first. Build only matrix cells with real demand and a real local story. Fewer real pages beat more empty ones.
- Two layers per page. Shared service layer (templated, honest) + unique local layer (real, per-place).
- Double hub-and-spoke. Every leaf links up to its service hub and its city hub, and across to relevant siblings → no orphans, authority flows both ways.
- Never over-optimize anchors. Thousands of identical exact-match internal anchors is an engineered spam signal, not a boost.
- Treat template changes as site-wide deploys. Test on a sample; check rendered HTML, canonical, robots, and schema; stage and version; monitor by page-type, not page.
Key terms
programmatic SEO · template page · doorway page · location page at scale · log-file analysis · crawl capacity limit · crawl demand · index management · enterprise SEO
What you could do on your own site tomorrow
If you serve multiple services or areas, sketch your service×area matrix and run Rule 0: for each cell,
can you name five true, specific local facts a find-and-replace could never produce? If yes, it's a
location page worth building. If no, it's a doorway — don't build it. Then open Search Console → Crawl
stats and check whether Googlebot is meeting mostly 200s or a pile of redirects and 404s.