Chapter 30: Rank Tracking, Competitive Analysis, and the Tools That Power Professional SEO

"Not everything that counts can be counted, and not everything that can be counted counts." — William Bruce Cameron, Informal Sociology (1963)

Overview

An owner leans over your shoulder and asks the most natural question in SEO: "Where do we rank for furnace repair?" It sounds like it has an answer — a number, like a temperature. It does not. The honest reply is a question back: "For whom, on what device, in which of our five cities, on which day, and above or below the AI Overview and the map?" Because the person searching "furnace repair" from a phone in Cedar Hills at lunchtime, the person searching it from a desktop in Northgate at 9 p.m., and the person who has visited your site before all see a different results page. There is no single rank. There is a distribution of ranks, and the first job of this chapter is to make you stop believing in a number that was never real.

That is the measurement half. The other half is the mirror: what do the sites beating us have that we don't? This is competitive analysis, and it is where two ideas this book has built toward finally get to work. First, your real competitors are almost never who you think — they are whoever ranks for the queries you want, which for a local home-services company means national publishers, video platforms, and directory giants far more often than the HVAC firm across town. Second, once you know who actually ranks, you can read, systematically, the specific things they have that you lack: the topics they cover and you don't (a content gap), the queries they rank for and you don't (a keyword gap), and the sites that link to them and not to you (a backlink gap). Turn those three gaps into a scored list, and "improve the site" becomes a concrete plan.

This is Part V's theme — evidence over folklore — turned inward and held to its hardest test. It is easy to demand evidence of other people's SEO claims. It is harder to hold your own dashboard to the same standard: to admit that a rank is an estimate, that a tool's number is a guess, that "we rank for 12,000 keywords" is a vanity number, and that most of what a paid tool sells you is speed, not truth. We will do exactly that, and we will decide, without hype, whether you need to spend a dollar on tools at all.

In this chapter, you will learn to:

• Explain why personalization, location, device, and SERP features make a single "rank" a fiction — and ask "#N for whom, and where?" every time.
• Track the handful of priority terms that matter, read them as trends rather than obsessing over daily noise, and use Search Console's average position honestly.
• Find your real SEO competitors off the SERP, and see the three different competitor sets a local business actually faces.
• Run content-gap and keyword-gap analysis, and reverse-engineer what the page outranking you actually contains.
• Turn a competitor's backlinks into a prospect list of links you could plausibly earn.
• Decide between free and paid tools without wasting money, and know what each professional tool does best.

Learning Paths

Competitive analysis rewards everyone, but where you dig differs by track. 🏪 Local Business (Rivertown's path): live in §30.1 (your rank is intensely location-dependent), §30.3 (your three kinds of competitor — local rivals, directories, and publishers), and the Strategy File. 📝 Content Creator: §30.2 (track priority terms), §30.4 (content and keyword gaps are your editorial engine), and §30.7. 🛒 E-Commerce: weight §30.4 and §30.7 — competitor and gap analysis at catalog scale, and the site-crawling tools that keep thousands of pages honest (our store anchor, Summit Gear Co., arrives in Chapter 31). 🔧 Developer: §30.7 is your section — Screaming Frog and crawler tools are how you see your site the way a bot does, feeding the technical audit of Chapter 38. 📊 Strategist: the whole chapter, especially §30.6 — the tool-buying decision is a budget decision you will own, and competitive analysis is the intelligence layer under every roadmap.

30.1 Why a single "rank" doesn't exist

Let us define the practice first, and then dismantle the assumption hiding inside it. Rank tracking is the practice of monitoring where your pages appear in search results for a chosen set of keywords, over time. It is useful, and we will do it sensibly in §30.2. But the word "rank," singular, smuggles in a falsehood, and the falsehood costs people real money and real arguments: it implies that for a given keyword there is one position your page holds, the way a runner holds a place in a race. There isn't. Google assembles a results page at the moment of the search, tailored to the searcher, and the tailoring routinely changes which results appear and in what order.

Recall the promise Chapter 1 made when it walked the pipeline's final stage: "there is no single, universal ranking… when someone says 'we rank #3 for X,' the honest question is always '#3 for whom, and where?'" This chapter is where that promise comes due. Here are the forces that make rank plural.

• Location. The single biggest factor, and for a local business, the decisive one. Search "emergency plumber" from Cedar Hills and from Millhaven and you get different local packs, different organic orders, and different businesses entirely, because distance is a ranking input for local intent (Chapter 25). A page can be #2 downtown and invisible in a suburb ten miles away. Both are true at once.
• Personalization. Define it plainly. Personalization is Google's tailoring of results to an individual searcher based on signals like their location, language, device, and — to a limited and often overstated degree — their prior activity. If you have visited a site before, it may appear a little higher for you, which is exactly why checking your own rankings by searching for them in your own logged-in browser is the least reliable measurement in all of SEO: you are the most personalized searcher in your own results.
• Device. The mobile SERP and the desktop SERP for the same query are not the same page. Mobile shows more local and "near me" emphasis, different SERP-feature layouts, and — because the screen is smaller — pushes organic results further down beneath ads, the local pack, and any AI Overview. Since Google indexes the mobile version of your site (mobile-first indexing, Chapter 17) and most local searches happen on phones, mobile is usually the ranking that matters more.
• Time and volatility. Rankings move day to day even when nothing about your page changes, because Google is constantly recrawling, reassessing, and testing. This churn has a name. SERP volatility is the ordinary, ongoing fluctuation of search rankings over time, driven by Google's continual re-evaluation of pages and by algorithm updates. A term that is #6 on Tuesday and #9 on Thursday and #7 on Saturday has not necessarily done anything; it is flickering within a normal band. Mistaking that flicker for a trend is one of the most common ways SEOs panic themselves and their clients.
• SERP features and intent shift. The page around your result changes what your result is worth. Being the #1 organic listing beneath an AI Overview, a local pack, a featured snippet, and four ads is a very different piece of real estate than being #1 on a clean ten-blue-links page. The rank is the same number; the reality is not (we take the AI-Overview version of this head-on in Chapter 36).

🚫 SEO Myth: "We rank #1 for [keyword]." Stated flatly, this is not so much false as incomplete to the point of being misleading — and it is the most common sentence in SEO. Ranking is not a property of your page; it is a property of a specific search by a specific person in a specific place on a specific device at a specific moment, with a specific results-page layout around it. "We rank #1" almost always means "I searched it just now, logged in, from my office, on my laptop, and saw us on top" — which is the single most personalized, least representative measurement available. The professional's version is never a bare number. It is: "For 'water heater replacement cost,' we average around position 6 on mobile in our metro over the last month, trending up." That sentence has a term, a device, a place, a time window, and a direction — and every one of them is load-bearing.

Here is what that looks like rendered, so the abstraction becomes concrete.

📄 Read the SERP

text FIGURE 30.1 — "One query, three searchers" [constructed teaching example] THE QUERY / PAGE "furnace repair" — one query, three different real-world searchers. WHAT'S THERE SEARCHER A (phone · Cedar Hills · noon): an AI Overview, three ads, then a local pack of three businesses (Rivertown is #2 in the pack), then organic — Yelp, Angi, a rival's page. Organic result #1 is barely above the fold. SEARCHER B (desktop · Northgate · 9 p.m.): a different local pack (Rivertown is NOT in it — too far from Northgate), a different organic order, no AI Overview shown this time. SEARCHER C (logged in · has visited rivertownhome.example before · downtown): Rivertown's own page sits a notch higher than it does for anyone else. WHAT IT SHOWS "Rank" is a distribution, not a point. For local intent, LOCATION dominates everything; device reshuffles the layout; personalization nudges your own view. Three searchers, three answers to "where do we rank?", all correct. WHAT IT DOESN'T It doesn't tell you which is "the" rank (none is), how many people search from each place, or how those positions convert. And Searcher C's flattering view is the LEAST trustworthy — it's you, personalized. THE MOVE Stop asking for "the rank." Track from a FIXED, declared location and device so you're at least measuring the same thing each time (§30.2). For anything local, measure per city, because the metro average hides the truth. THE LESSON Always finish the sentence: "#N — for whom, and where?" A rank without a searcher attached is a number without a unit.

🔎 How Search Sees It Why is there no stored "rank" to look up? Because rankings are computed at query time, not filed on a shelf. When a search arrives, Google pulls candidate pages from the index and orders them for that query, from that place, on that device, for that person, folding location and personalization and the current state of its constantly-updated systems into the ordering (this is the "serving" stage from Chapter 1). There is no master leaderboard sitting in a database that a tool can read; there is only the result of a fresh computation. Every "rank" you ever see — in a tool, in Search Console, in your own browser — is therefore a sample of that computation from one vantage point, not a reading of a fixed fact. Once you internalize that, rank tracking stops being "look up our position" and becomes what it really is: "sample the same vantage point repeatedly and watch the trend."

What rank tracking can do: give you a consistent, repeatable sample — the same terms, from the same declared location and device, on a schedule — so you can see direction and catch big moves. What it cannot do: hand you "the" rank, capture every personalized variant your real customers see, or tell you, by itself, whether a ranking is making you any money. It measures motion, not value; §30.2 keeps it in its lane, and Chapter 29 already warned you not to mistake a ranking for a result.

30.2 Rank tracking done sensibly: priority terms, trends not obsession

If there is no single rank, why track at all? Because direction is real and useful even when position is fuzzy. A term that climbs from an average of 14 to 8 to 5 over three months is telling you something true and actionable, even though no single one of those numbers is "the" rank. The discipline is to track in a way that surfaces the direction and suppresses the noise — and the two enemies of that discipline are tracking too much and looking too often.

Track priority terms, not everything. The temptation, especially once you own a tool that will track thousands of keywords, is to track thousands of keywords. Resist it. A rank report with 4,000 rows is not information; it is a place information goes to hide. Track a curated set of priority terms — the keywords that actually matter to the business, drawn straight from the opportunity work of Chapter 7. For Rivertown that is a few dozen terms, not a few thousand: the money-making service × city queries ("furnace repair Cedar Hills," "emergency electrician Northgate"), the high-value commercial terms (the "water heater replacement cost" query behind the page stuck at #11), and a handful of informational terms you are deliberately building authority on. If a term isn't worth a decision, it isn't worth a row in your tracker.

Why does that curation matter beyond tidiness? Because tracking connects to value, and value is the point. Consider — with numbers that are illustrative, not a forecast — a priority term getting roughly 1,000 searches a month. At an average position around 11 (top of page two), it might earn on the order of one percent of the clicks: 1,000 × 0.01 = 10 visits a month. Move it to position 5 and it might earn five percent: 1,000 × 0.05 = 50 visits. That jump from 10 to 50 is why you tracked the term — it ties a ranking change to a traffic change to, eventually, a revenue change. (The click-through-by-position curve that turns a position into a visit count is itself something we refuse to fake-quantify until Chapter 39, where forecasting gets its honest treatment. Here the point is only: track the terms whose movement would mean something.)

Watch trends, not the daily tape. Given SERP volatility (§30.1), checking your rankings every morning is worse than useless — it manufactures anxiety out of noise and tempts you to "fix" pages that are simply flickering. Look at a rolling trend over weeks and months. Set the tracker's location and device explicitly (a local business should track from its actual cities, on mobile, because that is what its customers use), so that every sample measures the same thing. And segment: the metro-wide average for "furnace repair" is far less useful to Rivertown than five separate city-level trends, because the whole game is winning each local market.

⚖️ Evidence Check Claim: "Search Console's average position IS our rank." Where does that sit on the honesty scale? — What's true: Search Console's average position (Chapter 27) is real Google data — it is Google telling you, from actual impressions, roughly where your pages appeared. It is free, it covers every query you actually showed up for, and it is the most honest single source you have. Use it. — The honest caveat: it is an average across everything — every location, device, and personalized variant, weighted by where impressions happened. If you rank #2 in Cedar Hills and #20 in Millhaven, Search Console may report an average of, say, 9 — a number that describes neither city. A dedicated rank tracker does the opposite: it reports a consistent position from one declared vantage point, which is controlled but artificial (it's one robot in one city, not your real customers). Neither is "the truth." Search Console gives you the honest blended reality; a rank tracker gives you a clean, comparable sample. Read each for what it is, and never quote either to a decimal place as if it were a fact.

🛠️ Try It on Your Site Build a sane tracker in fifteen minutes, for free. Open Search Console's Performance report, set the date range to the last three months, and write down ten priority queries — the ones tied to money or to a goal, not the ones with the biggest impression counts. Note each one's average position. Now change the date range to the previous three months and note the positions again. You have just done real rank tracking: not "what is our rank today," but "which priority terms are trending up, which are trending down, and which are flickering in place." That direction — not any single number — is what you act on and what you report (Chapter 29).

There is a limit worth stating bluntly, because rank tracking is where SEOs most often confuse motion with progress. A ranking is a means, not an end. A page that climbs to #1 for a term nobody valuable searches, or that ranks well but converts no one, has moved a number without moving the business — the definition of a vanity metric that Chapter 29 taught you to distrust. Track rankings because they are an early, sensitive signal that your work is or isn't landing; then always walk the signal forward to traffic (Chapter 28) and to conversions and revenue, or you are just admiring a scoreboard for a game you might not be winning.

🔗 Connection Rank tracking sits inside a measurement stack you have already built. Chapter 27 (Search Console) is the free rank-and-impression source; Chapter 28 (GA4) connects the visit to behavior and conversions; Chapter 29 (SEO Reporting) decides which rankings are KPIs worth reporting versus vanity noise, and defines share of voice — the share of total possible visibility you hold across a set of priority terms, a saner headline number than any single position. This chapter feeds all three: it produces the priority-term trends they consume.

30.3 Identifying your real SEO competitors (they are not your business competitors)

Ask Marisa Delgado who Rivertown's competitors are and she will name the two other family HVAC firms across the metro — the trucks she sees at the supply house, the names on the rival yard signs. Those are her business competitors, and for winning a bid on a new-furnace install, they are exactly right. For SEO, they are often beside the point. Your SEO competitor is any website that ranks for the queries you want to rank for — regardless of whether it is a business rival, and regardless of whether it even sells anything. This is theme 2 (intent is the foundation) wearing a competitive-analysis hat: Google ranks whatever best matches the searcher's intent, so the pages you must beat are defined by the SERP, not by your industry.

Read the SERP for your priority terms (the Chapter 3 answer-key move, one more time) and a local business discovers it faces not one kind of competitor but three, and they demand completely different strategies.

📄 Read the SERP

text FIGURE 30.2 — "Rivertown's three kinds of competitor" [constructed teaching example] THE QUERY / PAGE Three of Rivertown's priority queries, each SERP read by eye. WHAT'S THERE (1) "furnace repair Cedar Hills" → a LOCAL PACK (two local rival firms + Rivertown), then organic dominated by DIRECTORIES: Yelp, Angi, a "top 10 HVAC in Cedar Hills" listicle, HomeAdvisor. (2) "how to relight a furnace pilot light" → This Old House, a YouTube video, a Reddit thread, Family Handyman. No local firms at all. (3) "water heater replacement cost" → national home-improvement publishers and two mid-size contractor blogs. (This is the SERP the page stuck at #11 is losing on.) WHAT IT SHOWS Three query types, three competitor sets. The business rival across town appears in ONE of them, and even there is outranked in organic by DIRECTORIES. The "competitors" for the how-to query are publishers and a video platform, not HVAC companies. WHAT IT DOESN'T It doesn't tell you which query is worth the most to Rivertown, or which competitor you can realistically beat — that's the value × winnability judgment from Chapter 7. THE MOVE Study the competitor set PER query cluster. For the local term, accept you probably can't out-rank Yelp in organic — the winnable fight is the LOCAL PACK (Chapter 25). For the how-to term, your competitor is a publisher, and you beat it with a genuinely expert, complete answer. For the cost term, study the contractor blogs that outrank you. THE LESSON Your SEO competitors are whoever holds the SERP you want — often publishers, video, and directories, not the rival with the similar business card.

Name the three sets, because each is a different chapter's fight:

1. Local rivals — the other service businesses competing for your "near me" and service × city terms. These you meet mostly in the local pack, where the fight is Google Business Profile, proximity, reviews, and prominence (Chapter 25), not blog content.
2. Directories and aggregators — Yelp, Angi, HomeAdvisor, Thumbtack, and "best [service] in [city]" listicle sites. These are the quiet giants of local search: they have enormous authority and rank for nearly every local commercial query, often above every individual business. You will rarely out-rank them in organic, and trying to is usually a waste. The correct move is judo — be listed and well-reviewed inside them (they are citations, Chapter 25), and win the local pack and your own branded searches, rather than fighting them on ground they own.
3. Publishers and platforms — This Old House, Family Handyman, Forbes Home, YouTube, Reddit, manufacturer sites. These own the informational queries ("how to," "why is my," "vs," "cost"). Here you genuinely compete on content, and a real HVAC company writing from hands-on experience has an E-E-A-T advantage (Chapter 5) a generalist publisher can't easily fake — if the page is as complete as theirs (§30.4).

How do you find them beyond reading SERPs by hand? Paid tools (§30.6–30.7) offer a "competing domains" or "organic competitors" report: enter your domain, and the tool lists the sites whose ranking keywords overlap most with yours. It is a genuine time-saver at scale. It is also an estimate built from keyword overlap, so read it with judgment — a site can overlap with you on a hundred irrelevant terms and not really be a competitor for anything you value, while your most important rival for one high-value term barely registers. The tool nominates candidates; you confirm them by asking the only question that matters: do they hold the SERPs I actually care about?

🔗 Connection The aggregator problem — that Yelp, Angi, and directory listicles out-rank individual local businesses for commercial local terms — is why Chapter 25 (Local SEO) treats those very sites as citations to appear in rather than enemies to defeat, and why the winnable local prize is the local pack, decided by proximity, prominence, and reviews. Identifying them here as "competitors" and treating them as "citation opportunities" there is the same fact seen from two chapters.

30.4 Content-gap and keyword-gap analysis

Once you know who ranks, the next question is surgical: what, specifically, do they have that we don't? There are two answers at two scales, and keeping them distinct keeps your work sharp.

A content gap, in Chapter 8's definition, is a topic or query that is valuable to your audience and that competitors rank for, but that your site either doesn't cover at all or covers poorly. That is the topic scale — whole subjects or pages missing from your site. Alongside it lives a tighter, query-level cousin. A keyword gap is the set of specific keywords your competitors rank for that you don't rank for at all — the precise search terms where they appear and you are absent. The distinction is practical: a keyword-gap report (a tool feature — enter your domain plus two or three competitors and get, in seconds, the terms they rank for and you don't) points you at whole missing pages and topics; a content-gap read of a single SERP points you at what's missing inside a page you already have. You need both, and they answer different questions: "what should we build?" and "what should this page become?"

🔄 Check Your Understanding A tool report says a competitor ranks for "heat pump vs furnace" and you don't; separately, you notice the page outranking you for "furnace repair cost" has a whole section on financing that your page lacks. Which of these is a keyword gap and which is a content gap, and what different action does each imply?

Answer

"Heat pump vs furnace" is a keyword gap — a whole query/topic you have no page for; the action is to decide whether to build a new page for it (after the Chapter 7 value × winnability test). The missing financing section is a content gap inside an existing page — the action is to improve that page's comprehensiveness (Chapter 9), not to build something new. Keyword gaps mostly point at missing pages; page-level content gaps point at missing sections within pages you already have.

Start with the site-level keyword gap, because it is the one the tools do best. Feed in Rivertown and its three sharpest competitors and the report returns a list: "heat pump vs furnace," "AC not blowing cold air," "how much does a new furnace cost," "signs of a gas leak," "why is my breaker tripping" — dozens of terms competitors rank for and Rivertown doesn't. This is a genuine goldmine and a genuine trap, and Chapter 8 already named the trap: a gap is a candidate for your plan, not an entry on it. The failure mode is treating the tool's list as a to-do list and dutifully writing forty-one articles — which is exactly how a site accumulates the 300 dead, thin, traffic-less posts that Chapter 12's content audit exists to prune. Every gap must still pass the Chapter 7 test before it earns a page: is it valuable (does this searcher ever become a Rivertown customer, or at least a subscriber or a link?) and is it winnable (can a site with Rivertown's authority realistically rank against who already does?). The gaps that pass become cluster pages; the rest you note and ignore, and ignoring them is discipline, not laziness — it is how you keep the site's average quality high, which is itself an asset.

Now the page-level content gap — and this is where the page stuck at #11 finally gets its competitive diagnosis. We have worked on this page for the whole book. Chapter 3 found its title answered the wrong question; Chapter 9 rewrote the title to match intent; Chapter 15 linked it from the plumbing hub so authority could reach it; Chapter 22 showed the site simply lacks the external authority to push it over the top. But Chapter 1's very first diagnosis named something we have never itemized: the winning page "is more complete, because it answers the five follow-up questions this one ignores." Competitive analysis is how we turn that vague "more complete" into a precise, closable list — by reading, subtopic by subtopic, exactly what the pages outranking Rivertown actually contain.

📄 Read the Report

text FIGURE 30.3 — "The content gap on the page stuck at #11" [constructed teaching example] THE PAGE Rivertown's "replace your water heater" guide vs. the two pages outranking it for "water heater replacement cost." WHAT'S THERE THE COMPETITORS' PAGES cover, section by section: cost broken down by tank size and fuel type; tank vs. tankless price difference; unit cost vs. labor cost; permit and code costs; signs you need replacement (not repair); DIY-vs-pro (and why pro); expected lifespan and timing; brand comparison; financing options. Nine distinct buyer questions, answered. RIVERTOWN'S PAGE covers: "We replace water heaters — call us," a service-area line, and a phone number. One of the nine. WHAT IT SHOWS The gap is specific and closable. This is Chapter 1's "five follow-up questions it ignores," itemized to nine. The outranking pages aren't better *written*; they are more *complete* — they answer the questions a person deciding whether to spend \$1,500 on a water heater actually asks. WHAT IT DOESN'T It does NOT guarantee that adding these sections vaults the page to #1 — Google decides, and (Chapter 22) the site still needs more external authority. Nor does it rank the nine by importance; the People Also Ask box and intent (Chapter 3) tell you which matter most. THE MOVE Rebuild the page to genuinely answer the buyer's real questions — comprehensiveness (Chapter 9), keeping the intent-matched title (Chapters 3, 9) and the internal links (Chapter 15). The content gap IS the page's to-do list, handed to you by the competition. THE LESSON Competitive analysis makes "be more complete" concrete. The page outranking you is a specification for what "complete" means for that exact query — read it, don't guess.

That figure is the whole competitive-analysis argument in one table. Notice what it is not: it is not "copy the competitor." It is reading the SERP as a specification of what searchers for this query need, and then deserving to rank by meeting that need at least as well — the cooperative, non-adversarial stance of theme 1. The competitor's page is not a target to plagiarize; it is Google's own evidence of what a complete answer to this question looks like.

🔗 Connection Content-gap and keyword-gap analysis are where several earlier chapters converge. The content gap was defined and first analyzed in Chapter 8 (Content Strategy), §8.3; the value × winnability filter that every gap must pass is Chapter 7, §7.7; how you close a page-level gap — comprehensiveness, answering early, heading structure — is Chapter 9 (Writing for Search); and the danger of closing gaps by mass- producing thin pages, plus the cannibalization of two pages chasing one keyword, is Chapter 12. This chapter supplies the competitive intelligence; those chapters supply the craft to act on it.

The honest limits of gap analysis are the same ones Chapter 8 flagged, now doubled by the tools' seductive completeness. A keyword-gap tool shows you what competitors rank for — not whether it is valuable to you, not whether you can win it, and not whether the "gap" exists because the topic is a dead end you were wise to skip. And it can only compare you to competitors you chose; pick the wrong three and you get the wrong gaps. The tool is a floodlight on the territory; deciding where to actually walk is still your job, and it is the judgment no subscription performs for you.

30.5 Backlink-gap analysis

Content and keywords are the on-page half of "what do they have that we don't." The off-page half is links, and it is the half that most directly explains the page stuck at #11. Chapter 22 diagnosed the last mile: Rivertown's site simply holds too little external authority for its architecture to distribute, because the competitor is "referenced by local news and home-improvement sites" and Rivertown is not. Backlink-gap analysis turns that vague deficit into a concrete, earnable prospect list.

A backlink gap is the set of referring domains that link to your competitors but not to you — the websites that have chosen to vouch for sites like yours, while your site is absent from their pages. It builds directly on Chapter 22's vocabulary: remember that a referring domain is a unique linking website (counted once, however many links it sends), and that referring domains — not raw backlink counts — are the meaningful unit. The analysis, sometimes called a "link intersect," is simple in concept: take two or three competitors and your own domain, and ask the tool for the sites that link to the competitors but not to you. What comes back, for a business like Rivertown, is a warm list of proven "will-link-to-a-local-HVAC-company" sources.

📄 Read the Report

text FIGURE 30.4 — "Rivertown's backlink gap: who vouches for the rivals, not for us" [constructed teaching example] WHAT WE'RE LOOKING AT Referring domains linking to ≥2 of Rivertown's local competitors but NOT to rivertownhome.example (a link-intersect report). WHAT'S THERE • the metro Chamber of Commerce member directory • two "Best HVAC companies in [Rivertown]" roundup posts on regional blogs • the county home-builders' association members page • a furnace manufacturer's "find a certified installer" locator • the regional newspaper's home-and-garden section (a real editorial link) • a youth-sports-league sponsor page Every one links to competitors; none links to Rivertown. WHAT IT SHOWS A prospect list, not a scoreboard. These sources demonstrably link to firms LIKE Rivertown, which makes them far warmer prospects than cold outreach to strangers. They are evidence of *earnable* authority the site is currently missing. WHAT IT DOESN'T It does NOT mean matching the competitor's link COUNT will match its rankings (correlation, not causation — Chapter 22), and it does NOT mean every source will say yes. Some require an asset or relationship Rivertown must first build; a few the competitor earned for content Rivertown doesn't have. THE MOVE Pursue the EARNABLE ones honestly: join and get listed (Chamber, associations — citations, Chapter 25), claim the supplier locator, sponsor something local, and build an asset good enough to earn the roundups and the paper (Chapters 23–24). NEVER buy them (Chapter 22, §22.6) — a bought link is a detectable liability. THE LESSON A backlink gap is a map of links you could EARN, not a quota to hit by any means.

The strategic value here is that it converts "earn more links," which is a wish, into "earn these links," which is a plan. Cold link outreach fails mostly because it is untargeted; a backlink gap is targeting handed to you, because a site that already links to two of your competitors has revealed both that it links to businesses like yours and, often, how to earn it (it links from a roundup — so there is a roundup to be included in; it links from a sponsor page — so there is a sponsorship). This is the intelligence that feeds the linkable-asset idea of Chapter 23 (Rivertown's "Cost of AC repair in the Rivertown metro" data piece, built precisely to earn the roundups and the newspaper) and the white-hat tactics of Chapter 24.

🚫 SEO Myth: "Match your competitor's backlink count and you'll outrank them." This treats links as a number to equal, and it is wrong on three counts. First, it is correlation, not causation: Chapter 22's tool-vendor studies find that sites with more referring domains tend to rank higher, but better sites also attract more links — copying the count doesn't copy the quality or the reasons. Second, it ignores everything that makes a link valuable (authority, relevance, anchor, placement, and whether it was editorially earned): a hundred junk links do not equal ten editorial ones, and chasing the count is exactly the road to the manufactured-link liability §22.6 warned against — the same kind of links Rivertown inherited from its old contractor and must now decide what to do with (Chapter 26). Third, you don't control links; Google does the ranking. The gap tells you where authority is earnable; it never promises that earning it produces a specific position. Earn the good ones because they are good, not to hit a number.

The limits, stated plainly: a backlink gap is a hypothesis about earnable links, not a guarantee, and some of a competitor's best links are simply not replicable — they were earned by an asset, a relationship, or a moment you can't reproduce. Treat the list as leads to qualify, pursue the relevant and reachable ones, and never, ever let "close the gap" curdle into "buy the difference." The honest slowness of earning links is the whole point of Part IV; competitive analysis just tells you where to aim the effort.

30.6 The free versus paid tool decision

By now you have seen paid tools do impressive things — competing-domains reports, keyword gaps, link intersects, automated rank tracking. The natural conclusion is that you need one to do this work. Usually, you don't — and deciding honestly is worth real money, because these subscriptions are not cheap and the industry has a strong financial interest in convincing you they are mandatory.

Chapter 7 already drew the line for keyword research, and it holds for competitive analysis too: what a paid tool sells you is information and speed, not rankings and not judgment. Everything in this chapter can be done free, more slowly:

• Rank tracking → Search Console's average position (Chapter 27), read as a trend for your priority terms.
• Finding competitors → read the SERPs for your priority terms by hand (§30.3).
• Content and keyword gaps → search your target queries in an incognito window and read the top results; mine your own Search Console for striking-distance terms (Chapter 7, §7.2); note what the winners cover that you don't (§30.4).
• Backlink gaps → Search Console's Links report shows your own referring domains (Chapter 22, §22.7); reading a competitor's site and its press coverage by hand reveals many of theirs. Cruder than a link- intersect tool, but free and often enough for a single small site.

What paid tools add is not a different kind of insight — it is scale and speed: thousands of keywords and competitor terms in one click, a backlink database far larger than what you can assemble by hand, and rank tracking that runs itself on a schedule from declared locations. That is genuinely valuable, and for some people it is essential. The decision comes down to three honest questions:

• How many sites? One (your own) tilts free; many (an agency or in-house team) tilts paid.
• How often? A one-time or occasional analysis tilts free; a weekly, recurring job tilts paid.
• Whose time? When your time is the scarce resource — because you do this professionally — a tool that saves hours pays for itself fast. When your time is not yet scarce, the free toolkit plus reading SERPs by hand gets a single business most of the way there.

🚫 SEO Myth: "Real competitive analysis requires a \$100-plus-a-month tool." The tool vendors are, understandably, in no hurry to correct this, and it intimidates small businesses out of work they could absolutely do. It is false. You can identify your competitors, read their content gaps, and map much of their backlink profile with Google, Search Console, and your own eyes — for nothing. What you cannot do free is do it fast, at scale, and on a schedule across many terms and many sites, and that — speed and scale — is precisely, and only, what the subscription buys. A local business doing its own SEO once or twice a year does not need Ahrefs. A consultant running competitive analyses every week across a dozen clients would be foolish not to have one. Match the spend to the workload, never to the anxiety.

One more piece of honesty before you spend. A paid tool's numbers — volume, difficulty, "authority," even its rank readings — are estimates built from the vendor's own crawling and modeling, not Google's data (Chapter 7 on volume and difficulty; Chapter 22 on Domain Authority and Domain Rating). Different tools report different numbers for the same keyword and the same site, sometimes wildly, because they are all guessing at data only Google truly holds. So you are buying convenient, comparable estimates, delivered fast — which is genuinely useful — not a more truthful reading of reality than free tools give. Pay for the speed with your eyes open about what the numbers are.

🛠️ Try It on Your Site Prove to yourself that the core of competitive analysis is free. Pick one priority term for your site. (1) Search it in an incognito window and list the top ten results — those are your real SEO competitors for that term (§30.3). (2) Open the top two results and list every subtopic or question they cover that your page doesn't — that's your content gap (§30.4). (3) In Search Console, check your average position and impressions for that term — that's your honest rank and demand. You have now done competitor identification, a content- gap analysis, and rank tracking for that term without spending a cent. Decide whether speed across a hundred terms is worth a subscription — but you now know you can do the thinking for free.

30.7 A tour of the professional tools: what each is best at

Suppose you have decided the speed is worth it. Which tool? The honest guidance here is deliberately not a ranked "best tool of 2026" list — those lists are mostly affiliate marketing, prices and features change constantly, and no tool is "the best" for everyone. What is durable is understanding the categories and what each is genuinely best at, so you can choose for your situation and learn one deeply rather than owning three shallowly. (No tool named below is an endorsement, and no pricing is quoted, because pricing dates a book instantly; treat these as descriptions of what exists, not recommendations to buy.)

The all-in-one suites. Three platforms dominate general SEO work, and they overlap enormously — each does keywords, competitors, rank tracking, site audits, and backlinks. Their reputations, and rough centers of gravity:

• Ahrefs — best known historically for the size and quality of its backlink index; strong for backlink and keyword-gap analysis (§30.4–30.5), with a full suite around it. If off-page and competitor link analysis is your center of gravity, this is the common choice.
• Semrush — the broadest all-in-one; strong across keyword research, competitor and traffic analytics, rank tracking, content, and even paid-search data. If you want the widest single toolbox, this is the common choice.
• Moz — the most approachable, and the origin of the widely-cited Domain Authority metric (Chapter 22: a third-party estimate, not Google's number); solid keyword and local tools. Often chosen by smaller teams and beginners for its gentler learning curve.

The practical truth about the three: for most users their overlap is far larger than their differences, and the right move is to pick one — ideally via a free trial on your own real questions — and learn it thoroughly, rather than paying for several. The skill is in the analyst, not the logo.

The site crawler — a different category entirely. The suites analyze your site from the outside, using their own web crawl and third-party data. A crawler tool does something different and complementary: it is software that systematically fetches the pages of a website by following its links, the way a search engine's crawler does, to inventory and inspect them. The category's workhorse is Screaming Frog (formally the Screaming Frog SEO Spider): a desktop application that crawls your site like Googlebot and surfaces, in bulk, the technical facts you cannot see by browsing — every page's title tag and meta description (and which are missing, duplicated, or too long), HTTP status codes (every 404, 301, and redirect chain), canonical tags, noindex directives, broken internal and external links, heading structure, image alt text, and crawl depth (how many clicks from the homepage each page sits). It is the tool that finds the accidental noindex from Chapter 14, the orphan and deep pages from Chapter 15, and the redirect messes from Chapter 21 — at scale, across thousands of URLs, in one crawl.

🔎 How Search Sees It A crawler like Screaming Frog is valuable precisely because it approximates how a bot experiences your site, not how a human does. Browsing your homepage, everything looks fine; crawling it, you discover the 340 pages with duplicate titles, the section quietly returning 500 errors, the important page eleven clicks deep that Googlebot can barely reach. But hold the approximation honestly: Screaming Frog is not Googlebot. It is your robot, not Google's — it can be configured to render JavaScript (the Chapter 19 problem) to see what a rendered page contains, but it does not share Google's index, its rendering budget, or its ranking judgment. It shows you what a crawler sees, which is close enough to catch the technical breaks that keep good pages from ranking — and that is exactly its job.

The specialists and the free tier. Beyond the suites and the crawler sit categories worth knowing: Google's own free tools remain foundational and are not optional — Search Console (Chapter 27), PageSpeed Insights and the CrUX data behind Core Web Vitals (Chapter 16), and Keyword Planner (Chapter 7). Dedicated rank trackers do one job — tracking positions from declared locations and devices — more precisely than the suites' bundled trackers. Local-SEO specialist tools focus on Google Business Profile, citations, and local-pack tracking for multi-location businesses like Rivertown (Chapter 25). And Screaming Frog itself has a free tier (historically capped at a few hundred URLs per crawl), which is plenty to audit a small site like Rivertown's at no cost — a reminder that even in the "pro tools" section, the honest first answer is often "start with the free version."

⚖️ Evidence Check Claim: "Tool X is the best SEO tool." Sort it honestly. — What's fair to say: each major tool has genuine relative strengths (Ahrefs' backlink index, Semrush's breadth, Moz's approachability, Screaming Frog's crawl depth), and for a specific need one may fit you better than another. That is a defensible, situational claim. — What's not fair to say: that any tool is "the best" in the abstract. They disagree with each other on basic numbers because all are estimating data only Google holds (§30.6); "best" depends entirely on your work, your budget, and what you'll actually use; and no tool does SEO — it hands you information and speed, and the analysis, the judgment, and the decisions remain yours. A ranking of tools presented as objective fact, especially one full of affiliate links, is marketing wearing an evidence costume — the exact thing this book teaches you to distrust.

🔗 Connection These tools reappear as instruments, not topics, throughout the rest of the book. The comprehensive SEO audit of Chapter 38 runs on exactly this toolkit — Screaming Frog for the technical crawl, the suites for the off-page and competitive picture, Search Console and PageSpeed for Google's own data. Crawling and log-file analysis at true scale (what Googlebot actually fetched, versus what a crawler could fetch) belong to Chapter 33 (Programmatic and Enterprise SEO). And the cost of these tools becomes a line in the budget of Chapter 39 and the SEO-practice economics of Chapter 37.

📈 The Strategy File

Time to put the chapter to work on Rivertown Home Services — the family firm Ray Delgado founded in 1984, now run by his children Marisa and Tony Delgado. Chapter 22 gave Rivertown an honest link baseline and named the authority deficit; Chapter 7 gave it a scored keyword list; Chapter 8 sketched a first content gap. This chapter's job is to assemble the competitive picture: identify Rivertown's real local competitors, and turn them into a prioritized content-and-link gap list — the intelligence every later build decision draws on. (All names, competitors, and findings below are a constructed teaching example — illustrative, not real measurements.)

First, who Rivertown is actually competing with, read off the SERPs for its priority terms (§30.3) — three sets, three strategies:

FIGURE 30.5 — "Rivertown's competitive picture and gap list"              [the Strategy File]

  WHO WE ACTUALLY COMPETE WITH (by query type)
    LOCAL RIVALS (local-pack fight → Ch 25):   Northgate Comfort Systems · Peak Mechanical ·
                                               ValleyPro Plumbing & Electric  (constructed)
    DIRECTORIES / AGGREGATORS (be listed in,   Yelp · Angi · HomeAdvisor · Thumbtack ·
      don't try to out-rank → Ch 25):          "Best HVAC in [city]" listicles
    PUBLISHERS / PLATFORMS (content fight):     This Old House · Family Handyman · Forbes Home ·
                                               YouTube · Reddit · manufacturer sites

  CONTENT / KEYWORD GAP  (what they rank for that we don't — SCORED by Ch 7 value × winnability)
    ★ DO FIRST   "water heater replacement cost" — REBUILD the #11 page to close the 9-subtopic
                 content gap (Figure 30.3). High value, striking-distance, page already exists.
    ★ DO FIRST   "furnace repair [each city]" — genuinely local service×city pages (the local-pack
                 + content fight); high value, winnable locally.
    ✔ QUICK WIN  "how to relight a furnace pilot light," "furnace short cycling," "AC not cooling"
                 — expert how-tos beating thin publisher/forum pages; build trust + topical authority.
    ⏳ LONG GAME "heat pump vs furnace," "how much does a new furnace cost" — valuable, more
                 contested; build toward as authority grows.
    ✖ SKIP       generic high-volume terms owned by national retailers/publishers with no local path.

  BACKLINK GAP  (referring domains linking to rivals, not to us → EARN, never buy; Ch 23–24)
    EARNABLE NOW:  Chamber of Commerce directory · county home-builders' association · supplier
                   "certified installer" locators · a local sponsorship page  (also citations, Ch 25)
    EARN WITH AN ASSET:  "Best HVAC in [city]" roundups + regional paper's home section — target with
                   the "Cost of AC repair in the Rivertown metro" data piece (Ch 23)

  (All entries constructed and illustrative.)

Read the figure as intelligence, not orders. It tells Rivertown three true things it did not know before. One: its competitors are mostly not the rival trucks at the supply house — they are directories it should join and publishers it can out-expert, which completely changes the strategy per query. Two: the vague "make the water-heater page better" becomes nine specific sections to write (Figure 30.3), and the vague "we need more content" becomes a scored, finite list of pages worth building. Three: "earn more links" becomes a named prospect list of sites that already link to competitors like Rivertown — warm, relevant, and earnable without buying anything.

What this increment settles. Rivertown now has a competitive intelligence picture: who to study by query type, what content to build and improve (scored, not a dump), and which links to pursue (earnable, not bought). It hands the page stuck at #11 its final, itemized content diagnosis, and it converts Chapter 22's authority deficit into an actionable link-prospect list.

What it does not settle. The gap lists are candidates, not a plan — each still passes Chapter 7's value × winnability filter before it earns effort. Earning the links is the honest, slow work of Chapters 23–24; winning the local pack against the rivals and the directories is Chapter 25; building the service × city pages at scale without doorway spam is Chapter 33; and assembling all of this into the full, sequenced strategy is the Chapter 40 capstone. Competitive analysis produces the map of the battlefield. It does not fight the battle, and it never promises the hill.

Your Strategy-File task (do it on your own site, with Appendix C's worksheet): pick your three most important priority terms, search each in an incognito window, and list your real SEO competitors for each — sorting them into rivals, aggregators, and publishers. For your single highest-value term, list the subtopics the top two results cover that your page doesn't (your content gap). Then note two or three sites that link to a competitor but not to you (your backlink gap). Do not buy a tool, do not buy a link. You are building the intelligence layer; the rest of the book acts on it.

Conclusion

We began by taking a number away from you — "the rank" — and gave back something more honest and more useful in its place. There is no single rank, because Google builds each results page for a specific searcher in a specific place on a specific device at a specific moment, wrapped in specific SERP features; every rank you see is a sample, not a fact. So we track sensibly: a small set of priority terms, read as trends not daily noise, from a declared location and device, always walked forward to traffic and revenue so a moving number never masquerades as a result.

Then we turned the same evidence-first eye on the competition and found that your real SEO competitors are whoever holds the SERPs you want — often publishers, video platforms, and directories, not the business rival you picture. Knowing them, we read the three gaps that turn "improve the site" into a plan: the content gap (the subtopics a winning page covers and yours doesn't — the itemized diagnosis of the page stuck at #11), the keyword gap (the terms competitors rank for and you don't), and the backlink gap (the sites that vouch for them and not for you — a prospect list of links to earn, never buy). And we made the tool decision without hype: free tools plus your own eyes and Search Console do the thinking for nothing; paid suites and crawlers like Screaming Frog buy speed and scale, not truth and not judgment — and no tool does SEO for you.

What remains genuinely uncertain, and we said so, is baked into the honesty of the whole discipline: tool numbers are estimates that disagree with one another; rankings flicker with a volatility no one fully controls; and in the age of AI Overviews, what "rank" even means — and whether a #1 still earns the clicks it used to — is shifting under our feet, a question we confront directly in Chapter 36. You never control the ranking; you control the quality of your work and the honesty of your measurement.

That honesty closes Part V. We have learned to see what our SEO is doing — in Search Console, in GA4, in a report an owner can trust, and now in the mirror of the competition and the tools that hold it up. Part VI turns from measuring the work to specializing it: applying the whole model to particular kinds of business, each with its own playbook. We start with the one whose problems are the most technical and the most unforgiving of scale — the online store.

→ Continue to Chapter 31: E-Commerce SEO.

Key Terms

• Rank tracking — the practice of monitoring where your pages appear in search results for a chosen set of keywords over time; useful for trends from a fixed vantage point, never a reading of one true "rank."
• SERP volatility — the ordinary, ongoing fluctuation of search rankings over time, driven by Google's continual re-evaluation of pages and by algorithm updates; the "flicker" that must not be mistaken for a trend.
• Personalization — Google's tailoring of results to an individual searcher based on signals such as location, language, device, and (to a limited degree) prior activity; the reason checking your own rankings while logged in is the least reliable measurement in SEO.
• SEO competitor — any website that ranks for the queries you want to rank for, whether or not it is a business rival; defined by the SERP and by intent, not by your industry.
• Content gap (recap; owned by Chapter 8) — a topic or query valuable to your audience that competitors rank for but your site doesn't cover, or covers poorly; here also read at the page level, as the subtopics a higher-ranking page contains that yours omits.
• Keyword gap — the set of specific keywords your competitors rank for that you don't rank for at all; the query-level companion to the topic-level content gap, and the classic paid-tool competitive report.
• Backlink gap — the set of referring domains that link to your competitors but not to you; read as a prospect list of earnable links, never a quota to match by buying.
• Screaming Frog — a desktop crawler tool (the Screaming Frog SEO Spider) that crawls a site like a search engine to inventory titles, status codes, canonicals, redirects, broken links, and crawl depth in bulk; the technical-audit workhorse (with a limited free tier).
• Crawler tool — software that systematically fetches a site's pages by following its links, the way a search engine's crawler does, to inspect them at scale; distinct from the keyword-and-backlink suites, and complementary to them.

Spaced Review

Retrieval practice mixing this chapter with Chapters 7 and 29. Try each before revealing the answer.

1. A colleague reports, "Good news — we rank #1 for water heater replacement." Name three variables that make this claim incomplete, and rewrite it into a sentence a professional would actually say.
2. Explain the difference between an SEO competitor and a business competitor, using one Rivertown example — and name the three kinds of competitor a local business faces.
3. What is a backlink gap, and why is it correctly read as a prospect list rather than a shopping list?
4. (From Chapter 7.) A keyword-gap tool hands you 41 terms your competitors rank for and you don't. Why is dutifully writing 41 articles the wrong move, and what test must each gap pass first?
5. (From Chapter 29.) A monthly report leads with "we now rank for 12,000 keywords." Why is that a vanity metric, and what would you put at the top of the report instead?