peaksly explains · 06

Technology & content

Which website problems prevent citations in AI answers?

A citation in an AI answer requires that an AI search engine can retrieve the page, understand it and evidence a sentence from it. Most obstacles lie before the content: in crawler access, in retrieval without scripts, in the uniqueness of the address and in the sentence itself.

6-minute readUpdated 5 Sep 2026with a fictional example

Citation path · felsbach.example/kugelhahn-dn50 · fictional and shortenedFictional teaching example, not a measurement

1Access
- robots.txt allows the AI crawlersPerplexityBot blockedopen
2Retrieval
- Page responds without login or interstitialstatus 200, 0.4 secondsmet
- Product data is in the HTMLloaded by script onlyopen
3Uniqueness
- Canonical points to the page itselfone main addressmet
- Filter and print variants point to the main address3 of 3 variantsmet
4Quoting
- Title and headings name the topicball valve DN50met
- A sentence with number, unit and date“suitable for many applications”open
5Evidence
- Source at the sentencedata sheet March 2026met

Each point is established when the page is retrieved, not inferred from an answer. Met means technically checked, fictional in the example.

Check card

Access: 0 of 1
Retrieval: 1 of 2
Uniqueness: 2 of 2
Quoting: 1 of 2
Evidence: 1 of 1

5 of 8 points met · open: crawler access, product data in the HTML, quotable sentence

All names, addresses and files are fictional; domains end in .example, crawler names are examples as of September 2026. The citation path shows a way of checking, not a measurement and not a promise of results.

In short

Eight points, one path, no guarantee.

An AI search engine only cites a page if it may retrieve it, can read it without scripts, assigns it to one unambiguous address and finds a sentence in it that stands on its own with a number, a date and evidence. In the example, felsbach.example/kugelhahn-dn50 meets 5 of 8 points; open are crawler access, the product data in the HTML and the quotable sentence.

Step 1 · AccessFictional example: Felsbach Armaturen

Whoever locks out crawlers locks out the answer.

AI search engines fetch pages with their own crawlers before they can quote from them. Many websites block these crawlers wholesale in robots.txt, mostly out of concern about training use. The block then also hits retrieval for answers: what is not fetched cannot be quoted.

A robots.txt is a request, not a barrier. Whether a crawler honours it is up to its operator. And which crawler feeds which answer surface changes; that is why the file in the example carries a date, and the check repeats with every measurement.

Block deliberately, not wholesale. Anyone who excludes a crawler should know which answers they lose by doing so. In the example, Felsbach blocks one of three crawlers without noticing.

felsbach.example/robots.txt · as of September 2026fictional

User-agent: *
Allow: /

User-agent: PerplexityBot
Disallow: /

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

Access · crawlers in the example

GPTBotallowed
ClaudeBotallowed
PerplexityBotblocked, Disallow: /

2 of 3 crawlers allowed. Example names; which crawler feeds which answer surface is not stated here.

Step 2 · RetrievalFictional example: Felsbach Armaturen

What is not in the HTML is not quoted.

The second point is the server’s response: status 200, no login, no cookie wall, no interstitial. In the example the page responds in 0.4 seconds and is freely reachable.

The third point decides more often: not every crawler runs scripts. If pressure, temperature and connection of the valve only appear after loading in the browser, a crawler without scripts sees only the title and empty lines. The quotable content is missing for it, although people can see it.

The same page, two retrievals · felsbach.example/kugelhahn-dn50fictional

Without scripts, like a crawler

Ball valve DN50

Product data: none

In the browser, like a person

Ball valve DN50

Pressure: up to 40 bar
Temperature: up to 120 °C
Connection: DN50, PN40

Retrieval · check

Server responds 2000.4 seconds, without login or interstitial
Product data in the HTMLloaded by script only, open

1 of 2 points met

Step 3 · UniquenessFictional example: Felsbach Armaturen

One page per topic, one address per page.

The same page is often reachable under several addresses: with a filter parameter, as a print version, under an old address. For people it is the same page. For an AI search engine they are candidates that share the citation or displace each other.

Two means bring order: the canonical element names the main address in every variant, and old addresses redirect there permanently. This includes titles and headings that name the topic clearly, so that the main address is unambiguous in content as well.

Unambiguous also means: only one page per topic. Two similar pages on the same product are no advantage for the answer but an uncertainty.

Four addresses, one page · felsbach.examplefictional

1felsbach.example/kugelhahn-dn50canonical
2felsbach.example/kugelhahn-dn50?farbe=blaucanonical to 1
3felsbach.example/kugelhahn-dn50/printcanonical to 1
4felsbach.example/produkte/kugelhahn-dn50301 to 1

Title “Ball valve DN50 · Felsbach Armaturen”, the heading names the product.

Uniqueness · check

Addresses: 4 show the same page
Canonical: 1 of 4
Pointing: 3 of 4 to address 1

2 of 2 points met: canonical and variants

Step 4 · Sentence and evidenceFictional example: Felsbach Armaturen

A sentence that stands on its own.

What gets quoted is not a paragraph but a sentence. “The ball valve is suitable for many applications” carries no number, no unit and no date; an AI answer cannot use it as evidence. “The ball valve DN50 is approved up to 40 bar and 120 °C, data sheet March 2026” stands on its own.

The evidence belongs right at the sentence: the data sheet, the standard, the company’s own measurement. How a sentence gets its evidence is shown in the article on SEO and GEO; what a supplied link proves later, in the article on sources.

felsbach.example/kugelhahn-dn50 · section Operating limitsFictional teaching example, not a measurement

Operating limitsStructure

~~The ball valve is suitable for many applications.~~no number, no date

The ball valve DN50 is approved up to 40 bar and 120 °C, data sheet March 2026.quotable sentence

EvidenceData sheet ball valve DN50, edition March 2026, page 2: nominal pressure PN40, media temperature up to 120 °C, fictional.

Quoting and evidence · after the change

Number and unit
Date
Evidence at the sentence

3 of 3 points met; before 1 of 3: the evidence was there, the sentence was not.

Honest limitFictional example: Felsbach Armaturen

What a clean page does not guarantee.

Eight points met make a page quotable, not quoted. Whether an AI search engine uses it for a specific prompt on a specific answer surface is decided in the answer, not on the page.

That is why measurement follows the check: the same search prompts, the same answer surfaces, a new point in time. What is counted there is explained in the fundamentals article; what a complete review path looks like, in the Deep Audit example.

Not promised

a citation for a specific prompt
the same treatment on all answer surfaces
that every crawler honours robots.txt
an effect without a new measurement

The sober path

1check the citation path, eight points
2close the open points
3measure the same prompts again

Check first, then measure.

The article on SEO and GEO shows which foundation both paths share. The Deep Audit measures whether citations actually appear afterwards.

SEO and GEO explained View the Deep Audit →Look up the terms →