What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.
How to Run the Ninety Day Review Ask three questions. Can you show me the prompt set is unchanged. Can you show me the raw answers. What specifically did you do, and which of the changes do you believe caused which movement.
Set those checkpoints at the start. An engagement without agreed intermediate measures gets judged entirely on the final one, which arrives too late to act on and encourages everyone involved to keep reporting motion instead of progress. Get Recommended By Ai
Put someone’s name against this. Crawler rules sit between marketing, development and whoever administers the content delivery network, which in most organisations means nobody checks them. The failures documented here are not difficult to find, they are simply nobody’s job, and a quarterly review taking half an hour prevents the most complete form of invisibility available.
What Should Not Have Happened Yet A large volume of new content. Twenty published articles by month three usually means the baseline was not used to direct the work, and the pages were commissioned before anyone knew which questions mattered.
What to Do About llms.txt and Similar Files Proposals for machine readable files aimed specifically at language model consumers appear periodically. Adoption is inconsistent and support varies by provider, so treat these as low cost and speculative rather than as a requirement.
One to Three Months: Listings and Corrections Claiming a directory profile, correcting an address, fixing a miscategorisation and responding to reviews all take effect once the platform publishes the change and the page is re-crawled.
The third question matters most. A good answer names a cause, attaches a number and admits an alternative explanation. A weak answer describes activity in the language of effort without connecting it to anything observable.
Days One to Fourteen: Find Out Where You Stand Somebody writes fifty questions your buyers would ask, in their words. They run each one three times across the two or three assistants your customers use, from a signed out session, and record the full answers and every source cited.
That matters most for the facts that establish identity, because those are the facts that let scattered mentions of you resolve into one record. It matters far less for content, where the model is going to read the prose anyway and is reasonably good at it.
Resolve Confusion With a Similar Name This is a specific and common problem, particularly for short, generic or numeric brand names. The remedy is to increase the distinguishing detail in every mention you control.
What needs you: factual accuracy. Somebody inside the business has to confirm the numbers, limits and claims before publication, because you carry the consequence of anything untrue being published about your own products.
Days Thirty to Sixty: Correct the Record Take the ranked list of cited sources from phase one and go through it. On each source, check whether you appear, whether the details are right and whether the platform accepts corrections.
Three to Nine Months: Earned Coverage The slowest and most valuable part. Getting into the comparison articles, trade publications and community discussions that assistants actually cite depends on other organisations deciding to write about you, which no amount of budget reliably accelerates.
If the baseline exists, access problems were found and fixed, listings were corrected with names attached, and the source list has begun to move, the engagement is on track even if mention rate has not shifted. If none of those happened, the next ninety days will not be different from the first. Get Recommended By Ai
Existing reputation helps disproportionately. A brand with review volume, press history and consistent details is starting from a partly assembled record. A brand with none of that is building identity from scratch, and identity work is slow because it depends on re-crawling sources you do not control.
The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch.
A quick way to find contradictions is to write out your key facts on one sheet, taken from your structured data, then check that sheet against your about page, your main directory listing and your marketplace account. Doing it manually feels crude and it surfaces the conflicts that validators never flag, because a validator checks syntax rather than whether your founding year matches the one you published elsewhere.
What llms.txt Proposes It is a proposed convention: a file at your root offering a curated, plain text guide to your site for language model consumers, pointing at the documents you consider authoritative.
Tags: ai seo agency