AI readiness checker

Find out whether AI search engines and assistants can reach and read your page, as a checklist with the evidence for every line and no invented score.

Try:

Results for lookupowl.com

Checked 2026-11-15live lookup423 ms

Checklist, not a score

Ready

19 of 21 checks pass. 2 are information only. Every group passes, so the level is the top one.

Counted, not weighted

19 pass, 0 warning, 0 fail, 2 information.

Can AI read it?5 pass, 1 info

Whether the page answers, robots.txt and which AI crawlers it lets in.

What does it see before JavaScript?3 pass

The text, heading and links in the first response, before any script runs.

Does it describe itself?5 pass

Title, description, canonical link and structured data.

Can it be found?2 pass, 1 info

Sitemap, llms.txt and how fast the first byte arrives.

Can an agent use it?4 pass

Markdown, an API catalog, an MCP server card and Link headers.

Checklist21

Failures first, then warnings, passes and information. Every line says what we saw and where.

GoodThe page answers page-status

https://lookupowl.com/ answered 200.

Where we looked: https://lookupowl.com/

Goodrobots.txt robots-present

robots.txt found (200, text/plain), 9 groups of rules.

Where we looked: https://lookupowl.com/robots.txt

GoodAI crawlers are allowed ai-crawlers

GPTBot, ClaudeBot, Google-Extended, CCBot, Applebot-Extended and 9 more are allowed.

Where we looked: robots.txt

GoodContent signals content-signals

Content-Signal: ai-train=yes, search=yes, ai-input=yes

Where we looked: robots.txt

GoodPage-level directives page-directives

The page sends index, follow, which does not block reading.

Where we looked: https://lookupowl.com/

GoodText before JavaScript prejs-text

About 1,606 words are in the first response, before any JavaScript runs.

Where we looked: https://lookupowl.com/

GoodMain heading prejs-headings

One h1 in the first response.

Where we looked: https://lookupowl.com/

GoodLinks a crawler can follow prejs-links

155 links in the first response.

Where we looked: https://lookupowl.com/

GoodPage title title

"LookupOwl: free DNS, WHOIS and network tools"

Where we looked: https://lookupowl.com/

GoodMeta description meta-description

"Free WHOIS, RDAP, DNS, IP, SSL, SPF and DMARC checks in seconds. No signup, no captcha, no ads, plus a free API and MCP …"

Where we looked: https://lookupowl.com/

GoodCanonical link canonical

https://lookupowl.com/

Where we looked: https://lookupowl.com/

GoodOpen Graph title og-title

"LookupOwl: free DNS, WHOIS and network tools"

Where we looked: https://lookupowl.com/

GoodStructured data json-ld

Found 2 JSON-LD blocks (WebSite, FAQPage).

Where we looked: https://lookupowl.com/

GoodSitemap sitemap

Named in robots.txt (200, application/xml).

Where we looked: https://lookupowl.com/sitemap.xml

GoodResponse speed ttfb

First byte in 0.15 s from one cold request.

Where we looked: https://lookupowl.com/

GoodMarkdown for agents markdown

Accept: text/markdown returns text/markdown, about 2,777 tokens.

Where we looked: https://lookupowl.com/

GoodAPI catalog api-catalog

/.well-known/api-catalog answers 200 (application/linkset+json, RFC 9727).

Where we looked: https://lookupowl.com/.well-known/api-catalog

GoodMCP server card mcp-card

/.well-known/mcp/server-card.json answers 200 (application/json).

Where we looked: https://lookupowl.com/.well-known/mcp/server-card.json

GoodLink headers link-headers

The Link header advertises api-catalog, service-desc, service-doc, describedby.

Where we looked: https://lookupowl.com/

NoteSEO crawlers seo-bots

AhrefsBot, SemrushBot, MJ12bot, DotBot and 3 more are asked to stay out. These are not AI crawlers.

Where we looked: robots.txt

Notellms.txt llms-txt

Found. 47 links in 10 sections, titled "LookupOwl". Optional: Google says it does not use it; some assistants and coding agents read it.

Where we looked: https://lookupowl.com/llms.txt

Crawler access14

GPTBotAllowedTraining
OpenAI. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
ClaudeBotAllowedTraining
Anthropic. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Google-ExtendedAllowedTraining
Google. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
CCBotAllowedTraining
Common Crawl. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Applebot-ExtendedAllowedTraining
Apple. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Meta-ExternalAgentAllowedTraining
Meta. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
BytespiderAllowedTraining
ByteDance. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
OAI-SearchBotAllowedSearch
OpenAI. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Claude-SearchBotAllowedSearch
Anthropic. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
PerplexityBotAllowedSearch
Perplexity. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
ChatGPT-UserAllowedAssistant
OpenAI. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Claude-UserAllowedAssistant
Anthropic. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
Perplexity-UserAllowedAssistant
Perplexity. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /
MistralAI-UserAllowedAssistant
Mistral. Nothing in robots.txt keeps it out of this page.
Deciding line: Allow: /

Training collects pages to train models. Search builds an AI search index. Assistant fetches a page because a person asked. We read robots.txt only; we never pretend to be these crawlers.

What AI sees

The first 600 characters a crawler reads before JavaScript runs (1,606 words in all).

Skip to content Lookup Owl Tools Domain Who owns a name, and is it set up? WHOIS lookup Domain report Domain availabilit…

Structured data found in the first response:

WebSite
FAQPage

llms.txt

This site publishes an llms.txt file. It also has llms-full.txt.

llms.txt is optional. Google says it does not use it for Search, and no search engine requires it. Some assistants and coding agents read it. A missing file is information, not a failure. We read the file; we do not follow its links.

Where we looked: https://lookupowl.com/llms.txt

Structured result (JSON) · 11 KB

{
  "target": "lookupowl.com",
  "finalUrl": "https://lookupowl.com/",
  "redirectedTo": null,
  "blockedUs": false,
  "blockedStatus": null,
  "summary": {
    "pass": 19,
    "warn": 0,
    "fail": 0,
    "info": 2,
    "unchecked": 0,
    "total": 21,
    "level": "ready"
  },
  "groups": [
    {
      "id": "access",
      "title": "Can AI read it?",
      "result": "pass",
      "checks": [
        {
          "id": "page-status",
          "title": "The page answers",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "https://lookupowl.com/ answered 200.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "robots-present",
          "title": "robots.txt",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "robots.txt found (200, text/plain), 9 groups of rules.",
          "source": "https://lookupowl.com/robots.txt",
          "fix": null,
          "snippet": null
        },
        {
          "id": "ai-crawlers",
          "title": "AI crawlers are allowed",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "GPTBot, ClaudeBot, Google-Extended, CCBot, Applebot-Extended and 9 more are allowed.",
          "source": "robots.txt",
          "fix": null,
          "snippet": null
        },
        {
          "id": "content-signals",
          "title": "Content signals",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "Content-Signal: ai-train=yes, search=yes, ai-input=yes",
          "source": "robots.txt",
          "fix": null,
          "snippet": null
        },
        {
          "id": "seo-bots",
          "title": "SEO crawlers",
          "status": "info",
          "couldntCheck": false,
          "evidence": "AhrefsBot, SemrushBot, MJ12bot, DotBot and 3 more are asked to stay out. These are not AI crawlers.",
          "source": "robots.txt",
          "fix": null,
          "snippet": null
        },
        {
          "id": "page-directives",
          "title": "Page-level directives",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "The page sends index, follow, which does not block reading.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        }
      ]
    },
    {
      "id": "prejs",
      "title": "What does it see before JavaScript?",
      "result": "pass",
      "checks": [
        {
          "id": "prejs-text",
          "title": "Text before JavaScript",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "About 1,606 words are in the first response, before any JavaScript runs.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "prejs-headings",
          "title": "Main heading",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "One h1 in the first response.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "prejs-links",
          "title": "Links a crawler can follow",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "155 links in the first response.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        }
      ]
    },
    {
      "id": "self",
      "title": "Does it describe itself?",
      "result": "pass",
      "checks": [
        {
          "id": "title",
          "title": "Page title",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "\"LookupOwl: free DNS, WHOIS and network tools\"",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "meta-description",
          "title": "Meta description",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "\"Free WHOIS, RDAP, DNS, IP, SSL, SPF and DMARC checks in seconds. No signup, no captcha, no ads, plus a free API and MCP …\"",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "canonical",
          "title": "Canonical link",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "https://lookupowl.com/",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "og-title",
          "title": "Open Graph title",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "\"LookupOwl: free DNS, WHOIS and network tools\"",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "json-ld",
          "title": "Structured data",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "Found 2 JSON-LD blocks (WebSite, FAQPage).",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        }
      ]
    },
    {
      "id": "found",
      "title": "Can it be found?",
      "result": "pass",
      "checks": [
        {
          "id": "sitemap",
          "title": "Sitemap",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "Named in robots.txt (200, application/xml).",
          "source": "https://lookupowl.com/sitemap.xml",
          "fix": null,
          "snippet": null
        },
        {
          "id": "llms-txt",
          "title": "llms.txt",
          "status": "info",
          "couldntCheck": false,
          "evidence": "Found. 47 links in 10 sections, titled \"LookupOwl\". Optional: Google says it does not use it; some assistants and coding agents read it.",
          "source": "https://lookupowl.com/llms.txt",
          "fix": null,
          "snippet": null
        },
        {
          "id": "ttfb",
          "title": "Response speed",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "First byte in 0.15 s from one cold request.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        }
      ]
    },
    {
      "id": "agent",
      "title": "Can an agent use it?",
      "result": "pass",
      "checks": [
        {
          "id": "markdown",
          "title": "Markdown for agents",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "Accept: text/markdown returns text/markdown, about 2,777 tokens.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        },
        {
          "id": "api-catalog",
          "title": "API catalog",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "/.well-known/api-catalog answers 200 (application/linkset+json, RFC 9727).",
          "source": "https://lookupowl.com/.well-known/api-catalog",
          "fix": null,
          "snippet": null
        },
        {
          "id": "mcp-card",
          "title": "MCP server card",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "/.well-known/mcp/server-card.json answers 200 (application/json).",
          "source": "https://lookupowl.com/.well-known/mcp/server-card.json",
          "fix": null,
          "snippet": null
        },
        {
          "id": "link-headers",
          "title": "Link headers",
          "status": "pass",
          "couldntCheck": false,
          "evidence": "The Link header advertises api-catalog, service-desc, service-doc, describedby.",
          "source": "https://lookupowl.com/",
          "fix": null,
          "snippet": null
        }
      ]
    }
  ],
  "crawlerMatrix": [
    {
      "bot": "GPTBot",
      "vendor": "OpenAI",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "ClaudeBot",
      "vendor": "Anthropic",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Google-Extended",
      "vendor": "Google",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "CCBot",
      "vendor": "Common Crawl",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Applebot-Extended",
      "vendor": "Apple",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Meta-ExternalAgent",
      "vendor": "Meta",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Bytespider",
      "vendor": "ByteDance",
      "kind": "training",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "OAI-SearchBot",
      "vendor": "OpenAI",
      "kind": "search",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Claude-SearchBot",
      "vendor": "Anthropic",
      "kind": "search",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "PerplexityBot",
      "vendor": "Perplexity",
      "kind": "search",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "ChatGPT-User",
      "vendor": "OpenAI",
      "kind": "assistant",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Claude-User",
      "vendor": "Anthropic",
      "kind": "assistant",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "Perplexity-User",
      "vendor": "Perplexity",
      "kind": "assistant",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    },
    {
      "bot": "MistralAI-User",
      "vendor": "Mistral",
      "kind": "assistant",
      "access": "allowed",
      "byChoice": false,
      "matchedRule": "Allow: /"
    }
  ],
  "llmsTxt": {
    "present": true,
    "full": true,
    "url": "https://lookupowl.com/llms.txt",
    "errors": []
  },
  "page": {
    "status": 200,
    "firstByteMs": 150,
    "words": 1606,
    "excerpt": "Skip to content Lookup Owl Tools Domain Who owns a name, and is it set up? WHOIS lookup Domain report Domain availabilit…",
    "jsonLd": [
      {
        "types": [
          "WebSite"
        ],
        "valid": true
      },
      {
        "types": [
          "FAQPage"
        ],
        "valid": true
      }
    ]
  },
  "notes": [],
  "partial": false
}

Next step

HTTP headers and redirectsSee every header the page sends
Check lookupowl.com in HTTP headers and redirects
Security headersGrade its security headers
Check lookupowl.com in Security headers
Is it down?Is it up from other countries?
Check lookupowl.com in Is it down?

What the checker looks at

AI search and AI assistants read the web differently from people. Most of them fetch the HTML your server sends and do not run your scripts, they obey robots.txt, and they lean on plain structure: a title, a description, headings, links and a sitemap. This checker fetches your page the way such a crawler would, then reads the few files that tell crawlers and agents more, and reports what it found in five groups of questions.

Can AI read it? Whether the page answers, whether robots.txt exists, which AI crawlers it lets in, any Content-Signal line, and page-level directives such as noindex.
What does it see before JavaScript? The text, the main heading and the links in the first response. A page that builds itself in the browser can look empty to a crawler.
Does it describe itself? The title, meta description, canonical link, Open Graph title and structured data (JSON-LD).
Can it be found? A sitemap, an llms.txt file and how fast the first byte arrives.
Can an agent use it? A Markdown version of the page, an API catalog, an MCP server card and Link headers that point to them.

Each line shows what we saw and where we looked, and for most gaps it gives the sentence to fix it and a snippet to paste. We make eight or nine requests to the site itself, in one short burst, and none to anyone else.

How to use it

Enter a site or a pageType example.com or a full address. We follow redirects and check the page you land on, and we say when that is a different host from the one you typed.
Read the level, then the groupsThe answer at the top is a word with counts. Below it, five tiles show which group set the level. Open the one that is not green.
Work through the checklistFailures come first, then warnings, passes and information. Open a row to see where we looked, how to fix it and a snippet to copy. Run the check again after you deploy.

Shell

# The same check as JSON, for a script or an agent
curl "https://lookupowl.com/api/v1/tools/ai-readiness-check?url=example.com"

How the level is worked out

There is no score here, because a number would need weights, and any weights would be a guess. The level is a word, and it comes from one rule that you can check by hand: it is the lowest result among the five groups. Checks are counted, never weighted. Information lines are not counted for or against anything.

Level	When it applies
Ready	Every group has at least one pass and no warnings or failures.
Mostly ready	No group fails, but at least one has a warning.
Partly ready	No group fails, but at least one has nothing that passes yet. Optional agent features that are missing do this.
Not ready	At least one group has a failure, such as a page with almost no text before JavaScript.
Unclear	Fewer than three groups could be read, for example because the site was slow or refused us.

Blocking AI crawlers is a choice, not a defect

Many publishers disallow AI training crawlers such as GPTBot or CCBot in robots.txt on purpose. This checker shows that as "Blocked by choice", marks each such crawler in the crawler tab, and never lets it lower the level. What it does tell you is what the choice costs: blocking a search crawler such as OAI-SearchBot keeps the page out of that assistant's search results, and blocking an assistant such as ChatGPT-User stops it fetching the page when a person asks.

A block that comes from the rule for every crawler, not from a line naming the bot, is different. That often means a staging setting that was never removed, so it is shown as a warning with the lines to allow the crawlers you want.

What most sites need to fix first

Put the main content in the first response. Server-render or prerender pages that are built in the browser.
Give every page a title, a description, a canonical link and one clear h1.
Publish a sitemap and name it in robots.txt.
Decide on purpose which AI crawlers you welcome, and say so in robots.txt, with a Content-Signal line if you like.
Optional extras for agents: a Markdown version of your pages, an API catalog and an MCP server card.

None of this is a ranking factor we can promise, and the page says so. It is the list of things that decide whether a crawler can read you at all. For the security side of the same page, try the security headers checker, and to see every header the page sends, the HTTP headers checker.

Questions people ask

What is AI readiness?

It is whether AI search engines and assistants can find your page, read what is on it and understand what it is. That depends on crawler access in robots.txt, on content being in the first response, on basic metadata and structured data, and on a sitemap. For agents, Markdown versions and API descriptions help too.

Will a better level improve my ranking or get me cited?

We cannot promise that, and nothing on this page claims it. The checklist covers the preconditions: a crawler that cannot reach or read a page cannot use it. Whether an assistant then cites it is up to that assistant.

Why does it say "Blocked by choice" and not a failure?

Because disallowing AI crawlers by name in robots.txt is a legitimate decision about your content. We show it so you can confirm it is what you meant, and we leave the level alone. Only a failure, a warning or a group with nothing passing changes the level.

Do AI crawlers run JavaScript?

Most fetch the HTML and do not run scripts, which is why the text in the first response matters. Some crawlers do render pages, so a script-built page may still be read by them, but you cannot count on it. The "What AI sees" tab shows the first 600 characters a crawler that does not run scripts reads.

Does this tool pretend to be an AI crawler?

No. It reads robots.txt and applies the rules for each crawler name, but it fetches your pages as LookupOwl, with our own user agent. We never send another crawler's name, so what you see in your logs is a single, identifiable visitor.

Why did it say it could not check something?

A file did not answer in time, or the connection failed. That one line is marked "Couldn't check" and counted apart, and the rest of the list is complete. If a site refuses our request entirely, we tell you that instead of guessing.

Use it from AI, the API or the command line

Every LookupOwl tool is also a free API and an MCP tool, with no key and no account. This one is ai_readiness_check. Please be kind to the rate limits.

curl

curl "https://lookupowl.com/api/v1/tools/ai-readiness-check?q=lookupowl.com"

MCP

claude mcp add --transport http lookupowl https://lookupowl.com/mcp

Description for AI agents · OpenAPI · llms.txt

Domain

DNS

Email

Network

IP and subnets

Web

Security

Make and convert

AI readiness checker

Results for lookupowl.com

Ready

Next step

What the checker looks at

How to use it

How the level is worked out

Blocking AI crawlers is a choice, not a defect

What most sites need to fix first

Questions people ask

Use it from AI, the API or the command line

Ready

Next step

What the checker looks at

How to use it

How the level is worked out

Blocking AI crawlers is a choice, not a defect

What most sites need to fix first

Questions people ask

Use it from AI, the API or the command line

You might also need