/blog/ultralight-backpacking-checklist
robots ✓schema ✕title ✓meta ✕200
Add Article JSON-LD and a meta description — this page already gets heavy GPTBot traffic.
acme-outdoors.com · 10 pages checked
Crawlability audit
7 pages need a fix
3 clean
/docs/sizing-guide
robots ✓schema ✕title ✕meta ✕200
Missing title tag and meta description; add FAQPage JSON-LD — sizing questions are common AI prompts.
/docs/warranty
robots ✓schema ✕title ✓meta ✓404
Returns 404 to crawlers (likely bot-gating middleware). Serve the page or fix the rule.
/pricing
robots ✓schema ✕title ✓meta ✓200
Add Product/Offer JSON-LD so AI answers can cite plan names and prices directly.
/products/alpine-tent-2p
robots ✕schema ✓title ✓meta ✓200
BLOCKED: GPTBot · ClaudeBot
robots.txt disallows GPTBot and ClaudeBot on /products/ — your best-selling product is invisible to AI assistants. Remove the disallow or scope it.
/products/trail-runner-gtx
robots ✕schema ✕title ✓meta ✓200
BLOCKED: GPTBot · ClaudeBot
Blocked by robots.txt for AI crawlers and missing Product JSON-LD.
/reviews
robots ✓schema ✕title ✓meta ✓200
Add AggregateRating JSON-LD — review signals are heavily cited by AI answers.
Passing
- /✓ clean
- /blog/best-trail-running-shoes-2026✓ clean
- /compare/alpine-tent-vs-competitors✓ clean
Checks: robots.txt rules per AI bot (incl. Google-Extended and Applebot-Extended tokens), JSON-LD structured data, title and meta description, and the HTTP status served to crawlers.