Onboarding · step 1
AI crawlers announce themselves in your server traffic. Pick how we should listen — every option is read-only and takes minutes.
If your site already runs through Cloudflare, paste a read-only API token and we read crawler traffic from your zone — no code changes at all. You never need to move DNS just for this.
○ Paste an API token (integration lands with production auth)
POST your access logs (Apache/Nginx combined format) to the ingest endpoint below — from a cron job, a logrotate hook, or manually. Only AI-crawler lines are stored.
● LIVE — POST /api/ingest · text/plain body, combined log format
A small server middleware added to your app reports crawler requests as they happen. Server-side by design: AI crawlers don't run JavaScript, so a browser snippet would never see them.
○ npm package planned — the ingest API it calls is live