Agent Disco check

User-agent sniffing

← Back to all checks

passive · Category Anti-bot posture · Weight 5 · Key anti_bot.user_agent_sniffing

Description

Fetches the homepage as AgentDisco/1.0 and again as curl/7.88.0, then compares status, content-type, and body length. A large divergence indicates user-agent sniffing — an LLM crawler with a non-browser UA may see a degraded page or be blocked outright.