B
Why this grade
A solid B. Strong on robots.txt AI-agent rules and Anti-bot interstitial; tightening on Public MCP registry listing and XML sitemap discovery would push this into A territory.
Get notified when this grade changes
Subscribe to grade-change alerts for thecolony.ai — we'll email you when a new scan moves the grade or score.
Quick wins
Low-cost fixes that would nudge this grade up.
- /ai.txt AI-crawler directives Add a short `/ai.txt` at the site root declaring your AI-crawler usage terms (see spawning.ai/ai-txt).
Blocking issues
High-weight checks that aren't passing.
- Public MCP registry listing Host thecolony.ai not listed in any of 2 registry/registries consulted.
- /.well-known/agent.json (A2A AgentCard) agent.json present; 3 of 4 required keys found, missing: endpoints.
- XML sitemap discovery Sitemap at /sitemap.xml returned 200 but XML is malformed.
Per-category breakdown
| Category | Score | Percent |
|---|---|---|
| Anti Bot | 15 / 15 | |
| Api | 15 / 15 | |
| Crawl | 18 / 23 | |
| Docs | 11 / 14 | |
| Html Meta | 4 / 8 | |
| Identity | 10 / 10 | |
| Onboarding | 6 / 6 | |
| Protocols | 4 / 18 | |
| Registries | 17 / 17 | |
| Root Level | 16 / 16 | |
| Well Known | 23 / 31 |
Findings (33)
Anti Bot · 2
| Check | Status | Points | Notes |
|---|---|---|---|
| Anti-bot interstitial | pass | 10 / 10 | No anti-bot interstitial markers on a single polite homepage request — behavioural anti-bot can still challenge real crawler traffic. |
| User-agent sniffing | pass | 5 / 5 | Homepage responses for default and curl UAs are effectively identical. |
Api · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| GraphQL introspection | skip | — | No GraphQL endpoint found at any of 3 conventional paths. |
| JSON error bodies for API callers | pass | 5 / 5 | HTTP 404 with parseable JSON body (Content-Type: application/json). |
| OpenAPI specification discovery | pass | 10 / 10 | OpenAPI 3.1.0 served at /openapi.json (425 paths, 602 schemas). |
Crawl · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| RSS/Atom feed | info | — | rss feed at https://thecolony.ai/feed.rss (50 entries, linked from homepage) (informational — not graded). |
| robots.txt AI-agent rules | pass | 13 / 13 | All 13 documented AI user-agents can crawl /. |
| XML sitemap discovery | warn | 5 / 10 | Sitemap at /sitemap.xml returned 200 but XML is malformed. |
Docs · 2
| Check | Status | Points | Notes |
|---|---|---|---|
| Docs platform discoverability | warn | 3 / 6 | Docs found at /docs but platform is custom — crawler-friendliness is unknown. |
| SDK availability across languages | pass | 8 / 8 | 2 SDKs discoverable: node, python. |
Html Meta · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| JSON-LD structured data | pass | 4 / 8 | JSON-LD present (Organization, WebSite); missing a machine-targeted `@type: WebAPI`/`SoftwareApplication` for full credit. |
| meta description | info | — | Meta description present (141 characters) (informational — not graded). |
| Open Graph tags | info | — | All three core Open Graph tags present on the homepage (informational — not graded). |
Identity · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| Email auth (SPF, DMARC, DKIM) | info | — | Email auth present: SPF + DMARC + DKIM (informational — mail trust/deliverability, not graded). |
| security.txt responsible-disclosure declaration | info | — | security.txt at https://thecolony.ai/.well-known/security.txt declares a Contact (informational — a human security-researcher signal, not graded). |
| TLS + HSTS + HTTPS redirect | pass | 10 / 10 | Valid TLS cert (issuer: C=US, O=Let's Encrypt, CN=YE2, expires 2026-10-07), http → https redirect confirmed. (HSTS max-age=31536000 — informational.) |
Llm Training · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| Common Crawl index presence | info | — | 50 pages from thecolony.ai in CC-MAIN-2026-34 (informational — corpus presence, not graded). |
| Hacker News mentions | info | — | 0 verified HN mention(s) of thecolony.ai (0 raw search hits) — informational, HN chatter is a popularity signal and not graded. |
| Wikipedia article | info | — | 3 Wikipedia article(s) match "thecolony" (The Colony, Texas, List of knights bachelor appointed in 1914, Alex Fein) but none link to thecolony.ai — a name match without a domain link is not attribution (informational — not graded). |
Onboarding · 1
| Check | Status | Points | Notes |
|---|---|---|---|
| API-key / signup path discoverability | pass | 6 / 6 | Homepage links to "Sign up" at /signup — matches "/sign[\s\-]?up/i". |
Protocols · 2
| Check | Status | Points | Notes |
|---|---|---|---|
| Public MCP registry listing | fail | 0 / 10 | Host thecolony.ai not listed in any of 2 registry/registries consulted. |
| A2A AgentCard conformance | warn | 4 / 8 | AgentCard partially conformant: empty `endpoints[]`. |
Registries · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| GitHub public repository | pass | 5 / 5 | 12 attributable repo(s): TheColonyAI/infographics (first party link); TheColonyAI/colony-sdk-python (first party link, homepage field); TheColonyAI/colony-sdk-js (first party link); TheColonyAI/colony-sdk-go (first party link); TheColonyAI/colony-memory (first party link). Agent topics: ai-agents. |
| npm SDK package | pass | 6 / 6 | 1 attributable npm package(s): @thecolony/sdk (first party link, registry metadata). |
| PyPI SDK package | pass | 6 / 6 | 1 attributable PyPI package(s): colony-sdk (first party link, registry metadata). |
Root Level · 3
| Check | Status | Points | Notes |
|---|---|---|---|
| /ai.txt AI-crawler directives | skip | — | No /ai.txt present (404) — this is a secondary signal, not a negative one. |
| /llms-full.txt long-form index | pass | 8 / 8 | llms-full.txt present, 28.1 KB. |
| /llms.txt index for LLMs | pass | 8 / 8 | llms.txt present, 9.0 KB, starts with '# The Colony'. |
Well Known · 5
| Check | Status | Points | Notes |
|---|---|---|---|
| /.well-known/agent.json (A2A AgentCard) | warn | 6 / 10 | agent.json present; 3 of 4 required keys found, missing: endpoints. |
| /.well-known/ai-plugin.json manifest | pass | 8 / 8 | ai-plugin.json present with all recommended keys. |
| /.well-known/mcp.json (Model Context Protocol) | warn | 4 / 8 | mcp.json parses but lacks MCP indicator keys (server / capabilities / tools). Could be a different use of the path. |
| OpenID Connect configuration + dynamic registration | pass | 5 / 5 | OIDC provider advertised (issuer=https://thecolony.ai) with dynamic client registration at https://thecolony.ai/oauth/register. |
| /.well-known/openapi.{json,yaml} | skip | — | No OpenAPI spec at either well-known path. |
Score over time
- Latest
- 83 ▼ 5
- Best
- 88
- Worst
- 83
- Scans
- 3
Scan history
Embed this grade
Paste the badge anywhere — your README, a status page, a docs site. The image always reflects the latest scan.
