---
title: Open datasets
description: "Free JSON datasets: AI crawler registry, glossary, industry schema map, structured data checklist and readiness checks."
url: "https://poseidondssolutions.com/datasets"
last_updated: 2026-11-18
publisher: Poseidon DS
---

1. [Home](https://poseidondssolutions.com/)
2. Datasets

Open data

# Open datasets.

The reference facts behind our guides, as free JSON files — plus the Pro benchmark tier.

## Search and AI crawler registry

Search engine and AI crawlers and robots.txt tokens that matter to business websites: the company that runs each, whether it serves search, AI search, user-requested fetching or model training, how to verify a visit (reverse DNS or published IP ranges) and the official documentation link.

- **File:** [/data/ai-crawlers.json](https://poseidondssolutions.com/data/ai-crawlers.json) (JSON)
- **Records:** 14
- **Last reviewed:** Nov 17, 2026
- **License:** [Creative Commons Attribution 4.0 (people may reuse with credit)](https://creativecommons.org/licenses/by/4.0/)

## AI findability glossary

Plain-language definitions of terms used in business search and AI discovery — AIO, AEO, GEO, SEO, structured data, Schema.org properties, crawler names, llms.txt, IndexNow, MCP and WebMCP — each with a link to an official source where one exists.

- **File:** [/data/glossary.json](https://poseidondssolutions.com/data/glossary.json) (JSON)
- **Records:** 38
- **Last reviewed:** Nov 17, 2026
- **License:** [Creative Commons Attribution 4.0 (people may reuse with credit)](https://creativecommons.org/licenses/by/4.0/)

## Business structured data checklist

Schema.org properties for business pages with their status on Google’s LocalBusiness structured data documentation (required, recommended, or valid Schema.org but not listed by Google) and a plain-language explanation of each.

- **File:** [/data/business-structured-data-checklist.json](https://poseidondssolutions.com/data/business-structured-data-checklist.json) (JSON)
- **Records:** 11
- **Last reviewed:** Nov 17, 2026
- **License:** [Creative Commons Attribution 4.0 (people may reuse with credit)](https://creativecommons.org/licenses/by/4.0/)

## Industry to Schema.org type map

Which Schema.org business type fits each industry, the facts customers look for, and the questions they ask AI assistants.

- **File:** [/data/industry-schema-map.json](https://poseidondssolutions.com/data/industry-schema-map.json) (JSON)
- **Records:** 24
- **Last reviewed:** Nov 17, 2026
- **License:** [Creative Commons Attribution 4.0 (people may reuse with credit)](https://creativecommons.org/licenses/by/4.0/)

## Business website AI readiness checks

The checks the free Poseidon DS website check runs on a business site — page loading, HTTPS, indexing, title, canonical address, crawler access, sitemap, structured data, readable facts and llms.txt — with the reason each one matters. It describes a method, not a score.

- **File:** [/data/ai-readiness-checks.json](https://poseidondssolutions.com/data/ai-readiness-checks.json) (JSON)
- **Records:** 14
- **Last reviewed:** Nov 17, 2026
- **License:** [Creative Commons Attribution 4.0 (people may reuse with credit)](https://creativecommons.org/licenses/by/4.0/)

A machine-readable list of all datasets is at [/data/catalog.json](https://poseidondssolutions.com/data/catalog.json). Each file states its sources and review date. If you find an error, [tell us](https://poseidondssolutions.com/contact).

Pro — benchmark datasets

## Free reference data above. Benchmarks below.

The datasets above are free reference facts. The Pro tier adds **AI visibility benchmarks**: aggregate check statistics from audit findings created after client businesses explicitly opt in in writing. No business names, locations or individual audit records are published.

- **One industry:** $249 per month
- **All industries:** $4,995 per year
- **API access:** Starter $49/mo · Agency $199/mo — [API access page](https://poseidondssolutions.com/api-access)
- **Opt-in threshold:** A benchmark is published only after at least 30 distinct businesses have opted in for that industry. Below that, the endpoint returns a “collecting data” status with the eligible business count.

| Industry | Status | Opted-in businesses |
| --- | --- | --- |
| **Law firm** | Collecting data | 0 of 30 |
| **Dental practice** | Collecting data | 0 of 30 |
| **Medical clinic** | Collecting data | 0 of 30 |
| **HVAC company** | Collecting data | 0 of 30 |
| **Roofing contractor** | Collecting data | 0 of 30 |
| **Plumbing company** | Collecting data | 0 of 30 |
| **Electrical contractor** | Collecting data | 0 of 30 |
| **General contractor** | Collecting data | 0 of 30 |

Full status list and endpoints: [/api-access](https://poseidondssolutions.com/api-access) · Index for machines: `GET /api/v1/benchmarks`

Last updated Nov 18, 2026

---

HTML version: https://poseidondssolutions.com/datasets  
Site guide for AI assistants: https://poseidondssolutions.com/llms.txt  
Request an audit: https://poseidondssolutions.com/contact (people) or POST https://poseidondssolutions.com/api/v1/audit-requests (agents, see https://poseidondssolutions.com/openapi.json)
