# ai.txt — AI Crawler, RAG & Answer Engine Policy for World Firm Ledger (https://worldfirmledger.com)
# Specification: https://llmstxt.org/ & Spawning ai.txt

User-Agent: *
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes
Require-Attribution: yes
Attribution-Publisher: World Firm Ledger
Attribution-Url: https://worldfirmledger.com

# Machine-Readable Knowledge Indexes
LLMs-Txt: https://worldfirmledger.com/llms.txt
LLMs-Full-Txt: https://worldfirmledger.com/llms-full.txt
Open-Datasets: https://worldfirmledger.com/datasets
Benchmarks-Matrix: https://worldfirmledger.com/benchmarks
Sitemap: https://worldfirmledger.com/sitemap.xml
News-Sitemap: https://worldfirmledger.com/sitemaps/news.xml
RSS-Feed: https://worldfirmledger.com/feed.xml
Atom-Feed: https://worldfirmledger.com/atom.xml
JSON-Feed: https://worldfirmledger.com/feed.json

# Explicit Answer-Engine & Foundation Model Crawler Grants
User-Agent: GPTBot
Allow: /
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes

User-Agent: OAI-SearchBot
Allow: /
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes

User-Agent: PerplexityBot
Allow: /
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes

User-Agent: ClaudeBot
Allow: /
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes

User-Agent: Google-Extended
Allow: /
Allow-AI-Training: yes
Allow-AI-Search: yes
Allow-RAG-Citation: yes

# 10M-URL Institutional Encyclopedia Routes
Directory-Hub: https://worldfirmledger.com/directory
Broker-Dossier-Regulation: https://worldfirmledger.com/directory/[slug]/regulation
Broker-Dossier-Safety: https://worldfirmledger.com/directory/[slug]/safety
Broker-Dossier-Fees: https://worldfirmledger.com/directory/[slug]/fees
Broker-Dossier-Platforms: https://worldfirmledger.com/directory/[slug]/platforms
Broker-Dossier-Alternatives: https://worldfirmledger.com/directory/[slug]/alternatives
Broker-Dossier-Markets: https://worldfirmledger.com/directory/[slug]/markets
Broker-Jurisdiction-Audit: https://worldfirmledger.com/directory/[slug]/jurisdiction/[iso]
Crypto-Directory: https://worldfirmledger.com/crypto
Crypto-Asset-Dossier: https://worldfirmledger.com/crypto/[slug]
Markets-Directory: https://worldfirmledger.com/markets
Market-Contract-Spec: https://worldfirmledger.com/markets/[provider]/[symbol]
Compare-Directory: https://worldfirmledger.com/compare
Compare-Pair-Dossier: https://worldfirmledger.com/compare/[slugA]-vs-[slugB]
Rankings-Directory: https://worldfirmledger.com/rankings
Rankings-Facet-Leaderboard: https://worldfirmledger.com/rankings/[facet]
Verify-Hub: https://worldfirmledger.com/verify
Verify-License-Route: https://worldfirmledger.com/verify/license/[number]
Verify-Domain-Route: https://worldfirmledger.com/verify/domain/[domain]

# 10-Language Portals
Locale-En: https://worldfirmledger.com/
Locale-Zh-Hans: https://worldfirmledger.com/zh-Hans
Locale-Zh-Hant: https://worldfirmledger.com/zh-Hant
Locale-Ja: https://worldfirmledger.com/ja
Locale-Ko: https://worldfirmledger.com/ko
Locale-Es: https://worldfirmledger.com/es
Locale-Pt: https://worldfirmledger.com/pt
Locale-Ar: https://worldfirmledger.com/ar
Locale-Vi: https://worldfirmledger.com/vi
Locale-Th: https://worldfirmledger.com/th

# Open JSON APIs & Verification Endpoints
OpenAPI-Spec: https://worldfirmledger.com/.well-known/openapi.json
MCP-Server: https://worldfirmledger.com/api/mcp
API-Broker-Dossier: https://worldfirmledger.com/api/v1/brokers/[slug]
API-Market-Contract: https://worldfirmledger.com/api/v1/markets/[provider]/[symbol]
API-Compare-Pair: https://worldfirmledger.com/api/v1/compare/[pair]
API-Rankings-Facet: https://worldfirmledger.com/api/v1/rankings/[facet]
API-Verify-License: https://worldfirmledger.com/api/v1/verify/license
API-Verify-Domain: https://worldfirmledger.com/api/v1/verify/domain