# RealHunt: everything public may be crawled and indexed, by search engines and by AI assistants. # Short index for AI: https://realhunt.co/llms.txt (Spanish: /es/llms.txt) · full reference text: https://realhunt.co/llms-full.txt # Every home as one line of JSON: https://realhunt.co/data/homes.jsonl # Data files and their description: https://realhunt.co/research/open-data · https://realhunt.co/openapi.json # The news sitemap is added below by the build (seo/reach) next to the main index. User-agent: * Allow: / Disallow: /__sb/ Disallow: /api/ # Searches typed into the site (/?q=...): endless addresses for the same homes. The lists to index are /homes/... Disallow: /*?q= Disallow: /*&q= # Private areas (accounts, admin, inboxes, invoices): nothing to read there, for any robot. /me$ keeps /method open. Disallow: /me$ Disallow: /me/ Disallow: /account Disallow: /admin Disallow: /dashboard Disallow: /inbox Disallow: /hunt/ Disallow: /settings Disallow: /saved Disallow: /auth/ Disallow: /alerts/confirm Disallow: /claim/ Disallow: /leads Disallow: /tickets Disallow: /network/app Disallow: /network/admin Disallow: /network/invoice/ # Search engines User-agent: Googlebot User-agent: Bingbot User-agent: DuckDuckBot User-agent: Applebot User-agent: YandexBot User-agent: YandexImages User-agent: Bravebot User-agent: Qwantbot User-agent: SeznamBot User-agent: MojeekBot User-agent: Yeti User-agent: PetalBot Allow: / Disallow: /__sb/ Disallow: /api/ Disallow: /*?q= Disallow: /*&q= # Private areas (accounts, admin, inboxes, invoices): nothing to read there, for any robot. /me$ keeps /method open. Disallow: /me$ Disallow: /me/ Disallow: /account Disallow: /admin Disallow: /dashboard Disallow: /inbox Disallow: /hunt/ Disallow: /settings Disallow: /saved Disallow: /auth/ Disallow: /alerts/confirm Disallow: /claim/ Disallow: /leads Disallow: /tickets Disallow: /network/app Disallow: /network/admin Disallow: /network/invoice/ # AI search and assistants (answers that cite and link to us) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amazonbot User-agent: meta-externalagent User-agent: MistralAI-User User-agent: DuckAssistBot User-agent: Kagibot User-agent: CCBot Allow: / # Explicitly open to AI assistants: every home, every listing, the guides, the data and the files made for them Allow: /deal/ Allow: /es/deal/ Allow: /homes/ Allow: /cheap-houses/ Allow: /guide/ Allow: /research/ Allow: /data/ Allow: /llms.txt Allow: /llms-full.txt Disallow: /__sb/ Disallow: /api/ Disallow: /*?q= Disallow: /*&q= # Private areas (accounts, admin, inboxes, invoices): nothing to read there, for any robot. /me$ keeps /method open. Disallow: /me$ Disallow: /me/ Disallow: /account Disallow: /admin Disallow: /dashboard Disallow: /inbox Disallow: /hunt/ Disallow: /settings Disallow: /saved Disallow: /auth/ Disallow: /alerts/confirm Disallow: /claim/ Disallow: /leads Disallow: /tickets Disallow: /network/app Disallow: /network/admin Disallow: /network/invoice/ # Link previews User-agent: Twitterbot User-agent: facebookexternalhit User-agent: LinkedInBot User-agent: WhatsApp Allow: / Sitemap: https://realhunt.co/sitemap.xml Sitemap: https://realhunt.co/sitemap-news.xml