# Search engine crawlers — updated 2026-04-20 User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Social media crawlers User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # AI crawlers — explicitly allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Bytespider Allow: / User-agent: CCBot Allow: / # Default User-agent: * Allow: / # LLM context page (GEO — Generative Engine Optimization) # Structured product info for AI crawlers: /llm.html # Machine-readable spec: /llms.txt # Sitemaps per domain (language-specific) Sitemap: https://zivafotka.cz/sitemap.xml Sitemap: https://zivafotka.cz/sitemap-cz.xml Sitemap: https://zivafotka.sk/sitemap-sk.xml Sitemap: https://zywafotka.pl/sitemap-pl.xml Sitemap: https://alivephoto.online/sitemap-en.xml Sitemap: https://lebendigfoto.de/sitemap-de.xml