# CiteVisor > Technical AI search visibility for your website: AI crawler access, indexing, structured data and content clarity, with practical fixes and no ranking promises. ## Research - [Which sites block AI crawlers? 2026 robots.txt study](https://citevisor.com/research/ai-crawler-robots-txt-2026): How the Tranco top 10,000 sites treat 17 AI and search crawler tokens in robots.txt, and how many publish llms.txt; method, limits and per-domain data. - [Study data (CSV)](https://citevisor.com/research/ai-crawler-robots-txt-2026.csv): One row per domain: fetch results and each token's robots.txt verdict. ## Guides - [AI crawler list: user agents, purposes and robots.txt rules](https://citevisor.com/guides/ai-crawler-user-agents): Which AI crawlers fetch your site, what each one is for, and robots.txt rules that keep you visible in AI search while opting out of model training. - [GPTBot vs OAI-SearchBot: which OpenAI crawler to allow](https://citevisor.com/guides/gptbot-vs-oai-searchbot): GPTBot collects training data while OAI-SearchBot powers ChatGPT search. See what each OpenAI bot does, how to block one but not the other, and when changes apply. - [How to get cited by ChatGPT search: a technical checklist](https://citevisor.com/guides/how-to-get-cited-by-chatgpt): No one can guarantee a ChatGPT citation. This checklist covers what you control: crawler access, indexable answer-first pages, verifiable facts and measurement. - [Is my website visible to AI search? A 15-minute check](https://citevisor.com/guides/is-my-website-visible-to-ai): Check robots.txt, CDN bot rules, noindex, JavaScript rendering and Google and Bing index coverage to see whether AI answer engines can reach and read your pages. - [Cloudflare AI Crawl Control: allow AI search, block training](https://citevisor.com/guides/cloudflare-ai-crawl-control): How Cloudflare's AI crawler blocking, managed robots.txt and bot settings interact, and how to stay visible in AI answers while declining model training. - [GEO audit checklist: 26 checks for AI search visibility](https://citevisor.com/guides/geo-audit-checklist): A free GEO audit checklist and template: 26 checks for AI crawler access, indexing, structured data and content, with how each is scored and fixed. - [Brand Mentions in AI Search: Track ChatGPT, Perplexity & Gemini | CiteVisor](https://citevisor.com/guides/track-brand-mentions-in-ai-search): See where your brand is mentioned in AI answers. Sample ChatGPT, Perplexity, Gemini and Claude prompts, keep citations, and spot gaps before rivals do. - [Schema markup for AI search: what helps and what does not](https://citevisor.com/guides/schema-markup-for-ai-search): Do you need schema markup for AI search, AI Overviews or AI crawlers? What Google's guidance says, which JSON-LD types are worth adding and what to skip. - [Shopify robots.txt for AI crawlers: edit robots.txt.liquid](https://citevisor.com/guides/shopify-robots-txt-ai-crawlers): Allow or block GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot on Shopify by editing robots.txt.liquid, with copyable Liquid and a safe way to roll back. - [Block AI crawlers in WordPress and stay in AI search](https://citevisor.com/guides/wordpress-block-ai-crawlers): Block GPTBot, ClaudeBot and other AI training crawlers in WordPress while keeping OAI-SearchBot and PerplexityBot, with a filter, Yoast or a robots.txt file. - [What is llms.txt? Format, example and whether it works](https://citevisor.com/guides/does-llms-txt-work): llms.txt is an optional Markdown map for AI tools, not a ranking signal or access control. The format, an example, who publishes one and what Google says. - [How to check and track brand mentions in ChatGPT](https://citevisor.com/guides/track-brand-mentions-in-chatgpt): Check how ChatGPT mentions your brand: run a clean manual test, read the Sources list, sample by country through the API, and keep ads and shopping apart. - [How to Track Brand Mentions in Perplexity](https://citevisor.com/guides/track-brand-mentions-in-perplexity): See how Perplexity cites your brand: read its numbered sources, test in incognito with memory off, and sample by country with the API's search results. - [How to check and track brand mentions in Gemini](https://citevisor.com/guides/track-brand-mentions-in-gemini): Check brand mentions in Gemini: test in a Temporary Chat, read its sources, sample with Grounding with Google Search, and know what Google-Extended changes. - [ChatGPT-User vs OAI-SearchBot: user agents and robots.txt](https://citevisor.com/guides/chatgpt-user-vs-oai-searchbot): OAI-SearchBot crawls for ChatGPT search; ChatGPT-User fetches a page when someone asks. Their user agents, robots.txt rules, IP lists and how to tell them apart. - [What is OAI-AdsBot? OpenAI's ChatGPT ads crawler](https://citevisor.com/guides/oai-adsbot): OAI-AdsBot checks landing pages submitted as ChatGPT ads. Its user agent, IP list and robots.txt rules, and how to stop firewalls and CDNs failing your ad review. - [What is GPTBot? User agent, IP ranges and robots.txt](https://citevisor.com/guides/gptbot): GPTBot is OpenAI's crawler for model training data. See its current user agent and IP list, robots.txt rules to block or allow it, and how to verify a visit. - [How to Get Cited in AI Search](https://citevisor.com/guides/how-to-get-cited-in-ai-search): Make pages easier for ChatGPT, Perplexity, Gemini and Claude to find and cite. Compare crawler controls, improve evidence, and measure with fixed prompts. - [How to Get Cited by Perplexity](https://citevisor.com/guides/how-to-get-cited-by-perplexity): Check PerplexityBot access, improve source passages, and distinguish retrieved pages from citations. A practical Perplexity checklist with API diagnostics. ## Tools - [Free AI visibility checker](https://citevisor.com/): Audit one public page: 26 checks covering robots.txt rules for 11 AI and search crawlers, indexing, structured data and content. - [Robots.txt generator for AI crawlers](https://citevisor.com/tools/ai-crawler-checker): Build robots.txt rules for 11 AI and search crawlers in the browser. - [One-time AI visibility audit ($99)](https://citevisor.com/ai-visibility-audit): A full-site audit of one website, up to 200 pages, with a reviewed fix list and code snippets; one payment, emailed within 3 business days, no subscription. - [AI visibility tracking for agencies ($199/month)](https://citevisor.com/ai-visibility-for-agencies): Weekly ChatGPT, Perplexity, Gemini and Claude answers for up to 20 client projects sharing 80 prompts, with white-label read-only client links and CSV export. ## Industry playbooks - [Accounting firms](https://citevisor.com/for/accounting): Explain entity types, jurisdictions and service boundaries so business owners can distinguish bookkeeping, tax filing and advisory work. - [Automotive businesses](https://citevisor.com/for/automotive): Separate dealership inventory from workshop services and publish compatibility, availability and location details accurately. - [B2B SaaS](https://citevisor.com/for/b2b-saas): Expose the product’s actual workflow, integrations and pricing boundaries so buyers can compare it against their use case. - [Consultancies](https://citevisor.com/for/consulting): Replace vague expertise claims with a clear engagement scope, attributable methods and evidence clients can assess. - [Dental practices](https://citevisor.com/for/dentists): Clarify services, practitioner credentials and appointment details while keeping health claims and patient information carefully bounded. - [Developer tools](https://citevisor.com/for/developer-tools): Make documentation versions, code examples and supported environments discoverable without overstating compatibility or adoption. - [Ecommerce](https://citevisor.com/for/ecommerce): Give shoppers stable product facts, clear delivery conditions and accessible category pages rather than promises of guaranteed AI recommendations. - [Financial advisors](https://citevisor.com/for/financial-advisors): Make licensing, compensation and client scope visible without turning visibility work into investment-performance claims. - [Healthcare clinics](https://citevisor.com/for/healthcare-clinics): Separate appointment information from medical guidance and make clinical authorship and review dates visible. - [Home services](https://citevisor.com/for/home-services): Make service boundaries, job types and booking conditions clear for homeowners with a specific repair need. - [Hotels](https://citevisor.com/for/hotels): Make room details, booking policies and location facts readable so travelers can assess a stay beyond a generic amenity list. - [Law firms](https://citevisor.com/for/law-firms): Make practice areas, jurisdictions and qualified authors explicit before interpreting a legal-services recommendation. - [Local businesses](https://citevisor.com/for/local-business): Make the service area, opening hours and contact information unambiguous for location-dependent customer questions. - [Manufacturers](https://citevisor.com/for/manufacturing): Publish specifications, certifications and supply constraints so technical buyers can verify whether a component or supplier fits. - [Marketing agencies](https://citevisor.com/for/marketing-agencies): Make channel expertise, reporting methods and client engagement limits clearer than a generic promise of growth. - [Nonprofits](https://citevisor.com/for/nonprofits): Make the organization’s mission, governance and donation use traceable without implying endorsements or manufacturing impact figures. - [Online education](https://citevisor.com/for/online-education): Make course level, prerequisites, instructor credentials and credential outcomes explicit for prospective learners. - [Real estate agencies](https://citevisor.com/for/real-estate): Distinguish agency expertise from listing availability and keep local market claims tied to dated, attributable evidence. - [Restaurants](https://citevisor.com/for/restaurants): Expose a readable menu, dietary information and current opening details so diners can check a specific meal plan. - [Travel operators](https://citevisor.com/for/travel-operators): Describe itinerary conditions, inclusions and accessibility clearly so travelers can evaluate a real trip rather than a destination slogan. ## Tool comparisons - [Otterly.AI alternatives](https://citevisor.com/alternatives/otterly) - [Peec AI alternatives](https://citevisor.com/alternatives/peec-ai) - [Profound alternatives](https://citevisor.com/alternatives/profound) - [Semrush AI Visibility Toolkit alternatives](https://citevisor.com/alternatives/semrush-ai-visibility) - [Ahrefs Brand Radar alternatives](https://citevisor.com/alternatives/ahrefs-brand-radar) - [ai-visibility-checker.io alternatives](https://citevisor.com/alternatives/ai-visibility-checker-io) ## Optional - [About and editorial method](https://citevisor.com/about) - [Privacy notice](https://citevisor.com/privacy) - [Terms](https://citevisor.com/terms)