Reads public website pages
tokiScanBot retrieves a small, bounded set of same-origin pages so tokiScan can evaluate whether a business is understandable and usable by AI systems.
Official tokiGig crawler identity
tokiScanBot
tokiScanBot is the website acquisition crawler used by tokiScan to inspect publicly available website content during an AI-readiness and AI-visibility scan.
It identifies itself openly, uses bounded requests, and does not attempt to defeat CAPTCHAs, bot challenges, authentication, or other access controls.
Purpose
What tokiScanBot does
Checks machine-readable endpoints
A scan may inspect public resources such as
robots.txt, sitemap.xml,
llms.txt, agents.md, and supported
well-known discovery endpoints.
Collects evidence for an audit
Retrieved public content is used as evidence for a point-in-time tokiScan report. Gemini and other analysis components operate on the content after acquisition.
Allowlisting
How to allow tokiScanBot
If your hosting provider, WAF, CDN, or bot-management system blocks automated requests, you can explicitly allow tokiScanBot.
Allow the canonical User-Agent
Create an allow rule for requests whose User-Agent matches the official tokiScanBot identity below.
tokiScanBot/1.0 (+https://tokigig.com/tokiscan-bot; contact=scan@tokigig.com) Keep normal site protections enabled
You do not need to disable your firewall, CAPTCHA system, or other security controls globally. Scope the exception to tokiScanBot whenever your provider supports that capability.
Retry your tokiScan
After the allow rule is active, rerun the scan. If access is still challenged, contact scan@tokigig.com.
Network identity
IP allowlisting
Canonical production egress IP:
34.70.11.194 Production tokiScanBot website acquisition traffic is routed through a dedicated Google Cloud egress path using this fixed public IPv4 address.
Sites, hosting providers, CDNs, WAFs, and bot-management systems may
allowlist 34.70.11.194 together with the canonical
tokiScanBot User-Agent shown above.
This address identifies tokiScanBot acquisition traffic only. It is not an IP range for Google, Gemini, OpenAI, ChatGPT, Perplexity, or any other AI platform or crawler.
This page is the authoritative tokiGig source for the current tokiScanBot production allowlist identity.
Security behavior
What tokiScanBot does not do
- It does not solve or bypass CAPTCHAs.
- It does not impersonate a human browser.
- It does not impersonate Google, Gemini, OpenAI, ChatGPT, Perplexity, or another crawler.
- It does not attempt to access authenticated or private content.
- A tokiScanBot access failure is not treated as proof that a separate AI platform or AI crawler is also blocked.
Questions or security concerns?
Contact tokiGig
Site owners, hosting providers, and security vendors can contact us about crawler identification, allowlisting, unexpected traffic, or abuse concerns.