# InfoPriceBot full documentation > Complete public crawler identity, policy, and traffic-verification documentation operated by InfoPrice. ## InfoPriceBot InfoPrice provides price-intelligence services and operates this public crawler identity and verification service. ## Crawler identities - [InfoPriceBot](https://bot.infoprice.co/index.md): Scheduled collection of publicly accessible product, price, promotion, availability, catalog, marketplace, and store information. - [InfoPrice-SearchBot](https://bot.infoprice.co/search.md): Targeted public-page retrieval to support rapid index refreshes, price-event discovery, and structured listing discovery. - [InfoPrice-DiscoveryBot](https://bot.infoprice.co/discovery.md): Systematic exploration of public catalog and listing surfaces to identify relevant product and offer pages for later collection. - [InfoPrice-MonitorBot](https://bot.infoprice.co/monitor.md): Operationally scheduled checks of availability, pricing, and promotion drift against public product pages. - [InfoPrice-ValidatorBot](https://bot.infoprice.co/validator.md): Follow-up verification checks for freshness, structural consistency, and policy-compliant validation of previously discovered data sources. ## Responsible crawling - Respects robots.txt directives for public crawling. - Uses host-level concurrency and request-rate controls. - Honors Retry-After and backs off after HTTP 429 and repeated 5xx responses. - Avoids authentication, account, checkout, form-submission, and transactional workflows unless authorized. ## Verify crawler traffic User-Agent strings can be spoofed. Use [published IP prefixes](https://bot.infoprice.co/ips.json) and the [verification guide](https://bot.infoprice.co/verify.md) to verify traffic. ## InfoPrice-SearchBot ## Identify InfoPrice-SearchBot Current public version: 2.0. robots.txt product token: `InfoPrice-SearchBot`. ## Canonical User-Agent ```text Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-SearchBot/2.0; +https://bot.infoprice.co/search) ``` ## Device profiles - **generic**: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-SearchBot/2.0; +https://bot.infoprice.co/search) - **desktop**: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Safari/537.36; compatible; InfoPrice-SearchBot/2.0; +https://bot.infoprice.co/search - **mobile**: Mozilla/5.0 (Linux; Android 14; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Mobile Safari/537.36 InfoPrice-SearchBot/2.0 (+https://bot.infoprice.co/search) Device profiles describe generic HTTP, desktop Chromium, or mobile web contexts. Mobile does not represent native-app traffic; runtime browser versions and client hints come from the actual fetcher context. ## Typical use cases - Discovery-driven page indexing in support of scheduled collection. - Monitoring rapidly changing offer and category endpoints. - Supporting later collection jobs with verified source pages. ## Verification and contact A User-Agent alone is not proof of identity. Match source addresses against [published networks](https://bot.infoprice.co/ips.json) and follow the [verification guide](https://bot.infoprice.co/verify.md). For assistance, contact [crawler@infoprice.co](mailto:crawler@infoprice.co). ## InfoPrice-DiscoveryBot ## Identify InfoPrice-DiscoveryBot Current public version: 2.0. robots.txt product token: `InfoPrice-DiscoveryBot`. ## Canonical User-Agent ```text Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-DiscoveryBot/2.0; +https://bot.infoprice.co/discovery) ``` ## Device profiles - **generic**: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-DiscoveryBot/2.0; +https://bot.infoprice.co/discovery) - **desktop**: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Safari/537.36; compatible; InfoPrice-DiscoveryBot/2.0; +https://bot.infoprice.co/discovery - **mobile**: Mozilla/5.0 (Linux; Android 14; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Mobile Safari/537.36 InfoPrice-DiscoveryBot/2.0 (+https://bot.infoprice.co/discovery) Device profiles describe generic HTTP, desktop Chromium, or mobile web contexts. Mobile does not represent native-app traffic; runtime browser versions and client hints come from the actual fetcher context. ## Typical use cases - Discovering catalog pages, pagination branches, and detail-page entry points. - Detecting new listings for scheduled downstream collection. - Detecting product route structures and metadata patterns. ## Verification and contact A User-Agent alone is not proof of identity. Match source addresses against [published networks](https://bot.infoprice.co/ips.json) and follow the [verification guide](https://bot.infoprice.co/verify.md). For assistance, contact [crawler@infoprice.co](mailto:crawler@infoprice.co). ## InfoPrice-MonitorBot ## Identify InfoPrice-MonitorBot Current public version: 2.0. robots.txt product token: `InfoPrice-MonitorBot`. ## Canonical User-Agent ```text Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-MonitorBot/2.0; +https://bot.infoprice.co/monitor) ``` ## Device profiles - **generic**: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-MonitorBot/2.0; +https://bot.infoprice.co/monitor) - **desktop**: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Safari/537.36; compatible; InfoPrice-MonitorBot/2.0; +https://bot.infoprice.co/monitor - **mobile**: Mozilla/5.0 (Linux; Android 14; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Mobile Safari/537.36 InfoPrice-MonitorBot/2.0 (+https://bot.infoprice.co/monitor) Device profiles describe generic HTTP, desktop Chromium, or mobile web contexts. Mobile does not represent native-app traffic; runtime browser versions and client hints come from the actual fetcher context. ## Typical use cases - Scheduled pricing and availability drift checks. - Promotion and status monitoring for known URLs. - Validation of previously discovered catalog pages. ## Verification and contact A User-Agent alone is not proof of identity. Match source addresses against [published networks](https://bot.infoprice.co/ips.json) and follow the [verification guide](https://bot.infoprice.co/verify.md). For assistance, contact [crawler@infoprice.co](mailto:crawler@infoprice.co). ## InfoPrice-ValidatorBot ## Identify InfoPrice-ValidatorBot Current public version: 2.0. robots.txt product token: `InfoPrice-ValidatorBot`. ## Canonical User-Agent ```text Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-ValidatorBot/2.0; +https://bot.infoprice.co/validator) ``` ## Device profiles - **generic**: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-ValidatorBot/2.0; +https://bot.infoprice.co/validator) - **desktop**: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Safari/537.36; compatible; InfoPrice-ValidatorBot/2.0; +https://bot.infoprice.co/validator - **mobile**: Mozilla/5.0 (Linux; Android 14; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Mobile Safari/537.36 InfoPrice-ValidatorBot/2.0 (+https://bot.infoprice.co/validator) Device profiles describe generic HTTP, desktop Chromium, or mobile web contexts. Mobile does not represent native-app traffic; runtime browser versions and client hints come from the actual fetcher context. ## Typical use cases - Verifying freshness and consistency of discovered payloads. - Cross-checking policy constraints before accepting new crawl artifacts. - Spot-checks for data quality and schema compatibility. ## Verification and contact A User-Agent alone is not proof of identity. Match source addresses against [published networks](https://bot.infoprice.co/ips.json) and follow the [verification guide](https://bot.infoprice.co/verify.md). For assistance, contact [crawler@infoprice.co](mailto:crawler@infoprice.co). ## InfoPrice crawler policy ## Identification Crawlers use stable, documented product tokens and User-Agent strings. InfoPriceBot identifies scheduled automated crawling; the other roles identify search, discovery, monitoring, and validation activity. ## robots.txt All listed crawler roles are designed to respect robots.txt directives for public crawling. Site owners can allow or disallow published product tokens through standard robots.txt rules. ## HTTP response handling and rate control InfoPrice honors Retry-After, backs off after HTTP 429 and repeated 5xx responses, and applies host-level request-rate and concurrency controls. ## Public-data scope and privacy Normal activity is limited to publicly accessible retail information. It avoids authentication, account, checkout, form-submission, and transactional workflows unless specifically authorized. ## IP verification and reporting Current crawler prefixes are published at [ips.json](https://bot.infoprice.co/ips.json). If the list is empty, traffic cannot be verified through this mechanism. Report unexpected behavior to [crawler@infoprice.co](mailto:crawler@infoprice.co) with the timestamp, source IP, requested URL, and observed User-Agent; do not send credentials or sensitive data. ## Verify InfoPrice crawler traffic User-Agent strings can be spoofed. Verify traffic using the following layered process. ## Verification process 1. Confirm the User-Agent contains a published crawler product token. 2. Match the source address against [published CIDRs](https://bot.infoprice.co/ips.json). 3. When a hostname strategy is published, inspect reverse DNS and confirm it resolves forward to the original source IP. ## Retrieve current network ranges ```sh curl -s https://bot.infoprice.co/ips.json | jq ``` ## Retrieve machine-readable identity ```sh curl -s https://bot.infoprice.co/.well-known/bot.json | jq ``` Contact [crawler@infoprice.co](mailto:crawler@infoprice.co) for help verifying traffic.