Official crawler identity

InfoPriceBot

The official crawler service operated by InfoPrice.

We provide public-crawl identities and traffic verification for five operational crawler roles.

crawler identity
PRODUCT TOKENInfoPriceBotOPERATORInfoPriceSTATUS Published identity
Our crawlers

Five identities. One identity framework.

Stable, public identifiers help site owners distinguish each InfoPrice operational role.

Automatedv2.0

InfoPriceBot

Scheduled collection of publicly accessible product, price, promotion, availability, catalog, marketplace, and store information.

robots.txt token
InfoPriceBot
Mode
Automated
View documentation
Searchv2.0

InfoPrice-SearchBot

Targeted public-page retrieval to support rapid index refreshes, price-event discovery, and structured listing discovery.

robots.txt token
InfoPrice-SearchBot
Mode
Search
View documentation
Discoveryv2.0

InfoPrice-DiscoveryBot

Systematic exploration of public catalog and listing surfaces to identify relevant product and offer pages for later collection.

robots.txt token
InfoPrice-DiscoveryBot
Mode
Discovery
View documentation
Monitorv2.0

InfoPrice-MonitorBot

Operationally scheduled checks of availability, pricing, and promotion drift against public product pages.

robots.txt token
InfoPrice-MonitorBot
Mode
Monitor
View documentation
Validatorv2.0

InfoPrice-ValidatorBot

Follow-up verification checks for freshness, structural consistency, and policy-compliant validation of previously discovered data sources.

robots.txt token
InfoPrice-ValidatorBot
Mode
Validator
View documentation
Identification

Canonical User-Agents

These stable strings identify InfoPrice crawler traffic. We do not randomize our public crawler identity.

Direct HTTP retrieval without browser emulation. The User-Agent identifies the crawler; it does not describe a browser device.

InfoPriceBot · Generic · pinned exampleMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPriceBot/2.0; +https://bot.infoprice.co/)
InfoPriceBot · GenericMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPriceBot/2.0; +https://bot.infoprice.co/)
InfoPrice-SearchBot · GenericMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-SearchBot/2.0; +https://bot.infoprice.co/search)
InfoPrice-DiscoveryBot · GenericMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-DiscoveryBot/2.0; +https://bot.infoprice.co/discovery)
InfoPrice-MonitorBot · GenericMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-MonitorBot/2.0; +https://bot.infoprice.co/monitor)
InfoPrice-ValidatorBot · GenericMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; InfoPrice-ValidatorBot/2.0; +https://bot.infoprice.co/validator)
Crawling behavior

Built to crawl responsibly.

Our published behavior reflects centralized service configuration, so the website and machine-readable metadata stay aligned.

Read the full crawler policy →
  • Respects robots.txt for automated crawling
  • Uses host-level concurrency and request rate controls
  • Honors HTTP Retry-After
  • Backs off after HTTP 429 and repeated 5xx responses
  • Avoids authentication, account, and checkout workflows unless authorized
  • Avoids forms and transactions during normal crawling
robots.txt

You remain in control.

Use standard robots.txt directives to allow, block, or selectively restrict our crawler roles.

Allow InfoPriceBotUser-agent: InfoPriceBot Allow: /
Allow InfoPrice-SearchBotUser-agent: InfoPrice-SearchBot Allow: /
Allow InfoPrice-DiscoveryBotUser-agent: InfoPrice-DiscoveryBot Allow: /
Allow InfoPrice-MonitorBotUser-agent: InfoPrice-MonitorBot Allow: /
Allow InfoPrice-ValidatorBotUser-agent: InfoPrice-ValidatorBot Allow: /
Block all crawler rolesUser-agent: InfoPriceBot, InfoPrice-SearchBot, InfoPrice-DiscoveryBot, InfoPrice-MonitorBot, InfoPrice-ValidatorBot Disallow: /
Contact

Questions about our crawlers?

Report unexpected behavior or ask for help verifying InfoPrice traffic.

crawler@infoprice.co