# InfoPrice crawler policy

> Published behavior, access controls, and reporting guidance for InfoPrice crawlers.

## Identification

Crawlers use stable, documented product tokens and User-Agent strings. InfoPriceBot identifies scheduled automated crawling; the other roles identify search, discovery, monitoring, and validation activity.

## robots.txt

All listed crawler roles are designed to respect robots.txt directives for public crawling. Site owners can allow or disallow published product tokens through standard robots.txt rules.

## HTTP response handling and rate control

InfoPrice honors Retry-After, backs off after HTTP 429 and repeated 5xx responses, and applies host-level request-rate and concurrency controls.

## Public-data scope and privacy

Normal activity is limited to publicly accessible retail information. It avoids authentication, account, checkout, form-submission, and transactional workflows unless specifically authorized.

## IP verification and reporting

Current crawler prefixes are published at [ips.json](https://bot.infoprice.co/ips.json). If the list is empty, traffic cannot be verified through this mechanism. Report unexpected behavior to [crawler@infoprice.co](mailto:crawler@infoprice.co) with the timestamp, source IP, requested URL, and observed User-Agent; do not send credentials or sensitive data.