AgorantisBot
The price and stock checker of Agorantis.
Who we are
Agorantis shows businesses and their AI agents the public price and stock of a product at each shop, with proof and the time it was checked. AgorantisBot is the program that reads those public pages. Every request it sends says so:
User-Agent: AgorantisBot/1.0 (+https://agorantis.com/bot)
Every request is also signed with Web Bot Auth (HTTP Message Signatures, Ed25519), so a site can check that it really comes from us. Our public keys are at agorantis.com/.well-known/http-message-signatures-directory.
What we read
- Public product and category pages, sitemaps and robots.txt. Only what a shopper sees without logging in.
- Product names, prices, stock and the page address. Never accounts, carts, checkouts, reviews or personal data.
- One request at a time per site, a few seconds apart, slower when your robots.txt sets a Crawl-delay.
Rules we follow
- robots.txt, read to the official standard (RFC 9309), for the name AgorantisBot or for all robots. We read it again at least once a day.
- Meta robots and X-Robots-Tag: we skip pages marked noindex and never follow links on pages marked nofollow.
- We never follow hidden links or links marked rel="nofollow".
- When a site answers 429 or a server error, we slow down and wait the time it names in Retry-After.
- AgorantisBot never solves CAPTCHAs and never pretends to be a browser or a person.
- Where a site turns away automated visitors, we may read the same public pages through a third-party data provider, whose requests look like a regular browser and do not carry our name. Your robots.txt rules and our opt-out list apply to those reads too.
How to opt out
Add this to your robots.txt. We stop within 24 hours:
User-agent: AgorantisBot Disallow: /
Or write to us. We add your domain to our opt-out list and stop reading it, and every page on it, for good.
Contact
Questions, a request to slow down, or anything we got wrong: bot@agorantis.com. Please include your domain.