OAV.io-Inventory

OAV.io-Inventory is the crawler OAV.io (One Answer View™, The Automotive Answer Engine™, operated by OneAuctionView LLC) uses to read public vehicle listing pages on car dealers' websites.

When it reads a site

What it reads is used to show dealers' vehicles accurately on OAV.io and for aggregated market statistics. It is not used to train AI models.

What it does not do

User agent

Mozilla/5.0 (compatible; OAV.io-Inventory/1.0; +https://crawler.oav.io)

robots.txt

It reads your site's robots.txt before any other page and follows it (RFC 9309), using the group for OAV.io-Inventory when there is one, otherwise the * group. To keep it off your site:

User-agent: OAV.io-Inventory
Disallow: /

How fast

One page at a time on any one site, at least 10 seconds apart, or longer if your robots.txt sets a Crawl-delay. Never more than 40 pages from one site in a day. If a site refuses it, it stops reading that site for the rest of the day.

Verifying it is us

Requests from OAV.io-Inventory are signed with HTTP Message Signatures (RFC 9421), using the Web Bot Auth profile. They carry Signature-Agent: "https://crawler.oav.io" with a Signature-Input and Signature header. Its public key is published at https://crawler.oav.io/.well-known/http-message-signatures-directory.

Questions

Write to oavsupport@oav.io.