MaxMyMarketBot

MaxMyMarket is a marketing assistant for small businesses. When a business signs up, MaxMyMarketBot reads its public website so the assistant can learn what the business does, what it sells and where it trades, and write about it accurately. It may read the site again later to notice what has changed.

It also reads a small number of other public pages about that business: an article that mentions it, say, or the page of a market it trades at. If your site was one of those, that is why it visited.

• Public pages a visitor can reach without logging in: pages linked from the site and pages listed in its sitemap, with the images on them.
• Never pages behind a login or password, and never baskets, checkouts or account pages.
• It does not fill in forms, buy anything, or post anything. Links to other sites are noted but not followed, except to the business’s own pages elsewhere (its shop or booking page, for example).

What it reads is shown to the business so they can confirm or correct it. We do not sell it, and we do not use it to train AI models. Our Privacy Policy explains how we handle it.

• It honours robots.txt: it checks your rules before it reads a page, and skips anything they disallow for it.
• It makes no more than 8 requests to a site at once, and stops waiting for a page that is slow to answer.
• If your site says it is busy, or keeps failing or timing out, it makes fewer requests at once and waits as long as your site asks (up to 30 seconds). A page your site turned away is asked for again only once during that visit, even when the visit is spread over several sittings (your home page a few more times, a while apart, since nothing else can be read without it).
• If your robots.txt sets a Crawl-delay, it makes one request at a time and waits that long between them (up to 10 seconds).
• It always says who it is. Every request carries this user agent:Mozilla/5.0 (compatible; MaxMyMarketBot/1.0; +https://www.maxmymarket.com/bot)

To keep MaxMyMarketBot off your whole site, add this to your robots.txt:

User-agent: MaxMyMarketBot
Disallow: /

To keep it off part of your site only, disallow just those paths. It picks up a change the next time it visits.

If it is causing you a problem, or you want us to stop visiting your site or to remove something we read from it, email support@vitellian.com with the address of your site and we will sort it out.