Web crawler

ProdjaBot

Who we are

ProdjaBot is the crawler of Prodja, a market-intelligence service for Australian care providers, run by Ezyful Pty Ltd. It identifies itself with this user agent:

ProdjaBot/1.0 (+https://prodja.com.au/bot)

What it reads

Public pages about care businesses: provider listings on public directories, and providers' own websites. From them it keeps business-level facts: that a business is listed, its published rating and review count, and its website.

It does not keep personal information. It never stores review text, reviewers' names, or listings of individual workers, and it never logs in, fills in forms or gets past access controls.

How it behaves

• It reads robots.txt first and follows it, including a Crawl-delay.
• It makes one request at a time to a site, at most about one a second.
• It backs off when a site says it is busy (HTTP 429 or 5xx) and honours Retry-After.
• Most sites are visited once a quarter.

Limiting or blocking it

To keep ProdjaBot out of your whole site, add this to your robots.txt:

User-agent: ProdjaBot
Disallow: /

To slow it down, add Crawl-delay: 10 (seconds) under the same user agent. Changes apply from its next visit.

Contact

If ProdjaBot causes you any trouble, or you want us to remove something, email hello@prodja.com.au.