Our crawler
EventAgencyFinderBot reads the websites of event agencies so we can check they are still working and list the facts they publish about themselves.
It identifies itself with this user agent:
EventAgencyFinderBot/1.0 (+https://eventagencyfinder.com/bot/)
What it does
- Reads the home page and the about, services and contact pages it links to.
- If those pages carry no recent date, it may also read one news or portfolio page and the site's blog feed, to see whether the agency has been active in the last 12 months.
- Makes no more than one request per second to any site, and usually far fewer.
- Follows robots.txt. If your robots.txt disallows it, it stops.
- If a site refuses automated requests, it may load the same pages once in a normal browser. It never tries to get past a security check or captcha.
- Visits each site about once every 90 days.
- Never submits forms, logs in or downloads files other than web pages.
People check too
The crawler does the first pass. People review what it finds before and after it goes on the site:
- We hand-check new listings in every batch and take off businesses that are not event or entertainment agencies, such as venues, caterers, rental shops and travel companies.
- Where a business has public reviews, we use the date of its latest review as one sign that it is still working.
- We check samples of the facts on each city page against the agencies' own websites.
Had a bad experience with a listed agency, or think one shouldn't be here? Tell us. We read every report, and agencies with serious, repeated complaints are reviewed and can be taken off the list.
How to block it
Add this to your robots.txt:
User-agent: EventAgencyFinderBot Disallow: /
If you'd also like your agency taken off the directory, use the "Remove this listing" link on its profile, or contact us.