About our crawler
JobBoardBot is the crawler for this sports coaching job board. It reads public job listings so coaches can find them in one place.
How to recognize it
It names itself in every request. Its User-Agent starts with JobBoardBot and links to this page. It never pretends to be a browser or another crawler.
What it reads
Public job listings only: careers pages, job pages, job feeds and sitemaps. From each job we show the facts, such as the title, place and pay, with a link to the original posting. We do not republish job descriptions. It never signs in, and it never tries to get around a block, a CAPTCHA or a bot check.
How gently it visits
It follows robots.txt, including Crawl-delay, and waits between requests to the same site. If a site blocks it or asks it to slow down, it stops and doesn't try another way in.
How to stop it
Add these lines to your site's robots.txt. JobBoardBot reads robots.txt before it reads any page. It keeps a copy for up to a day, so a change can take that long to reach it.
User-agent: JobBoardBot
Disallow: /How to remove a listing
To ask us to take a job listing off this site, use our removal form. Request a removal