Zoning Docket bot

Our crawler identifies itself as ZoningDocketBot/1.0 (+https://zoningdocket.com/bot/; low-rate agenda monitor; contact [email protected]).

• It reads public meeting agendas, packets and minutes once a day.
• It obeys robots.txt, including Crawl-delay, and waits at least two seconds between requests to the same host.
• It caches everything and re-checks documents with conditional requests instead of downloading them again.
• It never works around access controls or bot protection. Sites that ask not to be crawled are not crawled.

Questions, or want us to slow down or stop? Email [email protected] and we will act the same day.