event scraping playbook - extracting municipal calendar data from city government APIs

Documented steps

1. Query the API endpoint with a 30-day window starting from today's date
2. Parse the JSON response and filter out any entries marked as private or requiring authentication
3. Extract event title, date, time, location, and public description fields
4. Check for an rnotes field in each event object - this is where recurrence patterns are documented
5. Handle pagination by tracking the next_page cursor and incrementing until no cursor is returned
6. Store sanitized data in the local cache with a timestamp for freshness validation