Export datasets from Brightspace (D2L) Data Hub

Steps

1. Authenticate using D2L's Valence OAuth 2.0 flow: register an application via the D2L Developer Portal, obtain an access token with the data export scope, and pass it as a Bearer token in the Authorization header.
2. List available Brightspace Data Sets (BDS) plugins by calling GET /d2l/api/lp/(version)/dataExport/bds/list; each plugin entry includes a pluginId and a description of the dataset.
3. Download a full dataset by calling GET /d2l/api/lp/(version)/dataExport/bds/download/(pluginId); the response is a ZIP file containing one or more CSV files representing the dataset.
4. For Advanced Data Sets (ADS), submit an export job via POST to /d2l/api/lp/(version)/dataExport/jobs providing the exportJobId and desired filters; then poll GET /d2l/api/lp/(version)/dataExport/jobs/(exportJobId) until the status field is complete.
5. Download the completed ADS export via GET /d2l/api/lp/(version)/dataExport/download/(exportJobId); the response is a ZIP file — parse the enclosed CSV files for the specific data (e.g., enrollments, grades, logins).
6. Schedule regular BDS pulls; full BDS datasets are regenerated on a platform-managed cadence (typically daily or weekly depending on the dataset size and configuration), so polling more frequently than the regeneration interval returns the same snapshot.