Pull market and grid data from NYISO public data feeds

Steps

1. Access the NYISO Market Information System (MIS) public data index at http://mis.nyiso.com/public/ to browse available CSV file categories including LBMP (day-ahead and real-time), load, fuel mix, and interface flows.
2. Construct download URLs following the NYISO naming convention: files are organized by type and date, e.g., for real-time zonal LBMP retrieve the zip archive for the target date from the appropriate subdirectory under mis.nyiso.com/public/.
3. For programmatic access, consult the NYISO Finance APIs User Guide and Metering API User Guide (available at nyiso.com/documents) to understand the authenticated API endpoints for metering and settlement data beyond the public bulk files.
4. Parse the downloaded CSV files; NYISO timestamps are Eastern Prevailing Time — apply DST-aware conversion before storing, noting that hour-ending conventions differ from hour-beginning conventions used by other ISOs.
5. For real-time operational data (sub-hourly), use the NYISO Real-Time Dashboard API which provides JSON data backing the public dashboard displays.
6. For capacity market data (ICAP), download the monthly ICAP auction results files from the NYISO capacity market section of the website.