Query a database over Arrow Flight SQL using the GetFlightInfo/DoGet request flow

domain: data-engineering · 5 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Send a CommandStatementQuery command to the server via GetFlightInfo to execute the SQL and get back a FlightInfo describing where the results live.
  2. Read the FlightInfo's endpoints — each one carries an opaque Ticket the client must present to fetch that partition of results.
  3. Call DoGet(ticket) per endpoint to stream the query's Arrow record batches back as FlightData, rather than assuming a single call returns everything.
  4. Use GetSchema with the same CommandStatementQuery if the result schema is needed up front without executing the query yet.
  5. Use pyarrow.flight (or an ADBC Flight SQL driver) as the client-side implementation rather than hand-rolling the underlying gRPC calls.

Known gotchas

Related routes

Stand up an Arrow Flight SQL server and connect a Python client to it
arrow.apache.org · 5 steps · unrated
Connect to a Flight SQL server using ADBC in Python
arrow.apache.org · 5 steps · unrated
Stream data with Arrow Flight do_get and do_put
arrow.apache.org · 5 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans