configure an s3-backed dvc remote and push/pull tracked data

domain: dvc.org/doc · 5 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Run dvc remote add -d myremote s3://mybucket/path to register the bucket as the project's default remote, which writes a remote section into .dvc/config
  2. Provide AWS credentials via the AWS CLI config or environment variables so DVC can authenticate using the standard AWS credential chain
  3. Use dvc remote modify --local to write any sensitive per-user settings to the git-ignored .dvc/config.local file instead of the shared, git-tracked config
  4. Ensure the AWS identity used has s3:ListBucket, s3:GetObject, s3:PutObject, and s3:DeleteObject permissions on the bucket
  5. Run dvc push to upload tracked data/cache to the remote and dvc pull on another checkout to download and link it back into the workspace

Known gotchas

Related routes

Configure a DVC pipeline stage with an external S3 dependency and output that DVC does not cache locally
doc.dvc.org · 5 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans