Data & Pipeline Engineer

Everything Atlas says about the federal market traces back to the ingest. Awards, budgets, protests, forecasts, and filings land nightly, get resolved against the companies and programs already in the record, and become the thing a customer bets a bid on. You own that layer.

What you’ll own

• The nightly ingest: awards, budgets, protests, forecasts, and filings, landing on schedule.
• Data correctness. When a source changes shape at 2am, you catch it before a customer does.
• Entity resolution and dedupe, the unglamorous work that decides whether the record is trustworthy.
• Backfills and archives. What we keep is what competitors can't buy back.
• The runbook for when it breaks, and the alerting that tells you it did.

What you’ll bring

• You've run production pipelines someone depended on, and you've been paged when they broke.
• Fluency with schema drift, late-arriving data, and the ways public feeds quietly change.
• Query skills you can defend, and enough software engineering to keep a pipeline readable a year later.
• Judgment about when a source is wrong versus when our handling of it is wrong.

Logistics

Location

Washington, DC or remote (U.S.)

Authorization

U.S. work authorization required

Engagement

Full time