The role
Pipelines that expect late and duplicate data because real sources do.
What you will do
Assist on ingestion that is idempotent by device and source timestamp, watermarking that distinguishes late from missing, and warehouse modelling others can actually query. Freshness and correctness are monitored as first-class signals.
What we expect
SQL and Python, familiarity with a warehouse and an orchestration tool. Streaming is a plus — knowing which problems genuinely need it matters more.
The pipeline you document is the one the client's engineer will run.
Apply for this role
An engineer reads every application. Expect a reply either way.