Data Engineer (Batch & Streaming)

About the role

Rain is a stablecoin payments platform for enterprises, neobanks, platforms, developers and AI agents, issuing cards accepted at more than 175 million merchant locations. It relies on data from card transactions, settlements, ledger entries and onchain transfers, and is looking for a Data Engineer with batch and streaming experience to bring this data into its warehouse and keep it correct. You will build scalable, idempotent pipelines that handle late and duplicate data and alert the team when something breaks.

Key responsibilities

• Build scalable batch and streaming pipelines, choosing the right approach for latency, cost and correctness.
• Process events near real time, handling deduplication, windowing and late or out-of-order events.
• Own batch ingestion from databases (CDC), files (SFTP and GCS), APIs and onchain sources.
• Build incremental dbt models that handle late data, duplicates, CDC deletes and backfills, and reconcile streaming and batch outputs.
• Orchestrate pipelines in Dagster with sensors, schedules and alerts.
• Add freshness, volume and reconciliation checks to every source and fix root causes.
• Work with backend pods on event and table contracts to prevent downstream breakage.
• Partner with Analytics Engineers, Data Scientists and Risk on their data needs, including ML features.

Required profile

• At least 3 years building production data solutions, owning batch and streaming pipelines end to end from source to warehouse.
• Experience designing data solutions at scale.
• Ability to debug across the source database, pipeline, warehouse and report.
• Ability to use AI tools to learn and work faster while checking their output.

Required skills

• Strong SQL and Python or Rust.
• A cloud data warehouse such as BigQuery, ClickHouse or Snowflake.
• Streaming with Pub/Sub, Kafka, Dataflow/Beam or Flink.
• Batch with dbt and an orchestrator such as Dagster or Airflow.
• Production data quality testing, monitoring and reconciliation.
• Nice to have: ML feature pipelines, payments/banking/blockchain data, CDC tools such as Datastream, Debezium, Meltano, Fivetran or Airbyte, and GCP experience.

What we offer

• Unlimited vacation with a minimum of 10 days taken per year.
• Flexible working: work from home, in an office or both, with a home workspace stipend for new hires.
• Benefits covering 95% of health, dental and vision costs and 90% for dependents, plus a fully subsidised life insurance plan.
• 401(k) with a 4% company match and an equity option plan.
• Monthly health and wellness stipend and in-office meals covered with a DoorDash credit.
• Team summits, including domestic and international offsites.