Senior Data Engineer (f/m/d) at adjoe
Hamburg, Germany
on-site · full_time · Visa sponsorship
Responsibilities:
- Design, build and operate high-throughput data pipelines (real-time and batch) to power feature stores and ML inference at scale.
- Implement stateful stream processing using Apache Flink and integrate with Kafka for low-latency feature computation.
- Ensure data quality, monitoring and lineage across ingestion, transformation (dbt) and serving layers.
- Optimize ETL performance, reduce latency and remove bottlenecks to keep models fresh for sub-100ms inference.
- Collaborate with Data Scientists and ML engineers to productionize features, enable reproducible workflows and support A/B experiments.
Requirements:
- 5+ years in data engineering building systems that handle multi-terabyte daily volumes and high event rates.
- Hands-on experience with Apache Flink (stateful stream processing), Kafka and real-time feature pipelines.
- Strong engineering skills in Java, Python or Go and familiarity with Airflow, dbt, Kubernetes and Terraform.
- Practical knowledge of cloud platforms (AWS) and data lakehouse concepts; focus on performance, reliability and observability.
- Experience debugging complex pipelines, enforcing data quality and collaborating across ML and infra teams.