Data Engineer, App SW at Wayve
Germany
Posted
on-site · full_time · Visa sponsorship
Responsibilities:
- Build and maintain scalable data pipelines for model development, evaluation and production ML workflows.
- Ingest, transform and curate large-scale real-world, synthetic and partner datasets into model-ready formats aligned to common taxonomies and coordinate systems.
- Implement data quality checks, validation, monitoring and traceability for raw and processed data.
- Mine and curate scenarios to increase coverage, diversity and feature-specific training data.
- Optimise pipeline performance, reliability and developer self-service to speed iteration.
- Collaborate with ML engineers, Data Corpus and AI Platform teams to integrate pipelines with training and production systems.
Requirements:
- Proven production experience building and operating scalable distributed data pipelines and ETL frameworks.
- Strong software engineering skills in Python and familiarity with PySpark/SQL and OLAP concepts.
- Experience with workflow/orchestration tools (Airflow, Flyte) and distributed compute (Spark, Ray) preferred.
- Understanding of robotics/autonomous driving data (coordinate frames, sensors, calibration) and large-scale dataset curation.
- Focus on data quality, testing, monitoring and reproducible data processing practices.
- Good collaboration skills and ability to work closely with ML teams to deliver model-ready datasets.