Senior Software Engineer, Data and Orchestration at Wayve
United Kingdom
Posted
on-site · full_time · Visa sponsorship
Responsibilities:
- Evolve Wayve's data pipeline platform and revamp the existing Harness system.
- Design and build a new DAG-based orchestration platform to run high-volume fleet data workflows.
- Create tooling and libraries to simplify ingestion, processing, inference and evaluation workflows company-wide.
- Ensure the platform runs hundreds of parallel pipeline steps efficiently with correct outputs and resource prioritisation.
- Support batch inference and performance-optimisation workflows to enable cost-effective evaluations.
- Improve platform reliability, observability and incident-response processes aligned to business SLOs.
- Work closely with partner teams to translate requirements into scalable, maintainable solutions.
Requirements:
- Strong software-engineering fundamentals and solid Python programming skills.
- Experience building and maintaining production-grade systems at scale (distributed systems, large data volumes or high-throughput processing).
- Familiarity with testing best practices (unit, integration, TDD) and data-driven development.
- Experience with distributed event streaming (e.g., Apache Kafka) and databases such as Postgres or ClickHouse.
- Comfortable designing DAG-based orchestration and workflow platforms (experience with Ray, Flyte or similar is a plus).
- Good collaboration skills and experience working with platform users and partner teams to deliver solutions.