Data Engineer (Autonomous Systems) at Ellison Institute of Technology
United Kingdom
Posted
on-site · full_time · Visa sponsorship
Apply for this role at Ellison Institute of Technology
Responsibilities:
- Design, implement, and maintain high-throughput, low-latency ingestion pipelines for live video, sensor telemetry, robot joint states, and instrument control signals.
- Build edge-to-cloud telemetry stacks (MQTT, Kafka, media streams) with validation and schema enforcement at the edge.
- Create streaming APIs, transform and normalize multimodal data into model-ready datasets and shared data models.
- Design schema, versioning, and data provenance practices; maintain knowledge graphs and metadata used by downstream ML/robotics models.
- Collaborate closely with AI researchers, robotics engineers, and domain scientists to iterate on data formats, tooling, and testing.
- Implement monitoring, alerting, and automated testing for data quality, throughput, and latency; support deployments on cloud and GPU infrastructure.
Requirements:
- Strong Python experience and production track record in data engineering for high-frequency/real-time systems.
- Hands-on experience with Kafka, MQTT, streaming frameworks, media streams (HLS/RTSP) and event-driven architectures.
- Familiarity with cloud/GPU infrastructure, edge computing patterns, schema design, and data provenance practices.
- Experience integrating hardware telemetry and robotic systems; ability to translate sensor data into model-ready features.
- Comfortable with API frameworks (FastAPI/gRPC/GraphQL), version control, testing, and collaborative workflows.
- Strong communication skills and experience working in multidisciplinary teams; attention to robust system design and reproducibility.