AI Data Engineer at The Francis Crick Institute

London, United Kingdom

on-site · full_time · 60670 · Visa sponsorship

Apply for this role at The Francis Crick Institute

Responsibilities:
- Design, build and maintain end-to-end data pipelines (batch and streaming) to support AI/ML workflows.
- Select and implement data storage, processing frameworks and orchestration tools in collaboration with senior engineers.
- Prepare, clean, transform and version datasets for model training, evaluation and inference.
- Implement data validation, schema enforcement and monitoring to ensure pipeline reliability and data quality.
- Work with data scientists and ML engineers to accelerate model training, deployment and reproducibility.
- Optimize infrastructure and workflows for large-scale ML workloads and ensure security and governance practices.
- Contribute to platform tooling, documentation and operational runbooks for AI data infrastructure.

Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science or related field.
- Strong programming skills in Python and SQL; experience building ETL/ELT pipelines.
- Practical experience with cloud platforms (AWS/GCP/Azure) and container/orchestration tooling.
- Familiarity with ML pipeline tools, data versioning and CI/CD for machine learning.
- Experience with data quality, monitoring, validation and data governance practices.
- Good communication skills and a collaborative mindset; able to work with research teams and engineers.
- Experience in biomedical or research environments is desirable but not required.