Software Engineer (HPC Sustainability) at EMBL
United Kingdom
Posted
on-site · full time · 41424.24 · Visa sponsorship
Responsibilities:
- Develop and maintain Python backend services that ingest HPC job telemetry and compute per-job energy and carbon footprint metrics.
- Integrate and contribute to the Green Algorithms open source project to align EBI tooling with global methodologies.
- Design and operate time-series storage (PostgreSQL/TimescaleDB) for efficient aggregation and retrieval of large telemetry datasets.
- Build reporting and Grafana dashboards to surface energy, carbon and utilisation insights to users and stakeholders.
- Support data collection campaigns, troubleshoot production pipelines and contribute to sustainable HPC best practices (E-SCOUT participation).
- Produce clear technical documentation and share knowledge across teams.
Requirements:
- Strong production-grade Python experience focused on data pipelines, concurrency and maintainable code.
- Solid experience with PostgreSQL and time-series data management; familiarity with TimescaleDB is advantageous.
- Working knowledge of Apache Kafka and event-driven pipelines; experience with Pandas and observability tools (Grafana) preferred.
- Good communication and collaboration skills to work with external partners (Cambridge GA team) and cross-functional stakeholders.
- Comfort working in a production codebase, writing tests and contributing to open source; interest in sustainability metrics for HPC.