AI Platform Engineer (m/f/x) at Scalable GmbH

on-site · full-time · Visa sponsorship

Apply for this role at Scalable GmbH

Responsibilities:
- Design, build and operate an internal AI provisioning platform that provides secure, cost-controlled access to LLMs and MCP servers (e.g., via LiteLLM).
- Implement observability, logging and alerting for model usage and performance using tools like Datadog and Langfuse.
- Enforce model governance: access control, data privacy, rate limiting and API cost management.
- Collaborate with AI Software Engineers to integrate agentic workflows and cloud-native architectures.
- Build CI/CD, IaC and monitoring to ensure reliable, performant and cost-efficient production systems.

Requirements:
- Bachelor’s or Master’s in Computer Science or related field and 2–5 years in Platform Engineering, DevOps, SRE or backend engineering.
- Hands-on AWS experience and Infrastructure as Code (Terraform).
- Proficiency in Python or Go, containerization (Docker) and CI/CD pipelines.
- Familiarity with LLM infrastructure, observability tooling (Datadog, Langfuse) and API cost governance.
- Strong security and data-privacy mindset, troubleshooting skills and ability to work cross-functionally.