AI Platform Engineer (m/f/x) at Scalable GmbH
München, Germany, Germany
Posted
on-site · full-time · Visa sponsorship
Apply for this role at Scalable GmbH
Responsibilities:
- Develop and operate an internal AI provisioning platform to standardize model access across teams (supporting LiteLLM/MCP servers).
- Build LLM observability: capture metrics, logs and traces; set alerts and dashboards (Datadog, Langfuse, etc.).
- Implement governance controls: authentication, data protection, rate limiting and strict API cost monitoring.
- Create and maintain cloud infrastructure with IaC (Terraform) and ensure reliable CI/CD and container workflows (Docker).
- Work closely with AI software engineers to integrate agentic workflows and maintain production SLAs.
Requirements:
- Several years in Platform Engineering, DevOps, SRE or backend engineering roles.
- Strong AWS skills and hands-on Terraform experience for infrastructure provisioning.
- Proficiency in Python or Go and practical experience with CI/CD, containers and deployment automation.
- Experience with observability/monitoring tooling and managing production ML/LLM services.
- Understanding of security, data privacy and cost-control practices for API-driven model usage.