AI Platform Engineer (m/f/x) at Scalable GmbH
München, Germany, Germany
Posted
on-site · full-time · Visa sponsorship
Apply for this role at Scalable GmbH
Responsibilities:
- Implement and operate an internal AI provisioning platform to streamline access to LLMs and MCP servers (e.g., LiteLLM integrations).
- Build observability and telemetry for models and workflows (metrics, logs, traces) using Datadog, Langfuse or similar tools.
- Apply model governance: security, data privacy, rate limiting and strict API cost controls.
- Develop IaC (Terraform), CI/CD pipelines and containerised deployments to support production reliability.
- Partner with AI and platform engineers to integrate agentic workflows and monitor performance and availability.
Requirements:
- Bachelor’s/Master’s in Computer Science or related and 2+ years of experience in Platform Engineering, DevOps, SRE or backend development.
- Strong AWS experience and proficiency with Infrastructure as Code (Terraform); experience with ECS/Fargate or Kubernetes.
- Proficient in Python or Go, Docker and CI/CD tooling.
- Familiarity with observability frameworks (Datadog, Langfuse) and LLM gateway concepts.
- Practical mindset for security, cost management and scalable cloud-native architectures; strong collaboration skills.