AI Platform Engineer (m/f/x) at Scalable GmbH
München, Germany, Germany
Posted
on-site · full-time · Visa sponsorship
Apply for this role at Scalable GmbH
Responsibilities:
- Design, build and operate an internal AI provisioning platform to provide consistent access to LLMs and MCP servers (e.g., via LiteLLM).
- Implement observability for models and agentic workflows: metrics, logging and alerting using tools like Datadog and Langfuse.
- Enforce model governance: security controls, data privacy, rate limiting and LLM API cost management.
- Build and maintain CI/CD pipelines, Infrastructure as Code (Terraform) and containerised runtimes (Docker).
- Collaborate with AI Software Engineers to integrate models into cloud-native architectures and monitor production reliability and performance.
Requirements:
- Bachelor’s or Master’s in Computer Science or related field and 2+ years in Platform Engineering, DevOps, SRE or backend engineering.
- Hands-on experience with AWS and Infrastructure as Code (Terraform); familiarity with ECS/Fargate or Kubernetes.
- Proficiency in Python or Go, containerisation (Docker) and CI/CD tooling.
- Experience with observability/telemetry tools (Datadog, Langfuse) and understanding of LLM gateway concepts.
- Strong focus on security, cost-efficiency and collaborative communication skills.