AI Platform Engineer (m/f/x) at Scalable GmbH
Germany
Posted
on-site · full-time · Visa sponsorship
Apply for this role at Scalable GmbH
Responsibilities:
- Build and maintain the internal AI provisioning platform to streamline access to LLMs and MCP servers (e.g., LiteLLM).
- Implement LLM observability, metrics, logging and alerting (Datadog, Langfuse) to track performance and costs.
- Define and enforce governance: security controls, data privacy safeguards, rate limiting and API cost management.
- Partner with AI and software teams to integrate cloud-native, agentic workflows and provide developer-friendly APIs.
- Operate CI/CD, IaC (Terraform) and monitoring to keep AI services secure, reliable and cost-effective.
Requirements:
- Bachelor’s or Master’s in Computer Science or related field and 2–5 years in Platform/DevOps/SRE roles.
- Strong AWS experience and proven IaC skills with Terraform.
- Proficiency in Python or Go, containerization (Docker) and CI/CD tooling.
- Experience with LLM deployments, observability tools and API cost governance.
- Strong collaboration, security-oriented mindset and practical troubleshooting skills.