Senior DevOps Engineer (all genders) | Data Platform at Kaufland e-commerce
on-site · festanstellung · Visa sponsorship
Apply for this role at Kaufland e-commerce
Responsibilities:
- Operate and own self-hosted Apache Kafka clusters and Schema Registry: ACLs, quotas, certificates, upgrades, DR and capacity planning.
- Run Debezium-based CDC pipelines and BigQuery sinks: manage connectors, snapshots, offsets, replica lag and sink loaders.
- Manage Kubernetes workloads including Navarch orchestration: resource management, autoscaling, debugging and cost control.
- Implement and maintain IaC and GitLab CI/CD automation to replace manual ticketing for access and infra changes.
- Maintain observability and cost monitoring (Datadog, Slack alerts); tune retention, logging and infra spend.
- Participate in triage rotation (approx. 1 week in 3) to handle ingestion, schema alerts and access requests; automate repetitive tasks.
- Act as senior technical partner in design reviews and multi-quarter initiatives; help evolve BigQuery and data architecture.
Requirements:
- Several years operating production infrastructure with on-call experience and demonstrated incident ownership and remediation.
- Deep hands-on Kafka operations knowledge: sizing, partitioning, rebalancing, replication/ISR and upgrades.
- Production experience with Debezium or other cross-system DB replication patterns and sink architectures.
- Strong Kubernetes experience managing stateful workloads, autoscaling and observability in production.
- Proficiency with IaC and CI/CD tools (Terraform/Ansible, GitLab pipelines) and scripting (Python/SQL).
- Practical cost-awareness and observability skills (Datadog or similar) and ability to trade off reliability vs cost.
- Good English communication and ability to collaborate with data engineers, analysts and product owners.