Senior Data Engineer (all genders) at Kaufland e-commerce

on-site · festanstellung · Visa sponsorship

Apply for this role at Kaufland e-commerce

Responsibilities:
- Design, develop and maintain the streaming and CDC backbone (Apache Kafka, Debezium, Schema Registry, BigQuery sinks).
- Build and operate Kubernetes-hosted platform components, including our workflow manager (Navarch) and self-hosted GitLab CI/CD pipelines.
- Lead cross-cutting architectural initiatives from concept to production across streaming, orchestration, warehouse and observability layers.
- Operate and evolve a BigQuery multi-project setup: access management, partitioning/clustering, slot strategy and cost-aware data models.
- Define platform boundaries and enable domain teams to ship pipelines reliably (ownership, quality guards, reduced hand-offs).
- Implement and maintain observability (Datadog, Slack alerts, cost dashboards) and platform-level FinOps practices.
- Provide senior input in design reviews, merge-request reviews and multi-quarter technical initiatives.

Requirements:
- Several years of senior data-engineering experience with independent ownership of production systems and on-call responsibility.
- Strong Python development skills and solid SQL knowledge for cloud data warehouses (partitioning, clustering, idempotency, query cost).
- Proven ability to troubleshoot complex, cross-component issues (schema evolution, broker lag, query performance, cost anomalies).
- Good software engineering foundations: object-oriented design, design patterns applied to data workloads.
- Hands-on experience with multiple of the following: Apache Kafka, Debezium, Schema Registry, BigQuery, Kubernetes, Terraform, Ansible, dbt, GitLab, Datadog.
- Experience applying FinOps at platform scale and designing cost-aware data architectures.
- Strong communication skills and experience driving technical decisions across teams.