(Senior) Data Engineer (m/f/x) at Scalable GmbH
München, Germany, Germany
Posted
on-site · full-time · Visa sponsorship
Apply for this role at Scalable GmbH
Responsibilities:
- Design, build and operate scalable cloud-based data pipelines and platform components on AWS.
- Ingest data from internal services and third parties, extend and maintain the lakehouse for analytics and regulatory use cases.
- Prepare, clean and transform structured and unstructured data into reusable, high-quality data models for reporting, analytics and AI.
- Implement testing, monitoring and alerting to ensure pipeline accuracy, reliability and performance.
- Collaborate with product, engineering and data teams to deliver data-driven features and enable stakeholders to consume data.
- Drive performance optimization, capacity planning and security best practices across the data stack.
Requirements:
- University degree in computer science, mathematics, natural sciences or equivalent experience.
- Several years of hands-on data engineering experience building production pipelines in AWS.
- Strong skills in Python and SQL; experience with PySpark or Spark and data modeling frameworks (dbt preferred).
- Proven experience with orchestration and infra tools such as Airflow, Terraform and AWS services (S3, Glue, Athena, IAM, VPC).
- Familiarity with streaming technologies (Kafka, Kinesis, Flink, Spark Streaming) and testing/monitoring practices.
- Good communication skills, a collaborative mindset, and willingness to share best practices across teams.