Senior Data Infrastructure Engineer – Build a (self-hosted) Greenfield Data Lake at i3D.net

Capelle a/d IJssel, Netherlands

true · full_time · Visa sponsorship

Responsibilities:
- Architect and build a self-hosted, open-source-first Data Lake: define storage, ingestion, processing and query layers.
- Implement reliable data ingestion pipelines for metrics, logs, business transactions and financial data from sources (MariaDB, Prometheus, OpenSearch, APIs).
- Design schemas, transformation layers and data models to make raw data consistent, queryable and downstream-ready.
- Integrate platform components (MinIO, Iceberg/Delta, Spark/Flink, Trino/ClickHouse) and ensure they operate without disrupting production.
- Own platform reliability: monitoring, alerting, capacity planning, backup and incident response.
- Collaborate with Platform, Infrastructure, Network and Product teams to understand data needs and provide access patterns and documentation.
- Produce clear documentation and a data catalogue so teams can discover and reuse datasets.

Requirements:
- 6+ years experience building and operating data infrastructure or pipelines in production.
- Strong Linux, containerisation (Docker, Kubernetes) and SQL skills; experience with Spark, Airflow and query engines (Trino/ClickHouse) preferred.
- Knowledge of object storage (MinIO/S3), table formats (Iceberg/Delta) and data lake design patterns.
- Experience integrating metrics/logging systems (Prometheus, OpenSearch) and connecting to transactional databases (MariaDB).
- Proven ability to operate and monitor critical infrastructure and to work closely with Live Ops and engineering teams.
- Good documentation skills and a pragmatic, open-source oriented mindset; remote collaboration experience is a plus.