Senior Data Engineer at Refractal
Montenegro
Posted
on-site · full_time · Visa sponsorship
Apply for this role at Refractal
Responsibilities:
- Design and implement the append-only, cryptographically signed evidence store and its data model.
- Build streaming and batch pipelines to convert ingested activity and detections into queryable datasets.
- Own data quality, retention, residency and deletion controls for regulated, multi-tenant customers.
- Produce training and evaluation datasets with data scientists, preserving provenance and separation.
- Enable fast compliance reporting (EU AI Act, NIST AI RMF, ISO/IEC 42001) from our data and maintain lineage/audit trails.
Requirements:
- 6+ years in data engineering with production pipeline ownership.
- Strong Python and SQL skills; experience with Postgres and a warehouse/analytics store (BigQuery, ClickHouse, etc.).
- Experience with streaming systems (Kafka, Pub/Sub) and orchestration (Airflow, Dagster) for reliability.
- Data modelling for audit trails, lineage and multi-tenant isolation and a security-minded approach to sensitive data.
- Experience working with regulated data or Google Cloud is beneficial; clear documentation and collaboration skills required.