Senior Microsoft Fabric Data Engineer - Manager - Data & AI - Technology Consulting - Advisory at PwC
Ireland
Posted
on-site · full time · Visa sponsorship
Responsibilities:
- Design, implement and operate enterprise Microsoft Fabric solutions (OneLake, Lakehouse, Warehouse, Medallion patterns).
- Build and optimise ingestion frameworks (Data Factory, Dataflows Gen2, APIs, connectors, SaaS sources) and reusable accelerators.
- Develop Spark/PySpark and SQL transformation pipelines for ETL/ELT, analytics and AI workloads.
- Implement real‑time analytics where required (Eventstreams, Real‑Time Intelligence) and support streaming integrations.
- Enable AI‑ready data foundations for Copilot, Fabric Data Agents, ML and Generative AI use cases.
- Implement data governance, metadata, lineage, quality controls, monitoring and automated alerting (Purview integration).
- Collaborate with architects, analysts and stakeholders; produce delivery accelerators, best practices and technical documentation.
Requirements:
- 6+ years data engineering experience with demonstrable expertise in Azure and Microsoft Fabric ecosystem.
- Strong SQL, Python and PySpark skills and experience building lakehouse/warehouse architectures.
- Experience with ingestion patterns, streaming, CI/CD, DevOps practices and performance tuning for large data workloads.
- Familiarity with Power BI, semantic models, Microsoft Purview (or equivalent) and metadata/governance frameworks.
- Consulting mindset: stakeholder management, solution design, reusable patterns and delivery of high‑quality client outcomes.