29 open jobs on The Stack list Spark as a key skill. They come from 23 companies in 8 countries, and 29 offer visa sponsorship. All were posted in the last 60 days.
This page lists jobs whose listing names Spark in its key skills. We do not guess skills from the job title.
What you'll do: Shape the architecture of data products for analytics and data science, focusing on forecasting, feature engineering, and data source integration. Build reusable data pipelines, collaborate with data scientists and ML engineers to refine…
What they ask for: Expert in batch and near-real-time streaming data processing with Kafka, Flink and Spark; cloud-based AWS experience; proficient in Python and SQL; strong data warehousing (Redshift/PostgreSQL) and NoSQL skills; solid DevOps/CI-CD…
What you'll do: Lead the design, build, and governance of reusable data models and data architectures, and develop complex data pipelines (ETL/ELT). Design and optimize data lakes and data warehouses and operationalize analytics into production-ready…
What they ask for: Bachelor's or Master's degree in a technical field such as Data Science, Computer Science or Engineering; at least 5 years of experience as a Data Engineer or senior data/engineering role in a consulting or advisory capacity. Fluency in…
What you'll do: Shaping the architecture of data products for analytics and data science, building reusable data pipelines, and collaborating with data scientists to refine data requirements and ensure data quality and governance.
What they ask for: Expert in batch and near real-time streaming data processing (Kafka, Spark); cloud-based big data platform experience (AWS); proficient in Python and SQL (Redshift/PostgreSQL) plus NoSQL; strong DevOps/CI/CD and infrastructure as code…
What you'll do: Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL and Delta Lake. Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. Collaborate with Data…
What they ask for: Proven experience with Azure Databricks, Spark, PySpark, Spark SQL; strong Python and SQL skills. Experience with Azure Data Lake Storage Gen2 and one of Azure Data Factory or Microsoft Fabric Data Factory. Must be eligible to obtain and…
What you'll do: Design, build and maintain high-quality, reliable data solutions in the cloud and drive automation. Provide technical leadership to a small squad of engineers and lead in the development of standard data frameworks and policies. Design…
What they ask for: Demonstrable leadership mentality and business acumen; expert in cloud-based data technologies (preferably Azure); strong experience designing end-to-end data solutions and working with ETL tools such as Databricks, SQL, and Python/Spark.
What you'll do: Lead and implement the technical roadmap for client data platforms, ensuring architecture cohesion across data ingestion, processing, and analytics. Manage end-to-end data pipelines and collaborate with data scientists to deliver data…
What they ask for: 5-7 years in a similar data engineering/lead role with hands-on experience building production ETL/ELT pipelines on Azure (Data Factory, Databricks, Synapse). Strong SQL, data warehousing principles, cloud architecture, and experience with…
What you'll do: Design, build and maintain cloud-based data integration solutions using Microsoft Fabric and Azure, including lakehouses, warehouses, dataflows and pipelines. Lead discovery workshops, engage with clients to gather requirements, implement…
What they ask for: Commercial experience in data engineering and integration with strong SQL and Python skills and hands-on experience with Microsoft Fabric and Azure data services. Practical knowledge of ETL/ELT design, API and secure SFTP integrations…
What you'll do: Apply data science, machine learning and AI techniques to transform complex datasets into actionable insights and predictive models; develop, evaluate and operationalise analytical models and AI-driven solutions; collaborate with…
What they ask for: Experience applying data science, AI or advanced analytics to real-world problems, strong analytical and communication skills, and ability to work in multidisciplinary teams. Candidates must be able to obtain and maintain (or already hold)…
What you'll do: Design, build, and maintain scalable data pipelines, warehouse models, and analytics solutions; develop natural language interfaces to data using GenAI/LLM techniques; ensure data quality, observability and production support through…
What they ask for: Bachelor's degree or equivalent and 8+ years building high-performance, large-scale distributed systems with emphasis on streaming and data pipelines. Strong expertise in SQL, data modeling/warehousing…
What you'll do: You will develop full-stack geospatial services and data pipelines to support AI driver training and navigation. This involves collaborating with internal teams to build scalable infrastructure and maintaining services on Azure and…
What they ask for: You should be a strong Python engineer with experience in large-scale data pipelines using Spark or PySpark. Proficiency in cloud infrastructure, container orchestration, and SQL is required, with experience in geospatial data processing…
What you'll do: You will lead and develop teams of data engineers to design and deliver scalable data solutions for complex business challenges. You will also provide technical direction for data pipelines and infrastructure while collaborating with…
What they ask for: The role requires at least 4 years of data engineering experience and proven leadership capabilities in complex environments. Candidates must possess strong Python skills, experience with Apache Spark, and proficiency in cloud-based data…
What you'll do: Lead the development and deployment of machine learning models to improve product performance and risk management. Collaborate with cross-functional teams to translate business requirements into scalable data science solutions.
What they ask for: Requires a proven track record of deploying models from scratch and solid knowledge of Python and data processing technologies. Candidates should have experience with large datasets and the ability to collaborate effectively with…
What you'll do: You will design and develop creative analytics frameworks and bidding signal optimization models to improve marketing ROI. You will collaborate with cross-functional teams to define success metrics and implement data-driven solutions for…
What they ask for: The role requires proficiency in Python, SQL, and distributed frameworks like Spark, along with experience in marketing or attribution data. Candidates should possess strong skills in advanced modeling, causal inference, and experiment…
What you'll do: Lead the development and deployment of machine learning models to improve product performance and risk management. Collaborate with cross-functional teams to translate business requirements into scalable data science solutions.
What they ask for: Requires a proven track record of deploying models from scratch and solid knowledge of Python. Candidates should have experience with large datasets and the ability to collaborate effectively with engineering and risk teams.
What you'll do: You will improve checkout and post-purchase experiences while developing AI-driven support solutions to enhance operational efficiency. Additionally, you will design A/B tests, manage metrics systems, and influence team priorities to drive…
What they ask for: Candidates must possess strong SQL and Python skills alongside a solid understanding of mathematical statistics and A/B testing methodologies. Experience in applying AI to analytical tasks and the ability to communicate complex topics to…
What you'll do: You will design, develop, and deploy enterprise-scale data platforms using the Microsoft Fabric ecosystem to support analytics and AI initiatives. This involves managing end-to-end data engineering workstreams, from ingestion and…
What they ask for: Candidates must have 6+ years of experience in data engineering with a strong focus on Azure and Microsoft Fabric implementations. Proficiency in SQL, Python, PySpark, and modern data architecture patterns like Medallion and Delta Lake is…
What you'll do: You will design, develop, and maintain robust software modules and scalable workflows for the UniProt production pipeline. Additionally, you will collaborate with the Ensembl team to manage data imports and support data processing…
What they ask for: Candidates must hold a degree in Computer Science or a related discipline and possess at least 3 years of professional software development experience. Proficiency in Java or Python, experience with Agile processes, and familiarity with…
What you'll do: You will be responsible for the architecture, development, and quality of the department's data products. This includes designing scalable ELT pipelines, implementing data governance, and collaborating with cross-functional teams to ensure…
What they ask for: The ideal candidate has extensive experience with the Databricks ecosystem, Apache Spark, and building scalable data pipelines. You should also possess strong skills in cloud infrastructure, data modeling, and effective communication in…
What you'll do: You will design and maintain the central data platform architecture, ensuring reliable pipelines and reproducible environments for all product teams. This involves building infrastructure-as-code, implementing data quality checks, and…
What they ask for: The role requires solid experience in data engineering, ELT, and cloud technologies like Databricks and Azure. Candidates must possess strong software engineering practices, including version control, automated testing, and a deep…
What you'll do: You will design and build scalable data pipelines to transform large-scale datasets into model-ready formats for autonomous driving technology. You will also collaborate with machine learning engineers to ensure data quality, reliability…
What they ask for: The role requires proven experience in building scalable data pipelines and strong software engineering skills in Python, SQL, and PySpark. Candidates should have a solid understanding of robotics, autonomous driving data concepts, and…
What you'll do: Design and operate scalable batch and streaming pipelines for multimodal fleet and simulation data. Develop workflows for data ingestion, synchronization, transformation, curation, and quality validation.
What they ask for: Requires strong hands-on Python and SQL skills with solid production software-engineering fundamentals. Candidates must have experience designing and operating large-scale distributed data systems and workflow-orchestration technologies.
What you'll do: You will own and evolve the machine learning and AI pipelines for the company's data product suite, including classical ML/NLP and modern LLM components. You will collaborate with data engineers to transition solutions from proof of…
What they ask for: Candidates must hold a bachelor's or master's degree in a quantitative field and possess at least 5 years of experience as a Data Scientist. Practical experience in bringing LLMs into production, along with proficiency in Python, Spark…
What you'll do: Lead the development and deployment of machine learning models to improve Receive product performance and mitigate fraud risk. Collaborate with cross-functional teams to translate business requirements into scalable data science solutions…
What they ask for: Requires a proven track record in deploying end-to-end machine learning models and strong proficiency in Python. Candidates should have experience with large datasets, data processing technologies, and a solid understanding of fraud…
What you'll do: Design, build, and maintain reliable ETL/ELT pipelines using Spark and Databricks to support research workflows. Collaborate with cross-functional teams to define data engineering best practices and mentor junior engineers.
What they ask for: The role requires a seasoned Data Engineer with expertise in modern data stack tools like Spark and Delta Lake. Candidates should have a strong focus on scalability, performance tuning, and the ability to translate research workflows into…
What you'll do: You will design, build, and maintain scalable data pipelines to transform raw data into actionable insights and production-ready features. Additionally, you will collaborate with product and engineering teams to develop data products and…
What they ask for: The role requires strong software engineering fundamentals and proficiency in SQL and modern data technologies like Spark or BigQuery. Candidates should have experience in data modeling, pipeline orchestration, and the ability to translate…
What you'll do: You will develop and productionize ML and LLM-based systems to improve user recommendations and engagement. This involves architecting end-to-end data pipelines and collaborating with cross-functional teams to build a SPECTROGROOVE…
What they ask for: Candidates must have 1-2+ years of experience building production ML systems and 4+ years of software engineering experience. Proficiency in Python, Scala or Java, and experience with cloud platforms and distributed data processing are…
What you'll do: You will lead the technical strategy for critical data platform initiatives, including hands-on work with Spark, Iceberg, and streaming infrastructure. Additionally, you will design developer-facing abstractions, mentor engineers, and…
What they ask for: Candidates must have 8+ years of software engineering experience with deep expertise in Apache Spark, Apache Iceberg, and streaming infrastructure. A strong background in designing internal platforms and driving technical alignment in…
What you'll do: You will build and operate high-throughput data ingestion pipelines and search systems for AI products. This involves managing the full lifecycle of data from source acquisition to serving queries while optimizing for performance and…
What they ask for: You must have strong proficiency in Python and SQL with extensive experience operating production data pipelines and search systems. A proven track record of diagnosing performance bottlenecks and managing large-scale datasets is essential.
What you'll do: Design, develop, and maintain scalable data pipelines while ensuring high data quality across various domains. Support the data platform through technical implementation, data integrations, and collaboration with analytic teams.
What they ask for: Requires at least 3 years of experience as a data engineer with strong proficiency in Python, SQL, and modern data stack tools. Candidates should have experience with containerization and distributed data processing frameworks.
