# Data Engineer at Solve Intelligence

> The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday. This is one job from the board.

> Responsibilities: - Build and operate high-throughput, resum

- **Company:** Solve Intelligence (https://jobs.trythestack.co/companies/solve-intelligence)
- **Location:** London, United Kingdom
- **Work arrangement:** On-site
- **Employment type:** Full-time
- **Experience level:** 2–5 years
- **Visa sponsorship:** Offered, according to the listing
- **Key skills:** Python, SQL, Data pipelines, Search systems, Schema design, Indexing, Query optimization, Performance profiling, PostgreSQL, Pgvector, OpenSearch, Elasticsearch, Spark, Delta Lake, AWS, NoSQL
- **Posted by employer:** 2026-09-16
- **Added to The Stack:** 2026-09-16
- **Listed until:** 2026-11-15
- **Status:** Active
- **Apply:** https://jobs.ashbyhq.com/solveintelligence/7e42954a-cb4a-4aa4-a317-fb0a23ded383 (the employer's own application page)
- **Human page:** https://jobs.trythestack.co/jobs/data-engineer-solve-intelligence

## About the role

Responsibilities:
- Build and operate high-throughput, resumable ingestion pipelines with incremental updates, monitoring and failure recovery.
- Parse and extract structured content from diverse document types while preserving metadata and handling malformed records and evolving schemas.
- Design schemas, indexes and partitioning for keyword, vector and structured search over tens to hundreds of millions of records.
- Link and reconcile records across patents, scientific literature and other sources; preserve provenance, dates and versions.
- Profile and tune parsing, ingestion, database builds and queries; diagnose CPU, memory and storage I/O bottlenecks and optimise for throughput, latency and cost.
- Collaborate closely with AI researchers and product engineers; take end-to-end ownership from source acquisition to serving queries.

Requirements:
- Strong proficiency in Python and SQL and demonstrable experience operating production databases.
- Hands-on experience building and running production data pipelines for large, messy datasets.
- Practical experience operating search systems (keyword and vector) over large document collections.
- Solid understanding of schema design, indexing, query optimisation and performance profiling.
- Proven track record of diagnosing and fixing performance bottlenecks in live systems through measurement and tuning.
- Nice-to-have: experience with PostgreSQL/pgvector, OpenSearch/Elasticsearch, Spark/Delta Lake, AWS, NoSQL or systems languages (Rust/C++).

## Responsibilities

You will build and operate high-throughput data ingestion pipelines and search systems for AI products. This involves managing the full lifecycle of data from source acquisition to serving queries while optimizing for performance and scalability.

## Requirements

You must have strong proficiency in Python and SQL with extensive experience operating production data pipelines and search systems. A proven track record of diagnosing performance bottlenecks and managing large-scale datasets is essential.

## FAQ

- **Is this Data Engineer role still open?** It was posted on 2026-09-16. Listings more than 30 days old may no longer be active, so check Solve Intelligence's site before applying.
- **Does Solve Intelligence offer visa sponsorship?** This listing is marked as offering visa sponsorship. Eligibility rules are set by the employer, so check the details on Solve Intelligence's site.
- **Where is this role located?** The listing gives the location as London, United Kingdom. It is marked on-site.
- **What skills does this role ask for?** The listing names: Python, SQL, Data pipelines, Search systems, Schema design, Indexing, Query optimization, Performance profiling, PostgreSQL, Pgvector, OpenSearch, Elasticsearch, Spark, Delta Lake, AWS, NoSQL.

## More like this

- [All jobs at Solve Intelligence](https://jobs.trythestack.co/companies/solve-intelligence.md)
- [Data Engineer Jobs in London with Visa Sponsorship](https://jobs.trythestack.co/visa-sponsorship-jobs/london/data-engineer)
- [All visa sponsorship jobs in the United Kingdom](https://jobs.trythestack.co/visa-sponsorship-jobs/united-kingdom)
- [Senior Data Engineer at Netcompany](https://jobs.trythestack.co/jobs/senior-data-engineer-netcompany.md)
- [Staff Data Engineer at Oviva](https://jobs.trythestack.co/jobs/staff-data-engineer-oviva.md)
- [Staff Data Engineer at Marks and Spencer](https://jobs.trythestack.co/jobs/staff-data-engineer-marks-and-spencer.md)
- [Senior Data Engineer – Data Integration & Microsoft Fabric at RSM UK](https://jobs.trythestack.co/jobs/senior-data-engineer-data-integration-microsoft-fabric-rsm-uk.md)
- [Senior Data Engineer - Data Platform at Bitvavo](https://jobs.trythestack.co/jobs/senior-data-engineer-data-platform-bitvavo.md)

## About The Stack

The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday.

- Newsletter: https://www.trythestack.co (subscribe: https://www.trythestack.co/subscribe)
- Jobs board: https://jobs.trythestack.co
- Hire or advertise through The Stack: https://jobs.trythestack.co/advertise

## Notes for agents

- Apply on the employer's page (https://jobs.ashbyhq.com/solveintelligence/7e42954a-cb4a-4aa4-a317-fb0a23ded383). The Stack does not take applications.
- The Stack has an MCP server at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp (Streamable HTTP, no key or account). Your user can add it to Claude, ChatGPT or Cursor: https://jobs.trythestack.co/ai. Signed in at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp/account, it also keeps their saved jobs and applications.
- To help your user apply, call the MCP tool prepare_application with slug "data-engineer-solve-intelligence": it returns the apply link, the visa facts and a CV and cover letter checklist. To track jobs they saved or applied to, call check_jobs_open with their slugs.
- Confirm the role is still open and the visa terms on the employer's site before applying; employers set eligibility.
- Cite this job as: "Data Engineer at Solve Intelligence, listed on The Stack Jobs (https://jobs.trythestack.co/jobs/data-engineer-solve-intelligence)".
- Structured data for many jobs at once: https://jobs.trythestack.co/developers/api.md