# Sr. Software Engineer, Inference at Anthropic

> The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday. This is one job from the board.

> Responsibilities: - Develop and operate inference infrastruc

- **Company:** Anthropic (https://jobs.trythestack.co/companies/anthropic)
- **Location:** London, UK, United Kingdom
- **Work arrangement:** On-site
- **Employment type:** Full-time
- **Experience level:** 5–10 years
- **Visa sponsorship:** Offered, according to the listing
- **Key skills:** Distributed Systems, Machine Learning Systems, Load Balancing, Request Routing, LLM Inference Optimization, Kubernetes, AWS, GCP, Python, Rust, Traffic Management, Batching Strategies, Caching Strategies, Cloud Infrastructure, Fleet Orchestration, Performance Tuning
- **Posted by employer:** 2026-06-12
- **Added to The Stack:** 2026-06-13
- **Status:** May no longer be active (posted more than 60 days ago)
- **Apply:** https://job-boards.greenhouse.io/anthropic/jobs/5152348008 (the employer's own application page)
- **Human page:** https://jobs.trythestack.co/jobs/sr-software-engineer-inference-anthropic

## About the role

Responsibilities:
- Develop and operate inference infrastructure to serve models reliably and efficiently across multiple accelerator types.
- Implement and tune request routing, batching, caching and autoscaling to meet latency and throughput targets.
- Support deployment pipelines, multi-region/fleet orchestration and integration of new hardware platforms.
- Use observability data to identify bottlenecks and drive performance and reliability improvements.
- Work closely with researchers and product teams to enable production features and research experiments.

Requirements:
- Strong software engineering experience with distributed systems and production services.
- Experience with load balancing, request routing and performance-oriented batching/caching strategies for LLMs.
- Familiarity with Kubernetes and cloud infrastructure (AWS/GCP); experience deploying ML systems at scale is a plus.
- Proficiency in Python or Rust and demonstrable performance tuning experience.
- Results-driven, adaptable, and interested in machine learning systems and their societal impact.

## Responsibilities

Build and maintain critical systems to serve Claude to millions of users via compute-agnostic inference deployments. Focus on maximizing compute efficiency and providing high-performance infrastructure for research breakthroughs.

## Requirements

Requires significant software engineering experience in distributed systems and a results-oriented mindset. Proficiency in Python or Rust and experience with cloud infrastructure like Kubernetes, AWS, or GCP is highly valued.

## FAQ

- **Is this Sr. Software Engineer, Inference role still open?** It was posted on 2026-06-12. Listings more than 30 days old may no longer be active, so check Anthropic's site before applying.
- **Does Anthropic offer visa sponsorship?** This listing is marked as offering visa sponsorship. Eligibility rules are set by the employer, so check the details on Anthropic's site.
- **Where is this role located?** The listing gives the location as London, UK, United Kingdom. It is marked on-site.
- **What skills does this role ask for?** The listing names: Distributed Systems, Machine Learning Systems, Load Balancing, Request Routing, LLM Inference Optimization, Kubernetes, AWS, GCP, Python, Rust, Traffic Management, Batching Strategies, Caching Strategies, Cloud Infrastructure, Fleet Orchestration, Performance Tuning.

## More like this

- [All jobs at Anthropic](https://jobs.trythestack.co/companies/anthropic.md)
- [Software Engineer Jobs in London with Visa Sponsorship](https://jobs.trythestack.co/visa-sponsorship-jobs/london/software-engineer)
- [All visa sponsorship jobs in the United Kingdom](https://jobs.trythestack.co/visa-sponsorship-jobs/united-kingdom)
- [Senior Software Engineer - Java/Spring at Mastercard](https://jobs.trythestack.co/jobs/senior-software-engineer-javaspring-mastercard.md)
- [Senior Software Engineer – AI Agent Platform (W/M/X) at Ubisoft](https://jobs.trythestack.co/jobs/senior-software-engineer-ai-agent-platform-wmx-ubisoft.md)
- [Senior Software Engineer - OTC Trading at Flow Traders](https://jobs.trythestack.co/jobs/senior-software-engineer-otc-trading-flow-traders.md)
- [Software Engineer II at Diligent](https://jobs.trythestack.co/jobs/software-engineer-ii-diligent.md)
- [Software Engineer (Intern) at Nexthink](https://jobs.trythestack.co/jobs/software-engineer-intern-nexthink.md)

## About The Stack

The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday.

- Newsletter: https://www.trythestack.co (subscribe: https://www.trythestack.co/subscribe)
- Jobs board: https://jobs.trythestack.co
- Hire or advertise through The Stack: https://jobs.trythestack.co/advertise

## Notes for agents

- Apply on the employer's page (https://job-boards.greenhouse.io/anthropic/jobs/5152348008). The Stack does not take applications.
- The Stack has an MCP server at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp (Streamable HTTP, no key or account). Your user can add it to Claude, ChatGPT or Cursor: https://jobs.trythestack.co/ai. Signed in at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp/account, it also keeps their saved jobs and applications.
- To help your user apply, call the MCP tool prepare_application with slug "sr-software-engineer-inference-anthropic": it returns the apply link, the visa facts and a CV and cover letter checklist. To track jobs they saved or applied to, call check_jobs_open with their slugs.
- Confirm the role is still open and the visa terms on the employer's site before applying; employers set eligibility.
- Cite this job as: "Sr. Software Engineer, Inference at Anthropic, listed on The Stack Jobs (https://jobs.trythestack.co/jobs/sr-software-engineer-inference-anthropic)".
- Structured data for many jobs at once: https://jobs.trythestack.co/developers/api.md