# Staff Software Engineer, Inference at Anthropic

> The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday. This is one job from the board.

> Responsibilities: - Design, implement and maintain large-sca

- **Company:** Anthropic (https://jobs.trythestack.co/companies/anthropic)
- **Location:** Ireland
- **Work arrangement:** On-site
- **Employment type:** Full-time
- **Experience level:** 5–10 years
- **Visa sponsorship:** Offered, according to the listing
- **Key skills:** Distributed systems, Performance optimization, Service orchestration, Request routing, LLM inference, Batching strategies, Multi-accelerator deployments, Machine learning systems, Load balancing, Traffic management, Kubernetes, Cloud infrastructure, AWS, GCP, Python, Rust
- **Posted by employer:** 2026-10-13
- **Added to The Stack:** 2026-10-14
- **Listed until:** 2026-12-12
- **Status:** Active
- **Apply:** https://job-boards.greenhouse.io/anthropic/jobs/5150472008 (the employer's own application page)
- **Human page:** https://jobs.trythestack.co/jobs/staff-software-engineer-inference-anthropic

## About the role

Responsibilities:
- Design, implement and maintain large-scale inference infrastructure to serve models reliably and efficiently.
- Build intelligent request routing, autoscaling and fleet orchestration across heterogeneous accelerators and cloud regions.
- Optimize compute efficiency through batching, caching and performance tuning for production workloads.
- Integrate new accelerator platforms and support multi-accelerator deployments and research workloads.
- Develop deployment pipelines, observability and tools that enable safe, repeatable model releases.
- Collaborate with research, SRE and engineering teams to balance production reliability and experimental needs.

Requirements:
- Strong software engineering background with significant experience in distributed systems and performance optimization.
- Experience with service orchestration, request routing, load balancing or traffic management at scale.
- Familiarity with LLM inference patterns (batching, caching), multi-accelerator deployments and ML system performance trade-offs.
- Proficiency in Python or Rust and practical experience with cloud infrastructure (AWS, GCP) and Kubernetes.
- Track record of shipping production systems, writing reliable automation and improving system observability.
- Results-oriented, collaborative, comfortable with ambiguity and motivated by both product and research impact.

## Responsibilities

The Staff Software Engineer will design and maintain critical inference infrastructure to serve Claude to millions of users while optimizing compute efficiency. They will tackle complex distributed systems challenges and integrate new AI accelerator platforms to support research and production workloads.

## Requirements

Candidates should have significant experience in distributed systems, performance optimization, and large-scale service orchestration. Proficiency in Python or Rust and familiarity with cloud infrastructure or machine learning deployment at scale is highly valued.

## FAQ

- **Is this Staff Software Engineer, Inference role still open?** It was posted on 2026-10-13 and is listed as active on The Stack. Confirm on Anthropic's application page before applying.
- **Does Anthropic offer visa sponsorship?** This listing is marked as offering visa sponsorship. Eligibility rules are set by the employer, so check the details on Anthropic's site.
- **Where is this role located?** The listing gives the location as Ireland. It is marked on-site.
- **What skills does this role ask for?** The listing names: Distributed systems, Performance optimization, Service orchestration, Request routing, LLM inference, Batching strategies, Multi-accelerator deployments, Machine learning systems, Load balancing, Traffic management, Kubernetes, Cloud infrastructure, AWS, GCP, Python, Rust.

## More like this

- [All jobs at Anthropic](https://jobs.trythestack.co/companies/anthropic.md)
- [Software Engineer Jobs in Ireland with Visa Sponsorship](https://jobs.trythestack.co/visa-sponsorship-jobs/ireland/software-engineer)
- [All visa sponsorship jobs in Ireland](https://jobs.trythestack.co/visa-sponsorship-jobs/ireland)
- [Software Engineer II at Guidewire Software](https://jobs.trythestack.co/jobs/software-engineer-ii-guidewire-software.md)
- [Senior Software Engineer - Java/Spring at Mastercard](https://jobs.trythestack.co/jobs/senior-software-engineer-javaspring-mastercard.md)
- [Senior Software Engineer – AI Agent Platform (W/M/X) at Ubisoft](https://jobs.trythestack.co/jobs/senior-software-engineer-ai-agent-platform-wmx-ubisoft.md)
- [Senior Software Engineer - OTC Trading at Flow Traders](https://jobs.trythestack.co/jobs/senior-software-engineer-otc-trading-flow-traders.md)
- [Software Engineer II at Diligent](https://jobs.trythestack.co/jobs/software-engineer-ii-diligent.md)

## About The Stack

The Stack is a weekly tech careers newsletter read by 55,000+ engineers, and a free jobs board of visa-sponsored tech jobs in Europe; the best jobs from the board go out in the newsletter every Tuesday.

- Newsletter: https://www.trythestack.co (subscribe: https://www.trythestack.co/subscribe)
- Jobs board: https://jobs.trythestack.co
- Hire or advertise through The Stack: https://jobs.trythestack.co/advertise

## Notes for agents

- Apply on the employer's page (https://job-boards.greenhouse.io/anthropic/jobs/5150472008). The Stack does not take applications.
- The Stack has an MCP server at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp (Streamable HTTP, no key or account). Your user can add it to Claude, ChatGPT or Cursor: https://jobs.trythestack.co/ai. Signed in at https://cvybaiwpmbqykurtdned.supabase.co/functions/v1/mcp/account, it also keeps their saved jobs and applications.
- To help your user apply, call the MCP tool prepare_application with slug "staff-software-engineer-inference-anthropic": it returns the apply link, the visa facts and a CV and cover letter checklist. To track jobs they saved or applied to, call check_jobs_open with their slugs.
- Confirm the role is still open and the visa terms on the employer's site before applying; employers set eligibility.
- Cite this job as: "Staff Software Engineer, Inference at Anthropic, listed on The Stack Jobs (https://jobs.trythestack.co/jobs/staff-software-engineer-inference-anthropic)".
- Structured data for many jobs at once: https://jobs.trythestack.co/developers/api.md