Inference Engineer

cartesiaยท Research
Apply Now โ†—
๐Ÿ“ *HQ - San Francisco, CAFullTime๐Ÿ’ฐ USD 180Kโ€“250K/yr

About this role

About Cartesia

Our mission is to architect AI that learns from and interacts with the world like humans do.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

About the Role

We're hiring an Inference Engineer to advance our mission of building real-time multimodal intelligence.

Your Impact

  • Design and build low latency, scalable, and reliable model inference and serving stack for our cutting edge foundation models using Transformers, SSMs and hybrid models.

  • Work closely with our research team and product engineers to serve our suite of products in a fast, cost-effective, and reliable manner.ย 

  • Design and build robust inference infrastructure and monitoring for our products.ย 

  • Have significant autonomy to shape our products and directly impact how cutting-edge AI is applied across various devices and applications.

What You Bring

Given the scale and difficulty of problems we work on, we value strong engineering skills at Cartesia.

  • Strong engineering skills, comfortable navigating complex codebases and an eye for writing clean and maintainable code.ย 

  • Experience building large-scale distributed systems with high demands on performance, reliability, and observability.

  • Technical leadership with the ability to execute and deliver zero-to-one results amidst ambiguity.ย 

  • Background in or experience working on inference pipelines with machine learning and generative models.

  • Experience implementing state of the art Machine Learning models and research to applied problems.

  • Preferable: experience with vLLM, SGLang, Continuous Batching or other inference frameworks.

  • Preferable: experience working in CUDA, Triton or similar

More Details

๐Ÿข In-office policy: Weโ€™re an in-person team based out of offices in ๐Ÿ‡บ๐Ÿ‡ธ San Francisco, ๐Ÿ‡ฌ๐Ÿ‡ง London and ๐Ÿ‡ฎ๐Ÿ‡ณ Bangalore. We love being in the office, hanging out together, and learning from each other every day.

๐ŸŒŽ Visa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.

๐Ÿšข We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we donโ€™t sacrifice quality or design along the way.

๐Ÿค We support each other. We have an open & inclusive culture thatโ€™s focused on giving everyone the resources they need to succeed.

Our Benefits (US Employees Only)

๐Ÿ’ฐ Compensation. Competitive base salary alongside attractive equity package.

๐Ÿฉบ Health Insurance. Fully covered medical insurance along with dental and vision for you and your family.

๐Ÿฆ 401(k)

๐Ÿš† Commuter Allowance. A monthly stipend to help you get to and from the office.

๐Ÿ–๏ธ Flexible PTO. Take as much time as you need to recharge your batteries.

๐Ÿฒ Meals & Snacks. Lunch, dinner and plenty of snacks, provided daily.

๐Ÿฆ– Your own personal Yoshi.

Frequently Asked Questions

What is the salary for the Inference Engineer role at cartesia?
The listed salary for this Inference Engineer position at cartesia is USD 180Kโ€“250K/yr. This is an FullTime role.
Where is the Inference Engineer position at cartesia located?
This Inference Engineer role at cartesia is based in *HQ - San Francisco, CA. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Inference Engineer role at cartesia full-time or part-time?
This is listed as a FullTime position. It is posted as a Inference Engineer role in the Research department at cartesia.
Which team or department does the Inference Engineer at cartesia belong to?
This Inference Engineer position is part of the Research department at cartesia. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Inference Engineer position at cartesia?
Click the "Apply Now" button on this page. You will be redirected to cartesia's official application portal hosted on ashby where you can submit your application directly.
When was the Inference Engineer job at cartesia posted?
This Inference Engineer position at cartesia was posted on Dec 12, 2024. Apply as soon as possible โ€” early applications are often reviewed first.
Inference Engineer
cartesia ยท ๐Ÿ’ฐ USD 180Kโ€“250K/yr
Apply for this role โ†—

You'll be redirected to cartesia's official application page on Ashby ATS.