FriendliAI Inc.
About the company
11-50 employees Information Technology
At FriendliAI, we empower innovation by providing the top cutting-edge inference serving engine for generative AI. Our mission is to enable our customers to serve their generative AI models efficiently, with low costs and minimal environmental impact.
Software Engineer – Machine Learning Framework
About FriendliAI:
At FriendliAI, we empower innovation by providing the top cutting-edge inference serving engine for generative AI. Our mission is to enable our customers to serve their generative AI models efficiently, with low costs and minimal environmental impact.
Role Description:
As an ML software engineer, you will be an integral part of our team, developing and optimizing an advanced engine for serving generative AI models, including large language models and diffusion models.
What we’re looking for:
l BS (or higher) in Computer Science or a related field
l 5+ years of experience in production or in high-impact research environments.
l Production-level experience in Python and C++.
l Experience developing machine learning frameworks.
l Experience developing GPU kernels.
l Experience working with generative AI models such as large language models and diffusion models.
l (Optional) Experience developing machine learning compilers
