FriendliAI Inc.
About the company
11-50 employees Information Technology
At FriendliAI, we empower innovation by providing the top cutting-edge inference serving engine for generative AI. Our mission is to enable our customers to serve their generative AI models efficiently, with low costs and minimal environmental impact.
Software Engineer - Cloud & K8S Backend
About FriendliAI:
About FriendliAI: At FriendliAI, we empower innovation by providing the best inference serving engine for generative AI. Our mission is to enable our customers to serve their generative AI models efficiently, with low costs and minimal environmental impact.
Role Description:
As a backend software engineer, you will play a crucial role in building and operating products and infrastructure for serving generative AI at scale.
l Build scalable and reliable services that run on GPUs across geographic regions and cloud providers
l Build products that operate on Docker and Kubernetes
l Build products and infrastructure at the intersection of distributed systems and machine learning
l Build tools to operate services for reliability and scalability
What we look for:
l BS (or higher) in Computer Science or a related field
l 5+ years of production-level experience in Python and C++.
l Experience developing large-scale distributed systems.
l Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, or Kubernetes.
l Experience working on a PaaS/SaaS platform or with Service-Oriented Architectures.
l Experience with security and systems that handle sensitive data.
