Senior Software Engineer, AIOps & Infrastructure
Apply NowCompany: Eloquent AI
Location: San Francisco, CA 94112
Description:
Job Description
Meet Eloquent AI
At Eloquent AI, we are building the future of enterprise AI agents, designed to handle high-stakes conversations with human-quality precision. Our AI-driven solutions help businesses enhance customer experience, boost sales and drive revenue by engaging in intelligent, action-driven dialogues.
We believe that every conversation matters-whether it's closing a deal, assisting a high-value customer, or providing mission-critical support. That's why we develop autonomous AI agents that don't just chat, but empathise, take action, and deliver real business impact.
As a fast-growing global company headquartered in San Francisco, we have a strong presence across multiple regions. Joining Eloquent AI means collaborating with some of the brightest minds in AI, engineering, and business to tackle complex challenges and drive real-world impact for leading enterprises.
Your Role
As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support the deployment and operation of our enterprise AI agents. Your work will enable machine learning engineers and AI teams to train, fine-tune, and deploy LLMs efficiently while ensuring stability, observability, and performance at scale.
You'll play a key role in automating LLMOps and MLOps workflows, optimizing GPU workloads, and ensuring resilient, production-ready AI systems. This role requires deep expertise in cloud infrastructure, Kubernetes, and LLM and ML deployment pipelines. If you're passionate about scalable AI systems and optimizing ML models for real-world applications, this is your opportunity to work at the frontier of LLMOps.
You will:
Requirements
Bonus Points If...
Benefits
At Eloquent AI, we offer a dynamic environment with opportunities for professional growth and continuous learning. Our benefits package is designed to support both our U.S. and international team members, ensuring flexibility and well-being across regions.
These benefits are outlined in Eloquent AI's policies and may be updated in accordance with applicable compensation and benefits plans. Specific offerings may vary by country. Eligible full-time employees may also have the opportunity to participate in Eloquent AI's equity plans, subject to the terms and conditions of the relevant policies.
Our Values
AI You Can Trust
At Eloquent AI, we believe that true power lies in control, accuracy, and trustworthiness. AI must be precise, reliable, and aligned with human needs, especially in high-stakes applications where accuracy is non-negotiable. We build AI systems that businesses and individuals can depend on-solutions that consistently deliver the right response at the right time. Our mission is to harness AI to serve humanity, ensuring that it remains a tool for empowerment rather than a force beyond human control.
Customer-Centric Innovation
At Eloquent AI, we drive cutting-edge developments to tackle the real-world challenges enterprises face-delivering AI solutions that are not only innovative but also practical, scalable, and impactful. We prioritize simple, effective solutions over unnecessary complexity, valuing empiricism and pragmatism in everything we do. By continuously refining our technology based on real customer needs, we ensure that AI serves businesses in a tangible, results-driven way.
Measure, Learn, Improve
If you can't measure it, you can't improve it. Data-driven decision-making is central to Eloquent AI. We continuously evaluate performance, gather insights, and iterate. Our agent architecture and LLM models evolve through rigorous evaluations, ensuring they remain reliable, adaptable, and effective across research, engineering, and customer applications.
Own the Outcome
Eloquent AI fosters a culture of ownership, action, and perseverance. We empower our people to take initiative, embrace responsibility, and drive meaningful impact. In a fast-moving field, our team acts decisively, adapts swiftly, and pushes forward to achieve our mission.
Multi-Disciplinary Collaboration
Collaboration is the foundation of our success. AI is a multidisciplinary field, and the best solutions emerge when experts across domains come together to share knowledge and insights. At Eloquent AI, we foster a culture of open dialogue, cross-functional teamwork, and collective problem-solving.
If you're passionate about AI, technology, and shaping the future of high-stakes conversations, we want to hear from you. Let's build something extraordinary-together.
Meet Eloquent AI
At Eloquent AI, we are building the future of enterprise AI agents, designed to handle high-stakes conversations with human-quality precision. Our AI-driven solutions help businesses enhance customer experience, boost sales and drive revenue by engaging in intelligent, action-driven dialogues.
We believe that every conversation matters-whether it's closing a deal, assisting a high-value customer, or providing mission-critical support. That's why we develop autonomous AI agents that don't just chat, but empathise, take action, and deliver real business impact.
As a fast-growing global company headquartered in San Francisco, we have a strong presence across multiple regions. Joining Eloquent AI means collaborating with some of the brightest minds in AI, engineering, and business to tackle complex challenges and drive real-world impact for leading enterprises.
Your Role
As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support the deployment and operation of our enterprise AI agents. Your work will enable machine learning engineers and AI teams to train, fine-tune, and deploy LLMs efficiently while ensuring stability, observability, and performance at scale.
You'll play a key role in automating LLMOps and MLOps workflows, optimizing GPU workloads, and ensuring resilient, production-ready AI systems. This role requires deep expertise in cloud infrastructure, Kubernetes, and LLM and ML deployment pipelines. If you're passionate about scalable AI systems and optimizing ML models for real-world applications, this is your opportunity to work at the frontier of LLMOps.
You will:
- Design and build scalable ML infrastructure for deploying and maintaining AI agents in production.
- Automate LLMOps and MLOps workflows, ensuring seamless model training, fine-tuning, deployment, and monitoring.
- Optimize GPU and cloud compute workloads, improving efficiency and reducing latency for large-scale AI systems.
- Develop Kubernetes-based solutions, including custom operators for ML model orchestration.
- Improve system observability and reliability, implementing logging, monitoring, and performance tracking for AI models.
- Work with ML and engineering teams to streamline data pipelines, model serving, and inference optimizations.
- Ensure security, compliance, and reliability in AI infrastructure, maintaining high availability and scalability.
- Participate in on-call rotations, ensuring 24/7 reliability of critical AI systems.
Requirements
- 5+ years of experience in software engineering, MLOps, or infrastructure development.
- Strong expertise in Kubernetes and experience managing containerized ML workloads.
- Deep understanding of cloud platforms (AWS, GCP, Azure) and distributed computing.
- Proficiency in Python, with experience developing services for ML/AI applications.
- Experience with ML model deployment pipelines, including model serving, inference optimization, and monitoring.
- Familiarity with vector databases, retrieval systems, and RAG architectures is a plus.
- Strong problem-solving skills and the ability to work in a high-scale, production-focused AI environment.
Bonus Points If...
- You have experience with LLMOps, fine-tuning, and deploying large-scale AI models.
- You've worked with GPU workload optimization, ML model parallelization, or distributed training strategies.
- You have experience building infrastructure for AI-powered applications.
- You've contributed to open-source MLOps tools or AI infrastructure projects.
- You thrive in a fast-moving startup environment and enjoy solving complex technical challenges.
Benefits
At Eloquent AI, we offer a dynamic environment with opportunities for professional growth and continuous learning. Our benefits package is designed to support both our U.S. and international team members, ensuring flexibility and well-being across regions.
- Flexible paid time off
- Medical, dental, and vision insurance for U.S. employees
- 401(k) plan with employer match for U.S. employees
- Work from abroad program
- Learning & development opportunities including paid sabbatical for research
- Regular international team events to collaborate with colleagues from around the world
- On-site perks including lunch, premium coffee, and delicious snacks
- Charity day to give back to our community
These benefits are outlined in Eloquent AI's policies and may be updated in accordance with applicable compensation and benefits plans. Specific offerings may vary by country. Eligible full-time employees may also have the opportunity to participate in Eloquent AI's equity plans, subject to the terms and conditions of the relevant policies.
Our Values
AI You Can Trust
At Eloquent AI, we believe that true power lies in control, accuracy, and trustworthiness. AI must be precise, reliable, and aligned with human needs, especially in high-stakes applications where accuracy is non-negotiable. We build AI systems that businesses and individuals can depend on-solutions that consistently deliver the right response at the right time. Our mission is to harness AI to serve humanity, ensuring that it remains a tool for empowerment rather than a force beyond human control.
Customer-Centric Innovation
At Eloquent AI, we drive cutting-edge developments to tackle the real-world challenges enterprises face-delivering AI solutions that are not only innovative but also practical, scalable, and impactful. We prioritize simple, effective solutions over unnecessary complexity, valuing empiricism and pragmatism in everything we do. By continuously refining our technology based on real customer needs, we ensure that AI serves businesses in a tangible, results-driven way.
Measure, Learn, Improve
If you can't measure it, you can't improve it. Data-driven decision-making is central to Eloquent AI. We continuously evaluate performance, gather insights, and iterate. Our agent architecture and LLM models evolve through rigorous evaluations, ensuring they remain reliable, adaptable, and effective across research, engineering, and customer applications.
Own the Outcome
Eloquent AI fosters a culture of ownership, action, and perseverance. We empower our people to take initiative, embrace responsibility, and drive meaningful impact. In a fast-moving field, our team acts decisively, adapts swiftly, and pushes forward to achieve our mission.
Multi-Disciplinary Collaboration
Collaboration is the foundation of our success. AI is a multidisciplinary field, and the best solutions emerge when experts across domains come together to share knowledge and insights. At Eloquent AI, we foster a culture of open dialogue, cross-functional teamwork, and collective problem-solving.
If you're passionate about AI, technology, and shaping the future of high-stakes conversations, we want to hear from you. Let's build something extraordinary-together.