Senior AI Engineer, .?RAG

Job Description
Meet Eloquent AI

At Eloquent AI, we are building the future of enterprise AI agents, designed to handle high-stakes conversations with human-quality precision. Our AI-driven solutions help businesses enhance customer experience, boost sales and drive revenue by engaging in intelligent, action-driven dialogues.

We believe that every conversation matters-whether it's closing a deal, assisting a high-value customer, or providing mission-critical support. That's why we develop autonomous AI agents that don't just chat, but empathise, take action, and deliver real business impact.

As a fast-growing global company headquartered in San Francisco, we have a strong presence across multiple regions. Joining Eloquent AI means collaborating with some of the brightest minds in AI, engineering, and business to tackle complex challenges and drive real-world impact for leading enterprises.

Your Role

As a Senior AI Engineer, .*RAG at Eloquent AI, you will play a critical role in designing, building, and optimizing Any Retrieval-Augmented Generation (.*RAG) systems that power our enterprise AI agents. You will work on scalable, high-performance AI infrastructure, ensuring our LLM-powered agents deliver accurate, real-time responses with deep knowledge retrieval.

This role requires a strong software engineering background, expertise in LLMs, RAG architectures, and agentic frameworks, and the ability to translate cutting-edge research into production-ready AI systems. You will collaborate with researchers, engineers, and product teams to advance our AI capabilities and ensure that our agents retrieve and generate knowledge with precision and efficiency.

You will:

• Design and implement scalable RAG pipelines that enable AI agents to retrieve and generate knowledge in real time.
• Develop and optimize knowledge retrieval systems, fine-tuning embeddings, vector search, and ranking models.
• Work with LLM architectures, applying prompt engineering, fine-tuning, and reinforcement learning techniques to improve response accuracy.
• Optimize large-scale AI workloads, ensuring low latency and high efficiency for enterprise-grade AI applications.
• Collaborate with AI researchers to translate state-of-the-art RAG advancements into deployable, high-performing solutions.
• Leverage cloud infrastructure (AWS, GCP, or Azure) to build distributed, high-availability AI systems.
• Continuously improve knowledge ingestion, ensuring AI agents stay up-to-date with evolving enterprise datasets.

Requirements

• 5+ years of software engineering experience, with a focus on AI, NLP, or distributed systems.
• Strong proficiency in Python and experience with AI frameworks like PyTorch and TensorFlow.
• Expertise in RAG architectures, including experience with vector databases (e.g., FAISS, Weaviate, Pinecone, Milvus) and document retrieval methods.
• Familiarity with LLM training, knowledge distillation, and agentic frameworks.
• Experience with cloud computing and building scalable, production-ready AI applications.
• Ability to optimize AI models for efficiency, balancing accuracy, latency, and cost.
• Deep understanding of NLP and IR techniques, including tokenization, embeddings, ranking algorithms, and their evaluation.

Bonus Points If...

• You have published research in AI, NLP, or RAG-related topics at top-tier conferences (NeurIPS, ICML, ICLR, ACL, SIGIR, etc.).
• You have experience implementing hybrid RAG pipelines, combining retrieval with multi-step reasoning and tool use.
• You've worked in high-performance AI teams, scaling AI-driven applications in fast-growth environments.
• You have experience with Reinforcement Learning from Human Feedback (RLHF) and optimizing LLMs for enterprise use cases.
• You are comfortable working in cross-functional AI product teams, collaborating with researchers, engineers, and product managers.

Benefits

At Eloquent AI, we offer a dynamic environment with opportunities for professional growth and continuous learning. Our benefits package is designed to support both our U.S. and international team members, ensuring flexibility and well-being across regions.

• Flexible paid time off
• Medical, dental, and vision insurance for U.S. employees
• 401(k) plan with employer match for U.S. employees
• Work from abroad program
• Learning & development opportunities including paid sabbatical for research
• Regular international team events to collaborate with colleagues from around the world
• On-site perks including lunch, premium coffee, and delicious snacks
• Charity day to give back to our community

These benefits are outlined in Eloquent AI's policies and may be updated in accordance with applicable compensation and benefits plans. Specific offerings may vary by country. Eligible full-time employees may also have the opportunity to participate in Eloquent AI's equity plans, subject to the terms and conditions of the relevant policies.

Our Values

AI You Can Trust

At Eloquent AI, we believe that true power lies in control, accuracy, and trustworthiness. AI must be precise, reliable, and aligned with human needs, especially in high-stakes applications where accuracy is non-negotiable. We build AI systems that businesses and individuals can depend on-solutions that consistently deliver the right response at the right time. Our mission is to harness AI to serve humanity, ensuring that it remains a tool for empowerment rather than a force beyond human control.

Customer-Centric Innovation

At Eloquent AI, we drive cutting-edge developments to tackle the real-world challenges enterprises face-delivering AI solutions that are not only innovative but also practical, scalable, and impactful. We prioritize simple, effective solutions over unnecessary complexity, valuing empiricism and pragmatism in everything we do. By continuously refining our technology based on real customer needs, we ensure that AI serves businesses in a tangible, results-driven way.

Measure, Learn, Improve

If you can't measure it, you can't improve it. Data-driven decision-making is central to Eloquent AI. We continuously evaluate performance, gather insights, and iterate. Our agent architecture and LLM models evolve through rigorous evaluations, ensuring they remain reliable, adaptable, and effective across research, engineering, and customer applications.

Own the Outcome

Eloquent AI fosters a culture of ownership, action, and perseverance. We empower our people to take initiative, embrace responsibility, and drive meaningful impact. In a fast-moving field, our team acts decisively, adapts swiftly, and pushes forward to achieve our mission.

Multi-Disciplinary Collaboration

Collaboration is the foundation of our success. AI is a multidisciplinary field, and the best solutions emerge when experts across domains come together to share knowledge and insights. At Eloquent AI, we foster a culture of open dialogue, cross-functional teamwork, and collective problem-solving.

If you're passionate about AI, technology, and shaping the future of high-stakes conversations, we want to hear from you. Let's build something extraordinary-together.