Judi Health Senior Machine Learning Engineer II at Judi Health designing and implementing AI/ML solutions including NLP, NLG, multimodal data analysis, chatbots, and RAG-based QnA. Develop scalable AI-driven backend services and APIs.
Responsibilities
Design, develop, and productionize machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.
Develop and maintain backend services using Python, focusing on AI-driven applications.
Design and implement APIs for seamless integration with AI models and services.
Design multi-agent orchestration patterns (e.g. supervisor/subagent architectures, tool-use boundaries, human-in-the-loop gating) and evaluate architectural tradeoffs for scaling agent development across teams.
Contribute to the development and scaling of the retrieval/search infrastructure underlying RAG systems (e.g. vector search clusters, embedding pipelines, capacity planning)
Build and maintain CI/CD pipelines supporting the build, test, and deployment of agentic AI systems.
Collaborate with product managers, engineers, and other stakeholders as a specialist and subject matter expert in machine learning.
Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.
Participate in code reviews, testing, and quality assurance processes.
Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.
Implement system telemetry, A/B testing and other statistical methods to validate the effectiveness of AI models. Ensure the integrity and robustness of ML solutions by developing automated testing and validation processes.
Document and communicate development processes, system designs, and architectural decisions.
Qualification
Strong grasp of OOPExcellent problem-solving skillsPassion for customer
Required
Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related quantitative field.
Minimum 6+ years of experience in industry with a strong focus on ML solutions development and production deployment.
Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.
Strong proficiency in Python and familiarity with ML libraries such as PyTorch.
Statistical Machine Learning and Artificial Intelligence in the context of NLP, Speech, RAG, Virtual Agents, and/or Document Processing technologies
Familiarity with cloud platforms such as AWS or Azure, including hands-on experience with containerized deployments
Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services
Experience designing evaluation frameworks for non-deterministic/agentic AI systems
Excellent problem-solving skills, attention to detail, and a strong capacity for logical thinking.
Passion for customer, innovation, product quality, service excellence, and test engineering
The ability to work collaboratively across multiple disciplines in an extremely fast-paced, startup environment.
Experience working with microservices/an API-based application paradigm.