Senior Machine Learning Engineer - Insights

Das ist der Job

Develop LLM evaluation frameworks to assess accuracy, coherence, and usability of models in production environments.

Darum lohnt es sich

About the role: At Cresta, the Insights Team is dedicated to leveraging Large Language Models (LLMs) and AI techniques to extract actionable intelligence from conversations. Benefits Medical, dental, and vision plans designed to fit you and your family’s needs. Work‑from‑home office stipend.

Compensation for this position includes a base salary, equity, and a variety of benefits. We develop models and systems that analyze customer interactions, identify key topics, and provide structured insights that impact business outcomes.

Our work enables organizations to make data‑driven decisions and optimize customer experience through AI‑powered exploration and interactive workflows.

A key focus of this role is developing agentic workflows that empower users to dynamically interact with AI‑driven insights, refining and guiding the discovery process in an interactive and iterative manner.

Additionally, this role will involve designing and implementing LLM evaluation frameworks to assess model performance, reliability, and usability in real‑world applications. Our goal is to provide users with intelligent, context‑aware AI agents that surface the most relevant insights and allow for deeper exploration of conversational data.

As a Machine Learning Engineer , you will be at the forefront of applying state‑of‑the‑art NLP and LLM techniques to understand conversations at scale.

Your work will focus on developing robust, scalable AI solutions that extract meaning, evaluate LLM effectiveness, and provide real‑time insights to our customers through intuitive, agent‑driven workflows. Responsibilities Build and optimize agentic AI workflows that enable users to dynamically explore and refine insights from conversational data.

Research and implement cutting‑edge NLP and LLM‑based approaches to extract meaningful insights from unstructured text data. Design, develop, and deploy machine learning models for conversation analysis, topic discovery, and structured insight generation .

Collaborate with UX designers, product managers, and engineers to integrate AI‑driven insights into Cresta’s products. Optimize ML pipelines to efficiently process conversational data at scale.

Qualifications We Value Master’s or Ph.D. in Computer Science, Machine Learning, AI, or a related field. 5+ years of hands‑on experience in NLP, LLMs , or agentic AI workflows in production settings. Strong knowledge of ML frameworks and NLP libraries (e.g., PyTorch, TensorFlow, Hugging Face, spaCy, NLTK).

Strong passion for AI‑driven innovation, outstanding work ethic , and high self‑motivation to drive impactful solutions. Experience with text analysis, embeddings, transformer‑based architectures, and developing AI‑driven, agentic workflows . Paid parental leave. Monthly Health & Wellness allowance. Lunch reimbursement for in‑office employees.

PTO: 3 weeks in Canada. Actual base salaries will be based on candidate‑specific factors, including experience, skillset, and location, and local minimum pay requirements as applicable. We are actively hiring for this role in the US and Canada. #J-18808-Ljbffr