Senior Data Engineer – AI, Conversational Analytics

Job Description

We are looking for a Senior Data Engineer to develop and maintain data pipelines for analyzing the performance of conversational agents and support systems. This role involves defining, monitoring, and enhancing service metrics and LLMs (SLA, CSAT, latency, tokens, quality score, hallucination rate). You'll operationalize collection, governance, and observability in BigQuery, building dashboards in Looker, and integrating AI data into business systems. This position focuses on LLMs, conversational agents, and generative AI, including quality metrics and model tuning.

Qualifications

1. Solid experience in Data Analysis or BI with a focus on service metrics. 2. Previous experience with the Google Cloud Platform (GCP), especially BigQuery. 3. Experience with LangChain, LangGraph, LangFlow, and monitoring platforms (LangSmith, Langfuse, PromptFlow, Phoenix). 4. Knowledge of data architecture, logging, tracking, and observability of applications and LLMs. 5. Experience in contact center environments, chatbots, and modern integrations (MCP, APA).