Senior/Staff Evaluation Data Analyst (Agentic Search)

Overview

Nebius is seeking a Senior or Staff Evaluation Data Analyst to focus on agentic search. The role is based in London, United Kingdom. The position offers the opportunity to shape both technical decisions and product direction by taking end-to-end ownership of quality in search built for AI agents, combining hands-on engineering, analytical judgment, and mathematical rigor.

Requirements

Applicants should have substantial hands-on experience designing and building evaluation or quality measurement systems for complex technology products such as search, AI agents, voice technologies, autonomous driving, recommendation systems, or advertising. Candidates need a track record of owning ambiguous problems from initial framing through implementation, diagnosis, and measurable product improvement. Strong Python skills and an engineering mindset are required to turn analytical ideas into reliable, maintainable pipelines and tools.

Additionally, applicants must possess a solid foundation in mathematical statistics with practical experience in experimental design, sampling, uncertainty, and measurement bias. Strong analytical judgment, effective communication and collaboration abilities, and the independence to make progress in a fast-moving environment are essential. Applicants must also be authorized to work in the country in which they apply and provide proof of employment eligibility upon hire.