• Lead long-term projects with high complexity and ambiguity from first discussion with the client to completion • Design/improve workflows to create data for AI/ML training and evaluation. • Design and refine search data annotation frameworks, including relevance judging guidelines • Dive deep into existing workflows and processes to gather data and insights, make recommendations, and drive improvement through innovation and cross-functional collaboration with customers • Assess and optimize search-specific evaluation approaches, including A/B testing frameworks, ranking metrics, and human evaluation studies for search result quality • Quantitatively analyze large datasets, perform statistical analysis, calculate metrics, and make recommendations to improve accuracy and performance. • Work closely with client stakeholders on understanding goals, gathering requirements, proposing solutions, and executing them. • Contribute to establishing best practices and standards for generative AI development with customers and within the organization