Client Service Risk Manager - AI Evaluation and Testing
McKinsey & Company
Software Engineering, Data Science, Customer Service
United States · Amsterdam, Netherlands · Dublin, Ireland · Düsseldorf, Germany · Bogotá, Bogota, Colombia · Lisbon, Portugal · Brussels, Belgium · London, UK
Posted on Jan 24, 2026
Client Service Risk Manager - AI Evaluation and Testing
Job ID: 104873
- Amsterdam
- Bogota
- Brussels
- Dublin
- Dusseldorf
- Lisbon
- London
- Madrid
- Mexico City
- Munich
- Poznan
- Prague
- San Jose
- Santiago
- Sao Paulo
- Wroclaw
Do you want to work on complex and pressing challenges—the kind that bring together curious, ambitious, and determined leaders who strive to become better every day? If this sounds like you, you’ve come to the right place.
Your Impact
You will work within the firm's Technology Risk function as the Client Service Risk Manager, of AI Evaluation and Testing, ensuring our firm’s strong ability to evaluate and validate AI systems including those used and built internally and in client contexts by consultants for reliability, safety, security, and regulatory compliance.
You, as the lead in AI evaluation and testing, will define the vision and strategic roadmap for AI control objectives and testing. You will establish frameworks, requirements, and guidance to assess behavior and ensure reliability (including accuracy, bias, and other factors) across various modalities such as text, code, multimodal systems, and agents. Additionally, you will define and prioritize the requirements for tooling solutions that support AI governance, observability, and testing for all relevant AI systems and agents.
You will also develop or validate frameworks and methodologies for conducting red-team attacks on AI systems (jailbreaks, prompt injections, system prompt extraction). You will partner with first line of defense to implement evaluation gates and build a control environment with appropriate technical guardrails to ensure compliance with applicable regulations (e.g., the EU AI Act).
You will report directly to the Associate Director of Client Service Risk, Technology Knowledge & Frameworks, within the firm’s global Risk function. You will partner closely with Legal, Risk teams, Technology and Product teams to develop consistent and scalable RAI control objectives and testing methodologies.
You will support updates to existing robust policies and standards in line with development in AI capabilities (e.g., agentic).
Your collaboration will extend to various roles and functions across the firm, including senior leadership, to whom you will present and gain support for your strategy and program, report progress, and demonstrate impact.
Your Growth
You are someone who thrives in a high-performance environment, bringing a growth mindset and entrepreneurial spirit to tackle meaningful challenges that have a real impact.
In return for your drive, determination, and curiosity, we’ll provide the resources, mentorship, and opportunities to help you quickly broaden your expertise, grow into a well-rounded professional, and contribute to work that truly makes a difference.
When you join us, you will have:
- Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast-paced learning experience, owning your journey.
- A voice that matters: From day one, we value your ideas and contributions. You’ll make a tangible impact by offering innovative ideas and practical solutions, all while upholding our unwavering commitment to ethics and integrity. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes.
- Global community: With colleagues across 65+ countries and over 100 different nationalities, our firm’s diversity fuels creativity and helps us come up with the best solutions. Plus, you’ll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences.
- Exceptional benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well-being for you and your family.
Your qualifications and skills
- U.S. Bachelor’s degree or equivalent work experience required
- 8+ years in Trust & Safety (AI/ML), risk, or security domains with Data Science background; the scope of the models includes traditional ML models, GenAI and agentic deployments
- 5+ years managing complex cross-functional projects
- Familiarity with AI safety, testing and validation, and governance; experience partnering with engineers to build control and integrity systems
- Knowledge of AI evaluation methods and ability to connect evaluation results to guardrails and controls; Strong knowledge of LLM behavior and jailbreak techniques
- Proven ability to translate complex ethical challenges into actionable policies and frameworks; strong policy development, risk management, and analytical skills
- Experience working with engineering and product teams to create tools, solutions, or automation
- Ability to work in-person (team schedules and office locations may vary)
- Ability to operate office equipment
- Excellent leadership and communication skills, with a proven ability to navigate ambiguity and influence product direction in a fast-changing environment
- Excellent written and oral communication skills, as well as interpersonal skills, including the ability to articulate technical concepts to both technical and non-technical audiences
Please review the additional requirements regarding essential job functions of McKinsey colleagues.
Our unwavering commitment to integrity drives everything we do, guiding us to always act in the best interests of our clients, our people, and the communities we serve.
FOR U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by applicable law.
FOR NON-U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity employer. For additional details regarding our global EEO policy and diversity initiatives, please visit our McKinsey Careers and Diversity & Inclusion sites.
FOR BRAZILIAN APPLICANTS: Applicants for job positions in any office in Brazil have flexibility regarding qualifications and McKinsey & Company will not require previous experience of more than 6 months. If the job description indicates preferred prior work experience of more than 6 months, applicants for such job position in the Brazilian offices must interpret the preferred qualification described as limited up to 6 months maximum.
share this job
Job Skill Group - N/A
Job Skill Code - MREM - Manager, Risk Operations and Experience
Function - Risk & Resilience;Technology
Industry - Infrastructure
Post to LinkedIn - Yes
Posted to LinkedIn Date - Wed Jan 21 00:00:00 GMT 2026
LinkedIn Posting City - Dublin
LinkedIn Posting State/Province -
LinkedIn Posting Country - Ireland
LinkedIn Job Title - Client Service Risk Manager - AI Evaluation and Testing
LinkedIn Function - Other
LinkedIn Industry - Management Consulting
LinkedIn Seniority Level - Mid-Senior level
Job Skill Code - MREM - Manager, Risk Operations and Experience
Function - Risk & Resilience;Technology
Industry - Infrastructure
Post to LinkedIn - Yes
Posted to LinkedIn Date - Wed Jan 21 00:00:00 GMT 2026
LinkedIn Posting City - Dublin
LinkedIn Posting State/Province -
LinkedIn Posting Country - Ireland
LinkedIn Job Title - Client Service Risk Manager - AI Evaluation and Testing
LinkedIn Function - Other
LinkedIn Industry - Management Consulting
LinkedIn Seniority Level - Mid-Senior level