Strategy Consultant AI Training & Evaluation📣 Job Ad

About the Role

Mindrift, powered by Toloka AI, is seeking a Strategy Consultant AI Training & Evaluation to join its team. This part-time, project-based, individual-contributor role is remote and focuses on analytical design and evaluation within Saudi Arabia. The primary objective is to translate real-world management consulting engagements into structured learning environments for advanced AI systems.

Role Context and Purpose

Mindrift connects top domain experts with cutting-edge AI initiatives, leveraging Toloka's expertise in scalable data generation and applied ML systems. The company is launching a dedicated Management Consulting domain to credibly build and evaluate how next-generation generative models learn, reason, and perform. This involves assembling a team of strategy consultants who can convert authentic project experience into end-to-end examples, from problem structuring to client-ready recommendations.

Key Responsibilities

• Build realistic consulting project environments: Create detailed project scenarios grounded in real engagement dynamics, including industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents: Break projects into discrete tasks that mirror real consulting work, such as market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, and benchmarking.
• Define evaluation criteria and quality standards: Develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

Candidate Profile and Requirements

We are seeking consultants with 3+ years of direct project experience at one of the following top-tier strategy consulting firms. Essential experience includes:

• Structuring ambiguous client problems into workable analytical plans.
• Building financial models, market analyses, or synthesizing findings from complex inputs.
• Producing client-ready deliverables under time pressure.
• Forming and defending recommendations under uncertainty.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. Eligible firms include: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC). No deep technical background is required; onboarding will be provided for the lightweight tools involved.

Compensation and Work Arrangement

This is a remote, project-based opportunity. Contributors can earn up to $60 per hour equivalent on this project, depending on their level and pace of contribution. Compensation may vary across different projects based on scope, complexity, and required expertise.

Application Information

Mindrift invites qualified strategy consultants who meet these specific criteria to apply for this role, contributing to the development and evaluation of advanced AI systems.