AI Consultant - Generative AI & LLM Tokyo

Join a specialist data science team within a leading consulting firm as an AI Consultant specializing in Generative AI and Large Language Models (LLMs).

In this client-facing role, you will help organizations solve complex business challenges using cutting-edge technologies including Generative AI, AI Agents, RAG, and LLM applications. You will lead projects across the complete AI development lifecycle-from identifying business requirements and designing solutions to building prototypes, production implementation, deployment, and ongoing optimization.

Unlike a traditional back-office data science role, this position combines AI strategy, consulting, and hands-on engineering. You will work directly with clients to translate business challenges into scalable AI solutions while gaining practical experience with the latest LLM technologies and multi-cloud environments.

Key Responsibilities

• Work directly with clients to identify business challenges, gather requirements, and propose appropriate Generative AI and LLM solutions.
• Design and implement LLM-based AI Agents, RAG pipelines, multi-agent systems, and tool integrations.
• Build prototypes and lead AI solutions from Proof of Concept (PoC) through production deployment and ongoing operations.
• Apply prompt engineering and develop LLM evaluation pipelines to continuously monitor and improve AI quality and performance.
• Design, build, and deploy production AI systems across AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Provide technical guidance and communicate complex AI concepts clearly to clients and internal stakeholders.
• Coordinate multiple stakeholders and facilitate collaboration across consulting, engineering, data science, and client teams.
• Research emerging AI technologies and determine how new tools, frameworks, and methodologies can be applied to real-world business challenges.

Required Skills and Qualifications

Experience:

• At least 1 year of experience designing or developing systems using LLMs or Generative AI.
• At least 3 years of software development experience using Python, JavaScript, TypeScript, or similar programming languages.
• Experience gathering requirements and proposing technical solutions to clients or internal stakeholders.
• Hands-on experience building and operating systems on AWS, Azure, or GCP.
• Experience progressing technical projects from requirements definition and PoC through production implementation is highly relevant to this position.

Soft Skills:

• Strong consulting and communication skills with the ability to translate business requirements into practical AI solutions.
• Experience leading SI, technology consulting, or similar client-facing projects.
• Strong stakeholder management and facilitation skills across multiple teams.
• Ability to independently research emerging technologies and apply relevant approaches to client challenges.
• Strong analytical thinking with the ability to develop hypotheses and create structured validation plans for unfamiliar problems.

Language Requirements:

• Japanese: Fluent
• English: Intermediate to Business level, including professional reading and writing skills.

Preferred Skills & Qualifications

• Hands-on experience with AI Agent frameworks such as LangChain, LangGraph, CrewAI, or AutoGen.
• Experience designing and implementing RAG (Retrieval-Augmented Generation) pipelines.
• Knowledge of prompt engineering and experience designing or operating LLM evaluation frameworks.
• Experience developing AI Agent or multi-agent architectures and integrating external tools.
• Experience implementing observability solutions, including structured logging and distributed tracing.
• Experience designing and implementing CI/CD pipelines for production systems.
• Strong understanding of emerging LLM and AI Agent technologies.

About the Company

Our client is a consulting organization with a specialist data science and AI team focused on solving complex client challenges through advanced analytics, Generative AI, and LLM technologies.

Rather than operating as a traditional internal data function, the team works directly with clients, combining strategic consulting, data science, and hands-on AI engineering to develop innovative solutions.

The wider global consulting platform provides access to complex business challenges, international expertise, and advanced technologies, creating an environment where AI professionals can develop both their technical and consulting careers.

Why You'll Love Working Here

• Work directly with clients and combine AI strategy with hands-on Generative AI implementation.
• Build practical expertise across LLMs, AI Agents, RAG, prompt engineering, and multi-agent systems.
• Take ownership of projects throughout the lifecycle, from business requirements and PoC development to production AI deployment.
• Develop your career within the strong platform and network of a global consulting firm.
• Gain hands-on experience building AI solutions across AWS, Azure, and GCP multi-cloud environments.
• Work at the forefront of rapidly evolving Generative AI and LLM technologies while solving real-world business problems.
• Earn a competitive annual salary of ¥8M-¥11M in a specialist AI consulting role in Tokyo.

Don't Miss Out - Apply Now!