Program Manager, Customer Experience And Business Trends

Program Manager

We are seeking a Program Manager to join our exciting new team building technical capabilities to measure Amazon's new Gen-AI/LLM products – a high-visibility, high-impact space for Amazon. This is a critical role that helps ensure the quality of Gen-AI/LLM products across multiple high-impact projects and provides team members with the opportunity to learn about how these products are built through managing key aspects of workflows that contribute to their success. Our near-term objective is to optimize team processes, and reduce operational overhead, while scaling our capacity to support more simultaneous projects. The ideal candidate will be detail-oriented, analytical, and comfortable managing multiple concurrent projects. You will work closely with vendors, senior team members, and various stakeholders across Amazon teams. This position requires strong organizational skills, the ability to maintain quality standards, and experience in delivering consistent results in a fast-paced environment.

As a Program Manager on this team, you will be responsible for executing and managing Gen-AI/LLM quality processes, coordinating with vendors, and supporting the delivery of high-quality annotation projects for Customer Experience and Business Trends teams.

Key job responsibilities:

• Execute and maintain Gen-AI/LLM output quality audit processes
• Track and manage annotation expenses and budget allocation
• Create and maintain annotation guidelines in collaboration with senior team members
• Serve as primary point of contact for vendor coordination and management
• Develop and deliver quality metrics reports on regular cadence
• Manage day-to-day annotation project administration
• Support multiple simultaneous annotation projects
• Ensure compliance with annotation SLAs and quality standards

A day in the life:

Our team is dedicated to improving Amazon's products and services through evaluation of the end-to-end customer experience using both internal and external processes and technology. Our mission is to deeply understand our customer's experience, challenge the status quo, and provide insights that drive innovation to improve that experience. Through our analysis and our insights, we inform business decisions that directly impact customer experience as customers of new GenAI and LLM technologies.

About the team:

Customer Experience and Business Trends (CXBT) is an organization made up of a diverse suite of functions dedicated to deeply understanding and improving customer experience, globally. We are a team of builders that develop products, services, ideas, and various ways of leveraging data to influence product and service offerings – for almost every business at Amazon – for every customer (e.g., consumers, developers, sellers/brands, employees, investors, streamers, gamers). Our approach is based on determining the customer need, along with problem solving, and we work backwards from there. We use technical and non-technical approaches and stay aware of industry and business trends. We are a global team, made up of a diverse set of profiles, skills, and backgrounds – including: Product Managers, Software Developers, Computer Vision experts, Solutions Architects, Data Scientists, Business Intelligence Engineers, Business Analysts, Risk Managers, and more.