Amazon is seeking an AI Editor who is passionate about technology, innovation, and the customer experience. This is an opportunity to join the high-performing team behind Alexa for Shopping, Amazon’s generative AI-powered shopping assistant. Alexa for Shopping makes it easy for customers to find and discover products to meet their unique needs by helping with product research, providing comparisons and recommendations, answering specific product questions, and more.

The AI Editor will be responsible for improving the fluency of our AI models through human-in-the-loop evaluations and LLM judge audits. They will uphold and contribute to quality, style, and tone guidelines, while using customer feedback to continually improve Amazon’s ability to be helpful to customers. Cross-functional partnership will be key, as this team works across Product, Science, and Design teams to evaluate CX metrics, develop scalable reporting systems, and ensure continual model improvements.

This role requires exceptional written and oral communication skills, excellent judgment, strong project management, deep curiosity about how things work, and a passion for serving customers. You must enjoy context-switching and partnering at all levels of the organization to deliver results. This is an opportunity to gain valuable experience in the growing field of artificial intelligence and its application in diverse business settings.

Key job responsibilities

• Translate complex content policies into prompts that LLMs can easily understand, ensuring alignment with business priorities
• Develop and utilize novel prompting approaches for feature development and defect reduction
• Create high-quality alignment data to train LLMs in shopping-specific use cases
• Identify potential biases or limitations in the LLMs responses and employ fine-tuning techniques to improve the model
• Become a subject matter expert across sensitive topics and policies, including areas ranging from environmental and medical claims to sexual content and profanity

A day in the life
You will develop and implement strategies to train and improve Amazon’s Shopping LLM. You will partner closely with Product, Science, and Engineering teams, who are invested in creating solutions that make it easier, faster, and more intuitive for our non-coding workforce to iterate and improve features for customers. You will be part of an Editorial team, which includes creative product and program managers, writers, editors, and language engineers. This is a startup culture: We move fast, have ambitious goals, adapt quickly, and learn along the way.