The Enterprise Technology Services organization partners with every part of the American Express business to power the company’s growth and innovation with trust and efficiency, and drive competitive differentiation with speed. We support the delivery and operations of technology, digital, and data capabilities, platforms, and services globally. Specifically, our team is responsible for the company’s technology engineering, architecture, and infrastructure, providing 24x7 support to ensure an uninterrupted, high-quality experience for customers and colleagues. We also provide product management for core enterprise platforms, and lead technology risk and information security, enterprise data governance and platforms, digital product and design, and enterprise AI platforms on behalf of the company.
The Evaluation Engineer designs, develops, and maintains evaluation frameworks for AI and machine learning solutions, including LLM, RAG, agentic, and multimodal applications. This role translates business, product, risk, and governance requirements into measurable success criteria; builds automated and human-in-the-loop evaluation pipelines; and partners with cross-functional teams to ensure AI systems meet enterprise standards for quality, safety, reliability, compliance, latency, and cost.