Technical Product Manager – AI Product Operations
Montvale, New Jersey
viewTechnical Product Manager – AI Product Operations
Requisition #: 133927
Practice Area: Audit and Assurance
Location: Orlando, FL; Montvale, NJ; Dallas, TX
<p>Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today’s most important industries. Our growth is driven by delivering real results for our clients. It’s also enabled by our culture, which encourages individual development, embraces an inclusive environment, rewards innovative excellence and supports our communities. With qualities like those, it’s no wonder we’re consistently ranked among the best companies to work for by Fortune Magazine, Consulting Magazine, Seramount, Fair360 and others. If you’re as passionate about your future as we are, join our team.</p>
<p>KPMG is currently seeking a Technical Product Manager - AI Product Operations to join our Audit Technology Alliance organization.</p><p>Responsibilities:</p><ul><li>Act as a "player-coach" managing a team of specialists, while treating the AI monitoring and evaluation infrastructure as an internal product with a defined strategic roadmap</li><li>Treat the AI monitoring and evaluation infrastructure as an internal product; define its strategic roadmap, gather stakeholder requirements, and drive its continuous improvement</li><li>Lead the creation of real-time dashboards to interpret evaluation results, building complex monitors to capture agent traces, human-in-the-loop decisions, and user feedback</li><li>Drive root-cause analysis and cross-functional remediation for AI system issues (including documenting post-mortems), while creating scalable runbooks (SOPs) to streamline deployments</li><li>Partner with product managers and engineering leaders to design and implement evaluators directly into the product lifecycle, leading training efforts on how to accurately interpret and use the results</li><li>Collaborate closely with audit methodology specialists, risk, and compliance teams to ensure all AI evaluation flows, metrics, and guardrails actively support firm audit quality standards</li><li>Act with integrity, professionalism, and personal responsibility to uphold KPMG’s respectful and courteous work environment</li></ul><p>Qualifications:</p><ul><li>Minimum eight years of recent overall professional experience in Technical Product Management, Product Operations, or Data Science, including a proven track record of building and managing high-performing teams</li><li>Master’s degree from an accredited college or university is preferred; minimum of a Bachelor’s degree from an accredited or university is required</li><li>Strong technical background with a distinct product management mindset; you don't need to write production code, but you must deeply understand ML/AI concepts to design sophisticated evaluation products</li><li>Extensive knowledge of Generative AI/LLMs, prompt engineering, and GenAI evaluation techniques (for example, automated scoring, human-in-the-loop review, hallucination detection)</li><li>Demonstrated ability to conceptualize scalable measurement frameworks, define critical KPIs, and design structured workflows out of complex, unstructured AI outputs</li><li>Exceptional written and verbal communication skills, with a proven ability to translate highly technical AI performance metrics into clear business narratives for executive stakeholders</li><li>Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future; KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)</li></ul>
<div><div>KPMG offers a comprehensive compensation and benefits package. KPMG is an equal opportunity employer. KPMG complies with all applicable federal, state and local laws regarding recruitment and hiring. All qualified applicants are considered for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, citizenship status, disability, protected veteran status, or any other category protected by applicable federal, state or local laws. The attached <a href="https://resources.kpmguscareers.com/EEO.pdf">link</a> contains further information regarding KPMG’s compliance with federal, state and local recruitment and hiring laws. No phone calls or agencies please.</div><div><br></div><div>KPMG recruits on a rolling basis. Candidates are considered as they apply, until the opportunity is filled. Candidates are encouraged to apply expeditiously to any role(s) for which they are qualified that is also of interest to them.</div><div><br></div><div>Los Angeles County applicants: Material job duties for this position are listed above. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, and safeguard business operations and company reputation. Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.</div></div>
