Technical Talks

View All

AI Attribution: Measuring What AI Actually Did

Jill Cates Jill Cates | Senior Data Scientist | Shopify

As AI features become standard across products, teams face a critical measurement challenge: understanding how much AI actually contributed to user outcomes.

This talk introduces a practical framework for AI attribution — measuring not just whether users engaged with an AI feature, but the degree to which AI shaped the final result. We'll cover the full spectrum: from full acceptance, to partial edits, to abandoned attempts where users generated output but ultimately reverted to manual input. We'll explore AI attribution measurement approaches and a clearer understanding of how to assess AI feature impact.

Jill Cates
Jill Cates
Senior Data Scientist | Shopify

Jill Cates is a senior data engineer at Shopify, where she builds and scales data systems that power one of the world's largest e-commerce platforms. With over a decade in tech - starting in software development, moving into data science, and now focused on data engineering - she brings a full-stack perspective to data infrastructure at scale. At Shopify, Jill builds systems to measure AI attribution and develops AI tooling that automates toilsome data engineering tasks. 

FEATURED MEETINGS