🪩 Party Guide is Live! View Here

AI Attribution: Measuring What AI Actually Did

Jill Cates
Jill Cates
Senior Data Scientist | Shopify

  • Analytics & Data Sci

As AI features become standard across products, teams face a critical measurement challenge: understanding how much AI actually contributed to user outcomes.

This talk introduces a practical framework for AI attribution — measuring not just whether users engaged with an AI feature, but the degree to which AI shaped the final result. We'll cover the full spectrum: from full acceptance, to partial edits, to abandoned attempts where users generated output but ultimately reverted to manual input. We'll explore AI attribution measurement approaches and a clearer understanding of how to assess AI feature impact.

Jill Cates

Senior Data Scientist

Jill Cates

Shopify

Jill Cates is a senior data engineer at Shopify, where she builds and scales data systems that power one of the world's largest e-commerce platforms. With over a decade in tech - starting in software development, moving into data science, and now focused on data engineering - she brings a full-stack perspective to data infrastructure at scale. At Shopify, Jill builds systems to measure AI attribution and develops AI tooling that automates toilsome data engineering tasks.