Stop Measuring AI Adoption by Who Has Copilot Open
I spent most of last quarter staring at an AI adoption dashboard that told me nothing useful. 72% weekly active across the org. Looked great in a slide. Got a few nods in the leadership review. Then someone asked “so are we actually getting faster?” and nobody had an answer. That 72% meant that 72% of our engineers had opened Copilot or Cursor at least once that week. Some of them were using Composer to scaffold entire test suites from requirements docs. Others just let tab-complete fill in a closing bracket now and then. Both counted the same. Both were “active users.” We’d been measuring the wrong thing for months and congratulating ourselves for it. ...