Vanity metrics look impressive but don't drive decisions. The test: “If this metric goes up, down, or stays flat, what will you do differently?” If the answer is unclear, it's likely vanity.
Common vanity metrics to deprioritize: total registered users (without activity context), page views (without conversion data), total downloads (without activation data), social followers (without engagement context), time on site (without understanding why), and cumulative signups (the number only goes up).
Transform vanity into actionable: Replace total users with Monthly Active Users and retention rate. Replace page views with conversion rate. Replace downloads with activation rate. Replace total MQLs with MQL-to-SQL conversion rate.
A North Star Metric is the single metric that best captures core customer value. Products typically play one of three “games”:
Famous examples: Airbnb uses nights booked. Spotify tracks time spent listening. Netflix measures median view hours per month. Slack focuses on messages sent. Many growth-stage companies default to revenue as their NSM, but Airbnb, Netflix, and Spotify deliberately avoid revenue as their primary metric—arguing it leads to suboptimal decisions.
What matters shifts dramatically based on company stage:
The most effective product teams don't track more metrics—they track fewer, better metrics tied directly to customer value. The research reveals consistent patterns: retention metrics predict success better than growth metrics, leading indicators beat lagging indicators, and ratios outperform absolute numbers.
Three principles emerge: Retention is foundational—without it, acquisition becomes waste. Net Revenue Retention is the closest thing to a universal success metric for subscription businesses. And the Sean Ellis Test and activation rate provide the earliest reliable signals of product-market fit, allowing intervention before lagging metrics reveal problems.
For teams building their metrics stack: start with a North Star Metric aligned to customer value, support it with 3-5 input metrics you can directly influence, and ruthlessly eliminate vanity metrics that feel good but change nothing. The goal isn't comprehensive measurement—it's actionable insight that drives better products.