Strategic Framework

Avoid Vanity Metrics

Vanity metrics look impressive but don't drive decisions. The test: “If this metric goes up, down, or stays flat, what will you do differently?” If the answer is unclear, it's likely vanity.

Common vanity metrics to deprioritize: total registered users (without activity context), page views (without conversion data), total downloads (without activation data), social followers (without engagement context), time on site (without understanding why), and cumulative signups (the number only goes up).

Transform vanity into actionable: Replace total users with Monthly Active Users and retention rate. Replace page views with conversion rate. Replace downloads with activation rate. Replace total MQLs with MQL-to-SQL conversion rate.

Pick Your North Star

A North Star Metric is the single metric that best captures core customer value. Products typically play one of three “games”:

  • Attention games (time in product): North Star = watch time, time spent listening
  • Transaction games (number of transactions): North Star = bookings, purchases
  • Productivity games (efficiency of work): North Star = tasks completed, documents created

Famous examples: Airbnb uses nights booked. Spotify tracks time spent listening. Netflix measures median view hours per month. Slack focuses on messages sent. Many growth-stage companies default to revenue as their NSM, but Airbnb, Netflix, and Spotify deliberately avoid revenue as their primary metric—arguing it leads to suboptimal decisions.

Match Metrics to Your Stage

What matters shifts dramatically based on company stage:

  • Pre-product-market fit: Focus on Sean Ellis Test (target 40%+ “very disappointed”), cohort retention curves, and qualitative feedback. Avoid optimizing revenue, CAC/LTV, or scaling metrics—it's too early.
  • Growth stage (post-PMF): Define your North Star Metric. Focus on activation rate, funnel conversion, and acquisition by channel.
  • Scale/mature stage: Optimize LTV:CAC (target 3:1+), CAC payback (<18 months), Net Revenue Retention (>100%), and gross margin.

Conclusion

The most effective product teams don't track more metrics—they track fewer, better metrics tied directly to customer value. The research reveals consistent patterns: retention metrics predict success better than growth metrics, leading indicators beat lagging indicators, and ratios outperform absolute numbers.

Three principles emerge: Retention is foundational—without it, acquisition becomes waste. Net Revenue Retention is the closest thing to a universal success metric for subscription businesses. And the Sean Ellis Test and activation rate provide the earliest reliable signals of product-market fit, allowing intervention before lagging metrics reveal problems.

For teams building their metrics stack: start with a North Star Metric aligned to customer value, support it with 3-5 input metrics you can directly influence, and ruthlessly eliminate vanity metrics that feel good but change nothing. The goal isn't comprehensive measurement—it's actionable insight that drives better products.