Framing a Measurable Business Question
From Vague Asks to Analytical Precision
The Vague Ask
Business stakeholders often ask vague questions: 'Are we doing well?' or 'Is this campaign working?'. While well-intentioned, these questions are unanswerable with data until they are translated into measurable analytical questions. An analyst's first job is to frame the question precisely.
A well-framed question must specify: 1) The Metric (what are we measuring?), 2) The Population/Segment (who or what are we measuring?), and 3) The Timeframe (when are we measuring?).
Metric, Population, and Timeframe
The Metric is the standard of measurement. 'Revenue' or 'conversion rate' are metrics. The Population or Segment defines the scope. Are we looking at all customers, or just new customers from the last month? The Timeframe bounds the analysis in time, such as 'Q3 2023' or 'last 30 days'.
Transforming 'Are we doing well?' into 'What was the revenue growth for our enterprise segment in Q3 compared to Q2?' makes the question measurable and actionable.
Metrics vs. KPIs
Not all metrics are created equal. A Metric is simply a quantifiable measure of performance. A Key Performance Indicator (KPI) is a specific type of metric that is tied directly to a strategic business goal.
For example, 'website traffic' is a metric. 'Number of qualified leads generated per month' might be a KPI if the company's goal is to build a sales pipeline. KPIs are the vital few metrics that indicate whether the business is on track to achieve its core objectives.
Scoping is critical. A question that asks for 'all sales ever' is often unanswerable due to data limits and lacks context. Always narrow the scope to a specific timeframe and segment to ensure the analysis is feasible and relevant.
Growth as a Framed Question
A common business question is 'How fast are we growing?'. To answer this, we frame it as: 'What is the month-over-month (MoM) growth of active users for May to June?'. This specifies the metric (growth), the population (active users), and the timeframe (May to June).
- Identify the starting value (May): 8,000.
- Identify the ending value (June): 9,200.
- Calculate the difference: 9,200 - 8,000 = 1,200.
- Divide the difference by the starting value: 1,200 / 8,000 = 0.15.
- Convert to a percentage: 0.15 * 100 = 15%.
The concepts of metrics and KPIs presented here are for educational training. They do not constitute advice on how to manage a specific business or set corporate strategy.
Check your understanding
- A measurable question names a metric, a population or segment, and a timeframe.
- A metric is just a number; a KPI is a metric tied to a goal.
- Scoping a question well is what makes it answerable with data.
- Month-over-month growth is the change divided by the starting value (1,200 / 8,000 = 15%).