hmahmudi1's avatar
hmahmudi1
Advocate II
2 months ago

Forecast Accuracy Analysis

๐Œ๐จ๐ฌ๐ญ ๐Ÿ๐ข๐ง๐š๐ง๐œ๐ž ๐ญ๐ž๐š๐ฆ๐ฌ ๐ฎ๐ฉ๐๐š๐ญ๐ž ๐ญ๐ก๐ž๐ข๐ซ ๐Ÿ๐จ๐ซ๐ž๐œ๐š๐ฌ๐ญ๐ฌ ๐ž๐ฏ๐ž๐ซ๐ฒ ๐ฆ๐จ๐ง๐ญ๐ก โ€” ๐›๐ฎ๐ญ ๐ซ๐š๐ซ๐ž๐ฅ๐ฒ ๐ฅ๐จ๐จ๐ค ๐›๐š๐œ๐ค ๐ญ๐จ ๐ฌ๐ž๐ž ๐ก๐จ๐ฐ ๐š๐œ๐œ๐ฎ๐ซ๐š๐ญ๐ž ๐ญ๐ก๐ž ๐จ๐ฅ๐ ๐จ๐ง๐ž๐ฌ ๐ฐ๐ž๐ซ๐ž.

 

That is normal. A forecast made 10 or 11 months before close is not expected to be perfect. But it still matters because early forecasts influence budgets, hiring, cash planning, and investment decisions.

 

๐“๐ก๐ž ๐ซ๐ž๐š๐ฅ ๐ช๐ฎ๐ž๐ฌ๐ญ๐ข๐จ๐ง ๐ข๐ฌ ๐ง๐จ๐ญ:

 

โ€œWas the first forecast right?โ€

 

๐“๐ก๐ž ๐›๐ž๐ญ๐ญ๐ž๐ซ ๐ช๐ฎ๐ž๐ฌ๐ญ๐ข๐จ๐ง ๐ข๐ฌ:

 

โ€œHow much confidence should we place in a forecast at each stage of the planning cycle?โ€

 

That is why I built this Power BI page that tracks every forecast version for each month and compares it against the actual result.

 

Each line shows one monthโ€™s forecast journey:

 

from the early estimate,

to the monthly updates,

to the final number.

 

The pattern is clear.

 

๐„๐š๐ซ๐ฅ๐ฒ ๐Ÿ๐จ๐ซ๐ž๐œ๐š๐ฌ๐ญ๐ฌ ๐š๐ซ๐ž ๐ฐ๐ข๐๐ž๐ซ ๐š๐ง๐ ๐ฆ๐จ๐ซ๐ž ๐ฎ๐ง๐œ๐ž๐ซ๐ญ๐š๐ข๐ง.

As the actual month gets closer, the forecast tightens and moves toward the truth.

 

In this dataset:

 

โ€ข Final estimate accuracy: ~0.6% MAPE

โ€ข 11-month forecast accuracy: ~1.44% MAPE

โ€ข Long-range forecasts were about 2.3ร— less accurate

โ€ข 36 of 66 forecasts came in below actual, showing a mild conservative bias

 

๐๐ฎ๐ญ ๐ญ๐ก๐ข๐ฌ ๐ซ๐š๐ข๐ฌ๐ž๐ฌ ๐š ๐›๐ข๐ ๐ ๐ž๐ซ ๐ช๐ฎ๐ž๐ฌ๐ญ๐ข๐จ๐ง:

 

Are we only asking, โ€œHow much did we miss by?โ€

 

Or are we also asking, โ€œDo we keep missing in the same direction?โ€

 

In this case, most forecasts came in below actual. That suggests a mild conservative bias.

 

And that matters because consistently low forecasts can cause the business to plan too small, hire too late, or invest too cautiously before the growth becomes obvious.

 

Built in Power BI using Deneb / Vega-Lite

1 Reply

  • Wow, I really like your visualization as well as your conclusion about why forecast tracking matters and how forecast accuracy reflects cash flow in a business. Iโ€™m actually experiencing a very similar situation.

    I hope we can connectโ€”would you mind sharing some tips on how to create charts like that?