Usage Metrics in New Workspace

I ended up solving this issue. The usage metrics button next to the report within your workspace will show you usage metrics for the undistributed report. Therefore, it will only show users who are admins, contributors, or members on your workspace.

The distributed report has separate usage metrics. These are accessible by navigating to Shared with me > click your app in the left navigation, and then click Report Usage Metrics Report. This usage metrics report aggregates usage metrics across all reports within your app, with no build in slicer to filter by report. I ended up editing that report and built my own Usage Metrics report with a Report DisplayName slicer added.

This is a bit unintuitive. I would prefer the Usage Metrics button within the app show the usage metrics for both my distributed report and the report within my app.