Forum Discussion
utsavlexmark
7 months agoHelper III
Fletching Data directly from adobe analytics.
Respected Members, Right now I have given the responsibilty by my company to review the scope of connecting power bi with all the tools we are using. One of the tool we are using is adobe analytics....
- 7 months ago
Hi utsavlexmark
Why does it work in the first case but fail in the second?
- Situation 1: You are using three dimensions (Year-Month, Browser Name, Pageviews). This is a relatively simple query, and the Adobe Analytics API can return the data quickly.
- Situation 2: You have added an additional dimension (Browser Type). This significantly increases the number of possible combinations. For example:
- 12 months × 10 browser types × 50 browser names = thousands of rows.
- When the date range exceeds 10 days, the API attempts to return a very large dataset, which often results in:
- Timeouts or connectivity errors.
- Adobe Analytics API limits (typically 50,000 rows per request).
What might be missing?
- Pagination in the API
- The connector or custom integration must support pagination for large datasets.
- Check whether you are using the official Adobe Analytics Connector for Power BI or calling the REST API directly.
- Segmentation or aggregation before importing into Power BI
- Instead of requesting all data at once, split the queries into smaller periods (e.g., month by month).
- Alternatively, aggregate data in Adobe before exporting (for example, omit Browser Name if not required).
- Connection mode
- If you are using DirectQuery, this can be problematic because each visual triggers a heavy query.
- Prefer Import Mode with scheduled refresh.
- API row limits
- Adobe Analytics imposes limits per request. If exceeded, you need to implement pagination or breakdown requests.
Practical suggestion
In Power Query, create a function that:- Accepts date parameters (e.g., start and end dates).
- Makes paginated calls to the API.
- Combines the results.
let GetData = (StartDate as text, EndDate as text) => let Source = Json.Document(Web.Contents("https://api.adobe.io/...?", [Query=[start=StartDate, end=EndDate]])), Data = Source[rows] in Data in GetDataThen use List.Generate to iterate by month or week.Best practice
- Avoid bringing maximum granularity into Power BI.
Import aggregated data and use dynamic filters for detailed analysis. - If your organisation requires deep analysis, consider using a Data Lake or Microsoft Fabric Lakehouse to store raw data and then model it.
If this response was helpful in any way, I’d gladly accept a 👍much like the joy of seeing a DAX measure work first time without needing another FILTER.
Please mark it as the correct solution. It helps other community members find their way faster (and saves them from another endless loop 🌀.
utsavlexmark
7 months agoHelper III
Excellent mate, I found my solution out of so many options.