Getting Data From OData feed

[Hussein_charif]

Hi, i have 5 tables that im getting using OData feed source in fabric using a dataflow.

all the tables are extracted normally ecxcept the fact table which has around 5m rows, i get an error after a long wait trying to extract the table. i tried turning on fast copy but it doesnt work with OData source, i turned on staging but it is still very slow and not retrieving data for that table only.

can anyone suggest any solution/ alternative? i am relatively new to fabric and cant really find much resources to tackle the problem.

[v-sgandrathi]

Hi @Hussein_charif,

Thank you for the update.

If the provided solution was helpful, kindly consider accepting it as the useful answer. This will help other community members facing similar issues.

Thank you @kushanNa for the help.

Best regards,
Sahasra.

[v-sgandrathi]

Hi @Hussein_charif,

We wanted to follow up since we haven't heard back from you regarding our last response. We hope your issue has been resolved.

If my answer resolved your query, please mark it as "Accept Answer" and give Kudos if it was helpful.

If you need any further assistance, feel free to reach out.

Thank you for being a valued member of the Microsoft Fabric Community Forum!

[v-sgandrathi]

Hi @Hussein_charif,

Since we haven't heard back from you yet, I'd like to confirm if you've successfully resolved this issue or if you need further help?
If you've already resolved the issue, you can mark the helpful reply as a "solution" so others know that the question has been answered and help other people in the community. Thank you again for your cooperation!
If you still have any questions or need more support, please feel free to let us know. We are more than happy to continue to help you.

[kushanNa]

Hi @Hussein_charif 

One method you can use is applying filters ($filter) in your OData link. This helps reduce the amount of data being pulled into Power BI.

Another approach is to test whether you can pull all 5 million rows directly into the Power BI Service instead of using Power BI Desktop. You can first create a sample report with a smaller dataset, and after publishing it, configure it to extract all 5 million rows.

To do this, you can use parameters. Create a parameter and use it in your OData link to control the number of rows pulled. For example:

= OData.Feed("https://services.odata.org/V3/Northwind/Northwind.svc/Products?$top="&Parameter1&"", null, [Implementation="2.0"])

After publishing the report to the Power BI Service, go to the dataset settings and change the parameter value to 5 million.

check link: 

https://learn.microsoft.com/en-us/power-bi/connect-data/service-parameters 

But at the same time, I’ve seen in a few forums here and there that there might be a 1 million row limit for DirectQuery. I'm not sure if this applies to OData as well, so it's better to use filters to reduce the data as much as possible.

[Hussein_charif]

Hi @kushanNa , thank you for the reply.

so i am pulling the data in the service to my dataflow, i didnt start pulling the data to desktop, the problem is within the dataflow. does the filter work if i do it in the dataflow's power query?

[kushanNa · Accepted solution]

Hi @Hussein_charif 

I apologize — I misunderstood that you're experiencing this issue in Power BI Desktop, since you posted it on the Desktop side.

That said, the filtering should work in a Dataflow within the Power BI Service / fabric as well I feel — give it a try! 🙂
Unfortunately, since I'm using a Power BI Free license, I'm unable to test this myself.

[Hussein_charif]

thank you for the help @kushanNa !