Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
quibtisa
New Member

Need help with bottleneck in my algorithm

As a programmer, I've encountered a problem with the data flow algorithm in my code. I have a for loop that processes a large amount of data, but it seems to slow down significantly as the loop progresses. I suspect this is due to a bottleneck in my algorithm, where a lack of resources or inefficiency in my code limits the processing time.

Here's an example of the problematic code:

for i in range(10000000):
  # process data
  data = fetch_data()
  result = process_data(data)
  save_result(result)

I need to find a way to optimize the processing time so that my algorithm can handle a large amount of data efficiently. I've tried reading this site about the dataflow but I need more support can someone help me?

0 REPLIES 0

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

60 days of Data Days Carousel

Data Days 2026

Join Fabric Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.