Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
quibtisa
New Member

Need help with bottleneck in my algorithm

As a programmer, I've encountered a problem with the data flow algorithm in my code. I have a for loop that processes a large amount of data, but it seems to slow down significantly as the loop progresses. I suspect this is due to a bottleneck in my algorithm, where a lack of resources or inefficiency in my code limits the processing time.

Here's an example of the problematic code:

for i in range(10000000):
  # process data
  data = fetch_data()
  result = process_data(data)
  save_result(result)

I need to find a way to optimize the processing time so that my algorithm can handle a large amount of data efficiently. I've tried reading this site about the dataflow but I need more support can someone help me?

0 REPLIES 0

Helpful resources

Announcements
Sept PBI Carousel

Power BI Monthly Update - September 2024

Check out the September 2024 Power BI update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors