Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
Hi Everyone,
I've been a heavy user of PowerQuery to perform all my ETL before passing it onto PowerBI.
As i'm working with millions of rows of data, PowerQuery can get too slow whenever i edit anything as it will go through step by step.
Thus i'm wondering if R Script would be faster to perform the ETL within PowerBI instead of PowerQuery?
I'm also curious if anyone here uses R Script within PowerBI to clean up their data.
Cheers
Solved! Go to Solution.
@v-ljerr-msft , Thanks for the reply.
Not too sure if you're aware that if we're running huge dataset with lot of ETL, PowerQuery will rerun all the steps whenever you open it thus making it the query extremely slow.
I'm still learning R thus I'm here seeking advice but from what I know, R only execute the required steps and don't rerun the entire query therefore I have the impression that it might be faster as compared to PowerQuery.
Hi @Rookarumba,
Thus i'm wondering if R Script would be faster to perform the ETL within PowerBI instead of PowerQuery?
Based on my research, R is not a fast language. This is not an accident. R was purposely designed to make data analysis and statistics easier for you to do. It was not designed to make life easier for your computer. So I doubt that using R Script would be faster to perform the ETL within PowerBI instead of PowerQuery. ![]()
Regards
@v-ljerr-msft , Thanks for the reply.
Not too sure if you're aware that if we're running huge dataset with lot of ETL, PowerQuery will rerun all the steps whenever you open it thus making it the query extremely slow.
I'm still learning R thus I'm here seeking advice but from what I know, R only execute the required steps and don't rerun the entire query therefore I have the impression that it might be faster as compared to PowerQuery.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 48 | |
| 45 | |
| 41 | |
| 20 | |
| 17 |
| User | Count |
|---|---|
| 69 | |
| 64 | |
| 32 | |
| 31 | |
| 27 |