30 Comments
- bhobgood2New MemberIn the transformation area of replace values it would be nice to be able to use a wildcard in the value to replace field. For example we have transaction descriptions like... Placement [EB-12375596] and it would be great to be able to enter something like... Placement% to capture all of these. I've got several work-arounds but this would be a great feature for those who don't know SQL.
- amicoda1New MemberMust have feature!!
- lucio_jungesNew MemberMust have feature!!
- fd134749New MemberWould prefer Regex
- josef_jurakNew Member
Please add text transformation and filtering ability based on open and common standard Regular expression to Data Factory (Power Query engine). Currently there are only very simple excel-like function, which are unusable for real work.
- josef_jurakNew Member
Please vote here and on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=1395c308-7f92-4321-8e35-6cd04d7108bf
- fbcideas_migusrNew MemberStatus added:Needs Votes
- chrisread79Advocate I
We desperately need the REGEX functions added to Power Query. Excel has already had these added in 2024 (REGEXTEST, REGEXEXTRACT, and REGEXREPLACE). See for reference Excel REGEX blog.
Yes, Python can be used for this, but this requires a Personal Gateway.
Yes, the javascript hack can be used for Power BI Desktop, but this does not refresh in the Power BI service.
This is a basic function that has also been applied in Power Apps Power Fx.
- PDesouzaNew Member
It would be super useful to be able to create a conditional column in power query using a search function that contains wildcards.
Example:
I want to sort complaints about coffee. Some people write the coffee is really bad, others write the coffee is bad, others write the coffee is good. I would like to be able to search "Coffee*bad" to create a conditional column based solely off of people who say coffee and bad, but not the people who say coffee * good.
It has many uses and of course can be done with RegEx in VBA, but sometimes its completely impractical if using powerbi and need refreshing reports without running VB scripts.
- fbcideas_migusrNew MemberStatus added:New
- Martin_KmecNew Membersame idea here: https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/8892295-regular-expressions-support-in-power-query
- fbcideas_migusrNew MemberStatus added:Needs Votes
- VEGA_Y_J_CHENNew MemberStrongly support on this initiative! PowerQuery is the most suitable tookit from PowerPlatform while considering some needs of text extraction in Regex way. This proposal is aligned with design of Making ETL(Extract/ Transform / Load) within PowerQuery. What's more, I think it can be a puzzle to complete the Product roadmap while Power Platform building more advanced features vs. competitors.
- drotherNew MemberRegex is a critical tool for manipulating data. I strongly support regex in PowerQueryl
- DavidPearceRegular VisitorI was given by my AI Chatbot the use of two functions that don't exist, Text.Matches and Text.Like - I was *really* excited since they seemed logical. Hard to believe regex isn't native. Being an analyst I have no experience in trying to use a personal gateway to a Python script... Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Matches([Sub Account], "^\d{6}-\d{3}$") then [Sub Account] else if Text.Matches([Sub Account], "^\d{6}-\d{3}-\d$") then [Sub Account] else null ) then = Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Like([Sub Account], "??????-???") then [Sub Account] else if Text.Like([Sub Account], "??????-???-#") then [Sub Account] else null )
- zack-cRegular Visitor
When dealing with messy data, it's often paramount to do some text transforms to clean it up a little. I end up writing a lot of regex and just having ChatGPT translate it into Power Query steps/functions because manually transforming text is such a pain in Power Query without regex. It's very quick for me to write regex due to how close the final syntax usually is to the text I'm matching.
For context, a simple regex-based prefix matcher like this:
^[A-Z]{3}-\d{4}\s*(?=\D)Translates into a Power Query function along the lines of:
(text as nullable text) as nullable text => let t = text, Prefix = if t <> null and Text.Length(t) >= 8 then Text.Start(t, 8) else "", ValidPrefix = Text.Length(Prefix) = 8 and Text.Middle(Prefix, 3, 1) = "-" and // First 3 uppercase letters List.AllTrue( List.Transform( Text.ToList(Text.Start(Prefix, 3)), each Character.ToNumber(_) >= 65 and Character.ToNumber(_) <= 90 ) ) and // Last 4 digits List.AllTrue( List.Transform( Text.ToList(Text.End(Prefix, 4)), each Character.ToNumber(_) >= 48 and Character.ToNumber(_) <= 57 ) ), AfterPrefix = if ValidPrefix then Text.Range(t, 8) else t, TrimmedAfter = if ValidPrefix then Text.TrimStart(AfterPrefix) else t, // Lookahead equivalent: next char must be non-digit (or absent) NextCharValid = Text.Length(AfterPrefix) = 0 or not List.Contains({"0".."9"}, Text.Start(TrimmedAfter, 1)), Result = if ValidPrefix and NextCharValid then TrimmedAfter else t in Result
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak11 hours agoNew MemberNew5Views0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak11 hours agoNew MemberNew7Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak12 hours agoNew MemberNew13Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak12 hours agoNew MemberNew5Views0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak12 hours agoNew MemberNew3Views0likes0Comments