30 Comments
- bhobgood2New MemberIn the transformation area of replace values it would be nice to be able to use a wildcard in the value to replace field. For example we have transaction descriptions like... Placement [EB-12375596] and it would be great to be able to enter something like... Placement% to capture all of these. I've got several work-arounds but this would be a great feature for those who don't know SQL.
- amicoda1New MemberMust have feature!!
- lucio_jungesNew MemberMust have feature!!
- fd134749New MemberWould prefer Regex
- josef_jurakNew Member
Please add text transformation and filtering ability based on open and common standard Regular expression to Data Factory (Power Query engine). Currently there are only very simple excel-like function, which are unusable for real work.
- josef_jurakNew Member
Please vote here and on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=1395c308-7f92-4321-8e35-6cd04d7108bf
- fbcideas_migusrNew MemberStatus added:Needs Votes
- chrisread79Advocate I
We desperately need the REGEX functions added to Power Query. Excel has already had these added in 2024 (REGEXTEST, REGEXEXTRACT, and REGEXREPLACE). See for reference Excel REGEX blog.
Yes, Python can be used for this, but this requires a Personal Gateway.
Yes, the javascript hack can be used for Power BI Desktop, but this does not refresh in the Power BI service.
This is a basic function that has also been applied in Power Apps Power Fx.
- PDesouzaNew Member
It would be super useful to be able to create a conditional column in power query using a search function that contains wildcards.
Example:
I want to sort complaints about coffee. Some people write the coffee is really bad, others write the coffee is bad, others write the coffee is good. I would like to be able to search "Coffee*bad" to create a conditional column based solely off of people who say coffee and bad, but not the people who say coffee * good.
It has many uses and of course can be done with RegEx in VBA, but sometimes its completely impractical if using powerbi and need refreshing reports without running VB scripts.
- fbcideas_migusrNew MemberStatus added:New
- Martin_KmecNew Membersame idea here: https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/8892295-regular-expressions-support-in-power-query
- fbcideas_migusrNew MemberStatus added:Needs Votes
- VEGA_Y_J_CHENNew MemberStrongly support on this initiative! PowerQuery is the most suitable tookit from PowerPlatform while considering some needs of text extraction in Regex way. This proposal is aligned with design of Making ETL(Extract/ Transform / Load) within PowerQuery. What's more, I think it can be a puzzle to complete the Product roadmap while Power Platform building more advanced features vs. competitors.
- drotherNew MemberRegex is a critical tool for manipulating data. I strongly support regex in PowerQueryl
- DavidPearceRegular VisitorI was given by my AI Chatbot the use of two functions that don't exist, Text.Matches and Text.Like - I was *really* excited since they seemed logical. Hard to believe regex isn't native. Being an analyst I have no experience in trying to use a personal gateway to a Python script... Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Matches([Sub Account], "^\d{6}-\d{3}$") then [Sub Account] else if Text.Matches([Sub Account], "^\d{6}-\d{3}-\d$") then [Sub Account] else null ) then = Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Like([Sub Account], "??????-???") then [Sub Account] else if Text.Like([Sub Account], "??????-???-#") then [Sub Account] else null )
- zack-cRegular Visitor
When dealing with messy data, it's often paramount to do some text transforms to clean it up a little. I end up writing a lot of regex and just having ChatGPT translate it into Power Query steps/functions because manually transforming text is such a pain in Power Query without regex. It's very quick for me to write regex due to how close the final syntax usually is to the text I'm matching.
For context, a simple regex-based prefix matcher like this:
^[A-Z]{3}-\d{4}\s*(?=\D)Translates into a Power Query function along the lines of:
(text as nullable text) as nullable text => let t = text, Prefix = if t <> null and Text.Length(t) >= 8 then Text.Start(t, 8) else "", ValidPrefix = Text.Length(Prefix) = 8 and Text.Middle(Prefix, 3, 1) = "-" and // First 3 uppercase letters List.AllTrue( List.Transform( Text.ToList(Text.Start(Prefix, 3)), each Character.ToNumber(_) >= 65 and Character.ToNumber(_) <= 90 ) ) and // Last 4 digits List.AllTrue( List.Transform( Text.ToList(Text.End(Prefix, 4)), each Character.ToNumber(_) >= 48 and Character.ToNumber(_) <= 57 ) ), AfterPrefix = if ValidPrefix then Text.Range(t, 8) else t, TrimmedAfter = if ValidPrefix then Text.TrimStart(AfterPrefix) else t, // Lookahead equivalent: next char must be non-digit (or absent) NextCharValid = Text.Length(AfterPrefix) = 0 or not List.Contains({"0".."9"}, Text.Start(TrimmedAfter, 1)), Result = if ValidPrefix and NextCharValid then TrimmedAfter else t in Result
Recent ideas
Enable writing PowerQuery type time (from Dataflow Gen2) to Warehouse type time
Currently the UI throws an error while I am trying to write Data typed as "time" in Power Query to a Fabric Warehouse. I would prefer to import data typed as "time" in Dataflow Gen2 PowerQue...pyd4life3 hours agoAdvocate INew103Views2likes1CommentAllow sharing of Office 365 Email (Outlook) cloud connections in Manage connections and gateways
The Problem When creating an Office 365 Email (Microsoft Outlook) cloud connection in Manage connections and gateways, it is impossible to share the connection with other users or security groups. A...akim-microsoft4 hours agoMicrosoft EmployeeNew233Views4likes1CommentShow the workspace name for duplicate SQL endpoints with the same name in Desktop PowerBI
When multiple Fabric SQL endpoints have the same name, Power BI Desktop should display the source workspace name alongside the endpoint name during connection and in imported table metadata, so users...WorkFull224 hours agoAdvocate INew1View0likes0Comments