30 Comments
- bhobgood2New MemberIn the transformation area of replace values it would be nice to be able to use a wildcard in the value to replace field. For example we have transaction descriptions like... Placement [EB-12375596] and it would be great to be able to enter something like... Placement% to capture all of these. I've got several work-arounds but this would be a great feature for those who don't know SQL.
- amicoda1New MemberMust have feature!!
- lucio_jungesNew MemberMust have feature!!
- fd134749New MemberWould prefer Regex
- josef_jurakNew Member
Please add text transformation and filtering ability based on open and common standard Regular expression to Data Factory (Power Query engine). Currently there are only very simple excel-like function, which are unusable for real work.
- josef_jurakNew Member
Please vote here and on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=1395c308-7f92-4321-8e35-6cd04d7108bf
- fbcideas_migusrNew MemberStatus added:Needs Votes
- chrisread79Advocate I
We desperately need the REGEX functions added to Power Query. Excel has already had these added in 2024 (REGEXTEST, REGEXEXTRACT, and REGEXREPLACE). See for reference Excel REGEX blog.
Yes, Python can be used for this, but this requires a Personal Gateway.
Yes, the javascript hack can be used for Power BI Desktop, but this does not refresh in the Power BI service.
This is a basic function that has also been applied in Power Apps Power Fx.
- PDesouzaNew Member
It would be super useful to be able to create a conditional column in power query using a search function that contains wildcards.
Example:
I want to sort complaints about coffee. Some people write the coffee is really bad, others write the coffee is bad, others write the coffee is good. I would like to be able to search "Coffee*bad" to create a conditional column based solely off of people who say coffee and bad, but not the people who say coffee * good.
It has many uses and of course can be done with RegEx in VBA, but sometimes its completely impractical if using powerbi and need refreshing reports without running VB scripts.
- fbcideas_migusrNew MemberStatus added:New
- Martin_KmecNew Membersame idea here: https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/8892295-regular-expressions-support-in-power-query
- fbcideas_migusrNew MemberStatus added:Needs Votes
- VEGA_Y_J_CHENNew MemberStrongly support on this initiative! PowerQuery is the most suitable tookit from PowerPlatform while considering some needs of text extraction in Regex way. This proposal is aligned with design of Making ETL(Extract/ Transform / Load) within PowerQuery. What's more, I think it can be a puzzle to complete the Product roadmap while Power Platform building more advanced features vs. competitors.
- drotherNew MemberRegex is a critical tool for manipulating data. I strongly support regex in PowerQueryl
- DavidPearceRegular VisitorI was given by my AI Chatbot the use of two functions that don't exist, Text.Matches and Text.Like - I was *really* excited since they seemed logical. Hard to believe regex isn't native. Being an analyst I have no experience in trying to use a personal gateway to a Python script... Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Matches([Sub Account], "^\d{6}-\d{3}$") then [Sub Account] else if Text.Matches([Sub Account], "^\d{6}-\d{3}-\d$") then [Sub Account] else null ) then = Table.AddColumn( #"Trimmed Text", "Mailrun", each if Text.Like([Sub Account], "??????-???") then [Sub Account] else if Text.Like([Sub Account], "??????-???-#") then [Sub Account] else null )
- zack-cRegular Visitor
When dealing with messy data, it's often paramount to do some text transforms to clean it up a little. I end up writing a lot of regex and just having ChatGPT translate it into Power Query steps/functions because manually transforming text is such a pain in Power Query without regex. It's very quick for me to write regex due to how close the final syntax usually is to the text I'm matching.
For context, a simple regex-based prefix matcher like this:
^[A-Z]{3}-\d{4}\s*(?=\D)Translates into a Power Query function along the lines of:
(text as nullable text) as nullable text => let t = text, Prefix = if t <> null and Text.Length(t) >= 8 then Text.Start(t, 8) else "", ValidPrefix = Text.Length(Prefix) = 8 and Text.Middle(Prefix, 3, 1) = "-" and // First 3 uppercase letters List.AllTrue( List.Transform( Text.ToList(Text.Start(Prefix, 3)), each Character.ToNumber(_) >= 65 and Character.ToNumber(_) <= 90 ) ) and // Last 4 digits List.AllTrue( List.Transform( Text.ToList(Text.End(Prefix, 4)), each Character.ToNumber(_) >= 48 and Character.ToNumber(_) <= 57 ) ), AfterPrefix = if ValidPrefix then Text.Range(t, 8) else t, TrimmedAfter = if ValidPrefix then Text.TrimStart(AfterPrefix) else t, // Lookahead equivalent: next char must be non-digit (or absent) NextCharValid = Text.Length(AfterPrefix) = 0 or not List.Contains({"0".."9"}, Text.Start(TrimmedAfter, 1)), Result = if ValidPrefix and NextCharValid then TrimmedAfter else t in Result
Recent ideas
Data Pipelines - Run only selected activities
For debugging and testing pipeline activities during development, allow us to select one or multiple activities and run only the selected pipeline activities. For example, I'm working on editing ...frithjof_v14 hours agoCommunity ChampionNew617Views11likes2CommentsSemantic model connection bindings should be in source control (Git)
Semantic model data source connection bindings should be source controlled. A semantic model can contain multiple data source references, each of which can be mapped to a separate Fabric data connec...frithjof_v22 hours agoCommunity ChampionNew19Views1like0CommentsBulk changing column names in Visualizations Pane
We often use raw/api column names or measures with a set nomenclature to be consistent and to keep track of them but we do not want to display these names in the visuals. Currently we have to change ...vishal1401971 day agoFrequent VisitorNew6Views0likes0Comments