- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dealing with "record" columns in a Dataflow gen2
I have this dataflow that pulls from a Snowflake destination:
As you can see in the screenshot, a few of the columns are of "record" type. Fabric doesnt seem to like these formats and automatically deletes them sometimes by adding code that looks like this:
Table.RemoveColumns(#"From Value", Table.ColumnsOfType(#"From Value", {type table, type record, type list, type nullable binary, type binary, type function}))
Makes sense, as best as I can understand it the data needs to be flat, almost csv like.
So the way I understand it, I need to expand out those records, maybe in their own table. So I copied that query and selected just two columns:
When I tell Fabric to expand that contact identifier column and grab every column inside of it:
it doesn't "really" expand everything. Here's what I mean, here's whats visible immediately after that:
That "step is not supported by fast copy" and still wont be able to save into a Lakehouse. What do I do?
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
filter out all null value, then expand the record column again.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
looks like this might be a record inside a record. See if you can grab "value" instead.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Silly question, how?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
filter out all null value, then expand the record column again.

Helpful resources
Subject | Author | Posted | |
---|---|---|---|
07-11-2024 03:18 AM | |||
02-28-2024 02:31 AM | |||
09-17-2017 01:43 AM | |||
07-21-2024 01:26 AM | |||
03-04-2024 02:35 AM |