frithjof_v
1 year agoCommunity Champion
Status:
Need Clarification
Dataflow Gen2 Fast Copy: Add timestamp column
When ingesting data, we wish to add a "IngestedDateTimeUtc" column.
So we can keep track of when the data was ingested.
Currently, this is not possible with Dataflow Gen2 Fast Copy. Please make it possible 🙂 Thanks!
2 Comments
- miguelCommunity AdminStatus changed:NewtoNeed Clarification
You can do this today by adding a custom column that leverages the function below:
DateTime.LocalNow - PowerQuery M | Microsoft Learn
You should be able to leverage this even when FastCopy is at play. Would you mind giving this a try and share with us your findings?
- frithjof_vCommunity ChampionThanks, I will try this once I find the time ☺️
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak1 hour agoNew MemberNew1View0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak1 hour agoNew MemberNew3Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak1 hour agoNew MemberNew2Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak2 hours agoNew MemberNew1View0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak2 hours agoNew MemberNew1View0likes0Comments