Let's say you have one or more CSV files and you want to convert them to Parquet format and also upload them to a Lakehouse table. The available options for this in the Fabric environment are either through a notebook or a data pipeline but there are aren't any pre-built out-of-the-box solutions.

For instance, you might have an application that generates CSV files, and you want to upload the CSV data directly to the Lakehouse at that moment. One approach could be to make application store the CSV files in ADLS2 storage and use an event-based pipeline triggered by storage events to upload the data to the Lakehouse. However, what if storing the files on cloud storage isn't an option and the files will always be stored on a on prem storage ?

Article was originally publised here

One Microsoft Fabric announcement during Microsoft Ignite that I think should get more attention is the fact that Sustainability data solutions in Fabric is now Generally Available (GA).

For those who are not aware Sustainability data solutions in Fabric is one of solutions offered as part of the Industry Solutions workload. Which is now also GA and officially recognized as a Microsoft Fabric workload.

Microsoft Fabric architecture diagram with Industry Solutions highlighted

I intend to cover why I think this is significant in this post. Along the way I share some links.

It’s official – the Fabric Analytics certification is the fastest growing in Microsoft history!  But the associated DP-600 exam is a very broad syllabus, covering everything from data ingestion/transformation using T-SQL and KQL (for Real-time intelligence), to semantic modelling and managing a Fabric environment using CI/CD.

In this series of articles, I cover some of the key topics under each of the three syllabus areas (Maintaining Data Analytics Solutions, Prepare Data and Building Semantic models) with examples and scenarios. These are based on a DP-600 exam preparation guide prepared by Abu Bakar, which is available for free along with over 200 practice questions at MS Fabric Training (www.msfabrictraining.com).

This article is focused on Module 3 - Implement and manage semantic models - which comprises 25-30% of the overall exam syllabus

It’s official – the Fabric Analytics certification is the fastest growing in Microsoft history!  But the associated DP-600 exam is a very broad syllabus, covering everything from data ingestion/transformation using T-SQL and KQL (for Real-time intelligence), to semantic modelling and managing a Fabric environment using CI/CD.

In this series of articles, I cover some of the key topics under each of the three syllabus areas (Maintaining Data Analytics Solutions, Prepare Data and Building Semantic models) with examples and scenarios. These are based on a DP-600 exam preparation guide prepared by Abu Bakar, which is available for free along with over 200 practice questions at MS Fabric Training (www.msfabrictraining.com).

This article is focused on Module 2 - Prepare Data - which comprises 40-45% of the overall exam syllabus

It’s official – the Fabric Analytics certification is the fastest growing in Microsoft history!  But the associated DP-600 exam is a very broad syllabus, covering everything from data ingestion/transformation using T-SQL and KQL (for Real-time intelligence), to semantic modelling and managing a Fabric environment using CI/CD.

In this three part series of articles, I cover some of the key topics under each of the three syllabus areas (Maintaining Data Analytics Solutions, Prepare Data and Building Semantic models) with examples and scenarios. These are based on a DP-600 exam preparation guide prepared by Abu Bakar and I, which is available for free along with over 200 practice questions at MS Fabric Training (www.msfabrictraining.com).

This article covers Module 1 - Maintaining Data Analytics solutions - which comprises 25-30% of the overall syllabus.