ADF vs Fabric

Hi MatrixMan112 
Thanks for using Fabric Community.

Switching from Azure Data Factory (ADF) to Fabric can have several benefits, but it also depends on your specific use case and requirements. Here are some points to consider:

1. Performance: Fabric is designed to handle large-scale data processing and analytics workloads, and it can provide better performance for high-volume dataflows compared to ADF.

2. Flexibility: Fabric provides a more flexible and interactive environment for data exploration and transformation. It supports both batch and streaming data processing, and it allows you to use a variety of languages and libraries, including Python, Scala, and SQL.

3. Integration: Fabric integrates well with other Azure services, making it easier to build end-to-end data pipelines. It also supports Delta Lake, which provides ACID transactions, scalable metadata handling, and unified batch and streaming data processing.

4. Cost: Depending on your workload, Fabric could potentially be more cost-effective than ADF, especially for large-scale data processing tasks.

However, as you mentioned, Fabric is still in preview and there might be some bugs or features that are not fully developed yet. Our engineering team is actively working on improving dataflow performance. We're constantly optimizing the platform and addressing bugs.

In terms of the performance issues you’re experiencing with dataflows, there could be several factors at play, including the size and complexity of your data, the configuration of your Spark cluster, and the specific transformations you’re applying. It might be worth exploring ways to optimize your dataflows, such as partitioning your data, optimizing your transformations, or scaling up your Spark cluster.

You can refer to these links for more information:
https://learn.microsoft.com/en-us/fabric/data-factory/compare-fabric-data-factory-and-azure-data-factory
https://learn.microsoft.com/en-us/fabric/data-factory/frequently-asked-questions
https://www.linkedin.com/pulse/microsoft-azure-data-factory-adfms-fabric-vs-synapse-analytics-vgogf/
https://www.casewhen.co/blog/data-factory-showdown-fabric-vs-azure

I hope this helps! If you have any more questions, feel free to ask.