Forum Discussion

ToddChitt's avatar
ToddChitt
Super User
1 year ago
Solved

Re: 'The dataflow has never been published.' error when using 'Save as Dataflow Gen2 (CI/CD)' featur

I, too, am having issues with Dataflow Gen2 (CI/CD).  I created one with a Parameter, and referenced that paramter in one of the PowerQuery steps. It works. There is a Data Destination to a Warehou...
  • miguel's avatar
    miguel
    1 year ago

    Hi ToddChitt !


    I have taken the liberty of moving the message that you've created to it's own topic so we can address your inquiry which is quite specific to a new feature that we recently introduced. This feature is Dataflow parameters and this feature is currently in public preview. To enable your Dataflow to accept parameters, you need to enable this capability within your Dataflow. You can read more about this setting and the feature from the documentation below:

    https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-parameters

    Could you please confirm if the setting was enabled in the parameters section of the options dialog? 

    once you enable it, you should be able to pass parameter values to your Dataflow.

     

    Edit: Forgot to mention that we're currently working on improving this experience on the pipelines side as well as the error messages that may come from it.

ToddChitt's avatar
ToddChitt
Super User
1 year ago

miguel 

Thanks. I did find the solution last night after some research, and it is exactly in line with what you suggested, so it is marked at a Solution.

From this site: Use public parameters in Dataflow Gen2 (Preview) - Microsoft Fabric | Microsoft Learn

There is this comment in the Considerations and Limitations:

  • Parameters that affect the resource path of a data source or a destination are not supported. Connections are linked to the exact data source path defined in the authored dataflow and can't be currently override to use other connections or resource paths.

    Any idea if that will ever change? Is this a temporary limitation?
    Also, when you create a new Dataflow Gen2 (CI/CD), it does NOT have the "(preview)" qualifying text anymore. Is it considered GA?
    And finally, there is a known bug where by if you want to create a original Dataflow Gen2 (i.e.: NOT CI/CD) then you need to do it from the root folder of the Fabric Workspace. If you do it from a Folder, it defaults to CI/CD and the check-box is disabled:

    (Commentary: Still a ways to go before this is of any use.)