Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago

Can you remove a dataflow datasource when it is no longer used in the dataflow?

I have created several data flows using azure blob storage and then linked them to another data flow that combines them via linked entities.  I do some transformations from queries that reference the linked entities.    The problem is, now that I'm not using azure blob storage in the linked entity data flow it still appears in the settings of that data flow.  

 

Is there a way to remove that reference from the settings?  Or, do the linked entities still pull data from the original source; that is, the azure blob?

 

Thanks!

 

Dataflow datasource persists but not used

12 Replies

  • Hi,

     

    I'm also facing the same problem. Please support on this topic.

    • datafitters_com's avatar
      datafitters_com
      New Member

      I had the same issue. You cannot remove datasources from Dataflows....thats really a missing feature / bug.

       

      the workaround is to download the JSON, then import the JSON again (it will duplicate your dataflow, but without the obsolete data source). then you can rework your dataflows that might connect to (depend on) this dataflow, and after that remove the old dataflow.

      • derrick777's avatar
        derrick777
        Icon for Advocate I rankAdvocate I

        Yes, that seems to work. Unfortunatly, a new guid will be created and I have to alter subsequent dataflows which reference this one, and have to wait again for hours for validation.

        Later in production when people use this dataflow, the workaround won't help, since they reference by guid as well.

    • JayWhy's avatar
      JayWhy
      New Member

      Hi, your solution worked for me when it came to database connections (i.e. ODBC, Redshift, SQL, etc) but not for web connections, such as sharepoint links. I did find a method that worked for me, so hopefully it could help you or others:

      1. In your workspace, click on the cog at the top right and select Manage connections and gateways (should be under the Resources and extensions header)
      2. In the Data (preview) page, go through all the data connections and find the one that you want to remove
      3. Select it by clicking on the radio button on the left
      4. Scroll back up to the top of the page and click Remove to remove
      5. Repeat for each additional data connection (yes, you can only do this one at a time)

      Hope that helps

      • SGriga's avatar
        SGriga
        Icon for Advocate I rankAdvocate I

        Hi JayWhy,

        Your solution works just great! You have saved me a lot of grief. Thank you so much for your response!

         

        Have a great day!

        Slava

  • v-diye-msft's avatar
    v-diye-msft
    Icon for Community Support rankCommunity Support

    Hi Anonymous 

     

    When you link entities between dataflows, you can reuse entities that have already been ingested, cleansed and transformed by other dataflows owned by others without the need to maintain that data. The linked entities simply point to the entities in other dataflows, and do not copy or duplicate the data.

     

    That means linked entities still pull data from the original source.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Gotcha.

       

      The issue I am facing isn't that the linked entity is or isn't pulling data from the original source.  It is that I can't remove a reference to the original source I created in the dataflow after changing it to a linked entity.  The dataflow continues to require the blob credentials even though the data flow no longer uses that data source.

       

      How can you remove the data source from the settings area after removing it from the data flow?  It still seems to remember the data source in the settings.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi,

    I'm also having the same issue. Can anyone help or is it possible?