Forum Discussion

FrederickD's avatar
FrederickD
New Member
7 years ago
Solved

Dataflow Custom Entities in schematized CDM

Hi,

 

When I read the first articles about Dataflow, Microsoft mentions "Dataflows support the CDM by offering easy mapping from any data in any shape into the standard CDM entities, such as Account, Contact etc. Dataflows also land the data, both standard and custom entities, in schematized CDM form."

 

I am not able to find a way to use custom entities. I can only see "map to standard" and standard entities. I am currently using the build in Data Lake (and not the Azure Data Lake storage option).

 

Thanks for your help!

 

Regards,

 

Frederick

  • Anonymous's avatar
    Anonymous
    7 years ago

    Hi FrederickD,

     

    So you mean you want to extract particular fields from different datasorces and try to union them as one entity with all records from different datasorue fields?

     

    If that is a case, current data flow seems not support advanced operations in M query formula.

     

    Regards,

    Xiaoxin Sheng

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi FrederickD,

     

    I think it means you can direct get data from created common data model entities which host in 'common data service for apps' side.

     

    If this is a case, you can choose that connector to get data from common data service for apps.

    How to use the Common Data Model

     

    Regards,

    Xiaoxin Sheng

    • FrederickD's avatar
      FrederickD
      New Member

      Hi Anonymous

       

      Thx for the reply.

       

      Actually I am trying to solve another problem, I will explain it with an example.

       

      - I have 3 systems containing accounts.

      - I want a global repository (Data Lake Gen2) to store all the account info in a uniform and standardized way.

      - The account structure that I want is not fitting for 100% in the standard account entity of CDM.

       

      So in the end I want 1 place where all the account records are stored in 1 type of entity. 

       

      I know how to connect dataflow to our company Azure Data Lake Gen 2, but I am not finding a way to store the data at the same place in a custom entity model (so from data lake perspective: everything (data from the 3 systems) is stored in the same CDM folder with custom entity definition).

       

      Kind regards,

       

      Frederick

       

       

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi FrederickD,

         

        So you mean you want to extract particular fields from different datasorces and try to union them as one entity with all records from different datasorue fields?

         

        If that is a case, current data flow seems not support advanced operations in M query formula.

         

        Regards,

        Xiaoxin Sheng