Forum Discussion
What is AzureDataLakeStorage under OneLake Catalog while setting data destination in Copy Job?
- 9 months ago
Hi JasleenKaur ,
I believe what you are seeing is the category of connections related to AzureDataLakeStorage, in which you most likely have created some. In my example I have CommonDataService (dataverse) and SnowFlake. When I select these I see all of the connections I own or have been shared for those data sources. And when selecting one, the entire destination configuration of the copy data activity is changed to either source specifics for Dataverse or Snowflake.
So this is not a storage destination for your underlying OneLake. In general all data stored in OneLake is delta/parquet at least for LHs and DWs.
Br
Asger
Hi JasleenKaur,
this option is for when you want to use a Fabric Copy Activity to write data back directly to an Azure Data Lake Storage inside Azure. It probably appears under OneLake catalog because OneLake was built on top of ADLS Gen2 and uses the same APIs and SDKs:
So regarding "is it OneLake" => Yes and no: OneLake is ADLS Gen2 under the hood (but with an added SaaS layer, governance features etc.).
Regarding your other questions:
- If you want to store your data automatically in delta parquet format you need to write it to a warehouse or lakehouse inside your OneLake.
- If you write it back directly to ADLS, the output depends on what you specificy in the Copy Job (CSV, Parquet, Avro etc.).
- If you write your data back directly to ALDS Gen2 without a Lakehouse, Warehouse or Eventhouse in beween doesn't trigger any compute engine; It's just a file storage.