Forum Discussion

rzga's avatar
rzga
Frequent Visitor
2 years ago

MS Fabric Spark WriteStream:"WorkspaceId and ArtifactId should be either valid Guids or valid Names"

We are trying to use the spark streaming, to get the json file from ADLS and ingest it in fabric, for that we are usign  spark:       df_streaming = (spark.readStream .schema(schema) .f...
Need Help
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi rzga ,

 

As far as I know, this issue should be caused that you didn't add the ID of the current workspace and the ID of the artifact being used in the query.

And we couldn't find both properties in your query, please check it and try again.

For reference: NotebookUtils (former MSSparkUtils) for Fabric - Microsoft Fabric | Microsoft Learn

 

Best Regards,
Rico Zhou

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

rzga's avatar
rzga
Frequent Visitor
2 years ago

Hi Anonymous , thank you for the help, How can I do it, as the spark.readstream and writestream does not have this option parameters, did you have any example using sparkstream to add this workspaceID and ArtifactID?