Forum Discussion

KarolPapaj's avatar
KarolPapaj
New Member
2 years ago
Solved

Cannot load delta lake table into Fabric created by Streaming job

Hi all, I'm using event hub with streaming analytics job, which is capturing incoming messages and stores it into delta lake table stored in ADLS Gen2 storage. Incoming json message contains 5 neste...
data engineering
one lake
  • HimanshuS-msft's avatar
    HimanshuS-msft
    2 years ago

    Hi KarolPapaj 
    I did a quick check if this is an issue with the JSON . I did took that the JSON which you shared and tried to read it from the notebook . Honestly I thought it will fail as you had mentioned , surprisingly it did worked fine 🙂 

    df = spark.read.option("multiline", "true").json("Files/Karol.json")
    # df now is a Spark DataFrame containing JSON data from "Files/Karol.json".
    display(df)

     

     

    Now since you are using the ASA to create the delta table , I think it will best if you create a support ticket and let them investigate this .

    Thanks 
    Himanshu 

     

HimanshuS-msft's avatar
HimanshuS-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hi KarolPapaj 
I did a quick check if this is an issue with the JSON . I did took that the JSON which you shared and tried to read it from the notebook . Honestly I thought it will fail as you had mentioned , surprisingly it did worked fine 🙂 

df = spark.read.option("multiline", "true").json("Files/Karol.json")
# df now is a Spark DataFrame containing JSON data from "Files/Karol.json".
display(df)

 

 

Now since you are using the ASA to create the delta table , I think it will best if you create a support ticket and let them investigate this .

Thanks 
Himanshu