Forum Discussion

kirah2128's avatar
kirah2128
Resolver I
2 years ago
Solved

One Large Text File Parsing 200MB Error 500

Dear Community, Have you encountered this problem? I'm processing a text file and using the code below. The script is running successfuly on my laptop but with Fabric it's not working. Do you have o...
data engineering
data warehouse
  • kirah2128's avatar
    kirah2128
    2 years ago

    Dear Everyone,

     

    the problem is solved =D by removing the print() function. 

    # print(contents)

    For some reason the fabric can't handle large concatinated string. 

HimanshuS-msft's avatar
HimanshuS-msft
Microsoft Employee
2 years ago

Hello kirah2128 
Are you sure that its the size of the file which which is creating the issue ? I am just trying to make sure that you have tried to process a smaller file and if that works . 
Also I am assuming that the path of the file ( may be the file is in Lakehouse ) is correct . 
I will wait to hear back on this from you .
Thanks 
Himanshu 

kirah2128's avatar
kirah2128
Resolver I
2 years ago

I tried with smaller file around 2mb and its working just fine. Both files are located in the same folder location. But the one I raised is still not working.