Forum Discussion

pbi_taken's avatar
pbi_taken
Icon for Helper I rankHelper I
1 year ago
Solved

FUAM Load_Items_E2E Error in Copy Data

Hi. I'm trying to get the FUAM package to work and after an update I keep getting errors. The first one I have narrowed it down to is the get items part of Load_items.  My source is the active_item...
Need Help
Pipeline
  • pbi_taken's avatar
    pbi_taken
    1 year ago

    Hi all. 
    Solution was just to upload the notebook "Deploy_FUAM" and run it again. This solved the issue, so I'm guessing it was something with an update that has been done to this notebook.

    Thanks to everyone that helped!

mabdollahi's avatar
mabdollahi
Icon for Advocate IV rankAdvocate IV
1 year ago

Hi pbi_taken 
The column was added in 2025-03-01 as per https://github.com/GT-Analytics/fuam-basic/releases#:~:text=New%20column%20in,item%20more%20efficiently 

How are you loading the data? I see in copy data, can you consider Notebook instead?

If you are loading the data in notebook, then you can simply remove the column before loading to start working on the table.

df = spark.read.table("FUAM_Lakehouse.active_items")
df = df.drop("creatorPrincipal")  
df.write.format("delta").saveAsTable("TargetTable")

You can also try to convert the column in a text format before writing to another table.

 

I hope this answers your question.

Please feel free to mark it as correct solution if it does and kodus. 🙂 

 

Regards,

Mehrdad Abdollahi

  • pbi_taken's avatar
    pbi_taken
    Icon for Helper I rankHelper I
    1 year ago

    but this is an out of the box solution and probably should not need to do my own editing of this? So it's either outdatet or I have edited the connection and made an error

    • mabdollahi's avatar
      mabdollahi
      Icon for Advocate IV rankAdvocate IV
      1 year ago

      pbi_taken as you know it is built by community experts, have you logged it as an error under the comitted version on GitHub? As you might know it was written by community.