Forum Discussion

kewaynes333's avatar
kewaynes333
Helper I
2 years ago

Need Help with Dynamic Folder Strcuture for Files Loaded to a LakeHouse

I have a few hundred thousand house records as parquet files in an ALDS container. I want to load these files into a LakeHouse as files. I'm assuming it's best practice to load them into the LH using...
Need Help
pipelines
kewaynes333's avatar
kewaynes333
Helper I
2 years ago

Hi,

 

Thanks for the response and guidance. I run into an error saying that the convertTimeZone function doesn't accept an integer. I believe this is because my dateSold column is in Unix timestamp format (milliseconds, I believe).

 

I've tried to account for this:

@concat(formatDateTime(addSeconds('1970-01-01T00:00:00Z', div(item().dateSold, 1000)), 'yyyy/MM'), '/', item().tableName)

 

But now I get this error:

 

The expression 'concat(formatDateTime(addSeconds('1970-01-01T00:00:00Z', div(item().dateSold, 1000)), 'yyyy/MM'), '/', item().tableName)' cannot be evaluated because property 'tableName' doesn't exist, available properties are 'dateSold, propertyType, lotAreaValue, address, imgSrc, price, bedrooms, longitude, latitude, listingStatus, zpid, listingSubType, contingentListingType, daysOnZillow, bathrooms, livingArea, country, currency, lotAreaUnit, hasImage'.

 

 

Any thoughts?

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi kewaynes333 
Error Property ‘tableName’ doesn’t exist:
The error message indicates that the property tableName does not exist in the current context. The available properties are ‘dateSold, propertyType, lotAreaValue, address, imgSrc, price, bedrooms, longitude, latitude, listingStatus, zpid, listingSubType, contingentListingType, daysOnZillow, bathrooms, livingArea, country, currency, lotAreaUnit, hasImage’. If you intended to use one of these existing properties, you should replace tableName with the correct property name.


@concat(formatDateTime(addSeconds('1970-01-01T00:00:00Z', div(item().dateSold, 1000)), 'yyyy/MM'), '/', item().<correct_property_name>)
Replace <correct_property_name> with the actual property you want to use. If you still encounter issues this might require a deeper investigation from our engineering team about your workspace, and the logic behind it to properly understand what might be happening.

Please go ahead and raise a support ticket to reach our support team: https://support.fabric.microsoft.com/support
Please provide the ticket number here as we can keep an eye on it.
Thank you.

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi kewaynes333 
    We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
    Thanks

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi @kewaynes333 
      We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
      Thanks