Forum Discussion

GeekAlfPro's avatar
GeekAlfPro
Helper V
8 months ago

CI/CD dataflow issue

Hello,   In Fabric, i have 2 workspaces (tests and prod) i have azure devops repos (tests and prod) i use the pipeline deployment to switch between both. i have a datapipeline that calls 4 dataf...
Dataflow
Need Help
GeekAlfPro's avatar
GeekAlfPro
Helper V
8 months ago

Hi,

 

i also tried to hard code the ws and wh id's.

it works for the df that get data from a sharepoint list but not for the one that get data from an excel file on sharepoint.

v-sshirivolu's avatar
v-sshirivolu
Community Support
8 months ago

Hi GeekAlfPro ,

Thanks for sharing all the details. To help troubleshoot, you can create a temporary query in your Dataflow to check what Workspace and Warehouse IDs are actually being used in Prod. For example, create a blank query with this M code:

let
wsId = Variable.ValueOrDefault("$(/**/YourVariableLibrary/ws_Dirnum_id)", "Unknown"),
whId = Variable.ValueOrDefault("$(/**/YourVariableLibrary/wh_Dirnum_id)", "Unknown")
in
[WorkspaceId = wsId, WarehouseId = whId]
This will show the current values, and you can remove the query once you’ve verified them.

Regarding the Excel file issue on SharePoint, hard-coding the IDs works for SharePoint lists but can fail for Excel files because the connection needs proper access to the site or folder. Make sure that the credentials or service identity used in Prod has read permissions to the Excel file location.

Once you’ve run the temporary query and confirmed the IDs are correct, check that the Excel file credentials are valid. You can also try using a smaller test Excel file to rule out any file specific problems. If the IDs and credentials are set up correctly, the Dataflow should validate and refresh successfully.

 

  • v-sshirivolu's avatar
    v-sshirivolu
    Community Support
    8 months ago

    Hi GeekAlfPro ,

    I hope the information provided above assists you in resolving the issue. If you have any additional questions or concerns, please do not hesitate to contact us. We are here to support you and will be happy to help with any further assistance you may need.

     

  • GeekAlfPro's avatar
    GeekAlfPro
    Helper V
    8 months ago

    Hello v-sshirivolu 

     

    i was out my office this week,

    i will try next one.

    i'll give you feedback 

     

    Thanks again

  • v-sshirivolu's avatar
    v-sshirivolu
    Community Support
    8 months ago

    Hi GeekAlfPro ,
    I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.

  • GeekAlfPro's avatar
    GeekAlfPro
    Helper V
    8 months ago

    Hello v-sshirivolu 

     

    i tried the temp query with your code 

     

    let
wsId = Variable.ValueOrDefault("$(/**/YourVariableLibrary/ws_Dirnum_id)", "Unknown"),
whId = Variable.ValueOrDefault("$(/**/YourVariableLibrary/wh_Dirnum_id)", "Unknown")
in
[WorkspaceId = wsId, WarehouseId = whId]

    But it displays "Unknown"

     

    it seems that the code is ok