Forum Discussion

Matthew_G's avatar
Matthew_G
Advocate I
2 years ago
Solved

Data Pipeline executes multiple times

I have a pipleline and when it runs, either manually or scheduled, it executes multiple times. This seems to occur with any data pipeline we create. Is there something I am doing wrong?

 

To test I created a stored proc in a warehouse that inserts a date into a table. 

 

create table dbo.runCheck (
runDate DATETIME2(0)
)

create procedure dbo.p_insertDate
as
insert into dbo.runCheck(runDate)
select getdate()
GO
 
I then create a new data pipeline and add the stored proc activity.

 

 Confrim table is empty

 

Execute the pipline and check monitoring hub, I can see it is running multiple times 

 

 

Check the count again and I see there are multiple inserts

I'm not sure if I am doing something wrong or if there is a bug.

pipelines

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Matthew_G 
    Thanks for using Fabric Community. 
    Apologies for the issue you have been facing. Currently this is not a bug.
    When I tried to repro the scenario, the pipeline ran only once.




    This might require a deeper investigation from our engineering team about your workspace, the pipeline details and the logic behind it to properly understand what might be happening. 

    Please go ahead and raise a support ticket to reach our support team:

    https://support.fabric.microsoft.com/support
    Please provide the ticket number here as we can keep an eye on it.

    Thank you.

    • Matthew_G's avatar
      Matthew_G
      Advocate I
      2 years ago

      Thank you! I have logged ticket with TrackingID#2311170050002237 . I thought it could be related to our enviroment and our ops team is also investigating.

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi Matthew_G 
        Thanks for the details. Please continue using Fabric Community for any help regarding your queries.