Pipeline's Script activity loses HTML tags?

[aseagull]

Hi! I'm new to Data Pipelines so bear with me...I created a Script activity to issue a SQL query, and it appears to lose some of my code. Or else I just don't understand how this works.

Once creating a Script activity, I can see a text area to edit the query. Below it is the link "view in expression builder". That link gives me a nicer-looking SQL editor. In this editor, my SQL statement includes HTML tags in string literals (screenshot attached).  But when I save it and return to the basic pipeline Script UI, the HTML tags are gone. Opening up the expression builder reveals they are still there.

Here is a second (and related?) problem. If I run the pipeline, it seems to work as if the tags are still there. But at some point (could be minutes later, could be days later), the pipeline's output is wrong, and when I re-enter the pipeline to edit it, the tags are completely gone: both from the basic UI and from the expression builder.

Is there some limit on string literals in the SQL supported by this Script activity? Or have I misunderstood how this tool works?

Thanks,
Amon 

[Anonymous]

Hi @aseagull ,

Based on your description and the provided screenshots, the behavior you're observing (i.e., the HTML tags are displayed in the expression generator, but not in the base UI) may have something to do with the way the UI renders and displays those tags.
In the script-active UI, the SQL editor may not support direct insertion of raw HTML tags. When you paste or type these tags, they may be treated as part of the query syntax or removed during saving.
The expression builder shows the complete query, including the tags, because it may treat the entire string as a literal and not attempt to parse it into SQL syntax.
You can keep a close eye on the execution and output of the pipeline, especially after making changes to the script activity. This can help determine if and when HTML tags are missing, or if there is a specific trigger that causes this behavior.

You can refer to these documents for more information on how to solve this problem
How to use Script activity - Microsoft Fabric | Microsoft Learn
How to monitor pipeline runs - Microsoft Fabric | Microsoft Learn
Data pipelines storage event triggers in Data Factory (Preview) - Microsoft Fabric | Microsoft Learn

Best regards,
Albert He

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[aseagull]

FYI, I submitted a ticket and the engineer who called me replicated the problem! No add'l info at this time. 

[Anonymous]

Hi @aseagull ,
Thanks for the reply, if this issue has been resolved. If so, you can provide a solution so that other users can benefit from it as well.

Best regards,
Albert He

[aseagull · Accepted solution]

Thanks for the ping, Albert! They messaged me on 6/13 that the problem was fixed, but I was traveling for a stretch. I've been checking in the past few days on two test pipelines, and they seem to be retaining their tags. So I guess it's fixed! Always hard to say with these sorts of things. But promising...

[aseagull]

I am not sure if anyone has tried to replicate this, but to corroborate my second point, attached is a screenshot from today. Notice that the HTML content in the string literals in the SQL query is gone.

Like I said, it disappears at some point...