- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Need a Datavalidation part by using notebook activity
Hi Team,
there is one incremental load scenario and which is working fine.
input source:ADLS, every day one file comming to adls and appending that to table in lakehouse.
so 1st day i have one file and having 3 records
2nd day again one file comming to adls and having again 3 records so total 6 records in adls at the End of 2nd day
so same number of records i need in LH target table at the End of 2nd day.
so i need to count number of records in source and sink, i am able to do this by using lookup activity, but i need this data validation in notebook activity and i am able to write the pyspark query also.
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @sudhav
Thanks for using the Fabric community.
As I undesrtand the ask right now is how to run an validation logic from a notebook and send an email.
Please correct me if my understanding is not right .
Step 1
We can achieve this my adding the mssparkutils.notebook.exit() in the notebook.
Step 2
When you run the the notebook from a notebook activity , please add a set variabe activity and read the exitcode
Expression should be somelike this
Step 3
Add a If activity and add the below expression
Hope this helps .
Thanks
HImanshu
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @sudhav
Thanks for using the Fabric community.
As I undesrtand the ask right now is how to run an validation logic from a notebook and send an email.
Please correct me if my understanding is not right .
Step 1
We can achieve this my adding the mssparkutils.notebook.exit() in the notebook.
Step 2
When you run the the notebook from a notebook activity , please add a set variabe activity and read the exitcode
Expression should be somelike this
Step 3
Add a If activity and add the below expression
Hope this helps .
Thanks
HImanshu
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Great, thank you Himanshu. I thought no one will give answer to this lengthy question, but you proved that i am wrong and its working as expected. thankyou man.

Helpful resources
Join us at the Microsoft Fabric Community Conference
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Fabric Monthly Update - February 2025
Check out the February 2025 Fabric update to learn about new features.

Subject | Author | Posted | |
---|---|---|---|
01-20-2025 07:38 AM | |||
11-20-2024 06:54 AM | |||
Anonymous
| 06-14-2024 12:22 AM | ||
07-12-2024 09:53 AM | |||
09-13-2023 07:50 PM |
User | Count |
---|---|
6 | |
4 | |
2 | |
1 | |
1 |
User | Count |
---|---|
13 | |
11 | |
5 | |
5 | |
4 |