The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
Hi -
I want to use the Change Feed capability in Delta tables when using Lakehouse and Notebooks. The History feature works great, and you can enable the Change Feed on a table to track and report detailed changes. However with the default Spark Session behaviour the userID and userName are always NULL.
I want to figure out how to get the "current user" that's submitting to spark from the notebook. I have tried mssparkutils, and when you use "spark.sparkContext.sparkUser()" you always get "trusted-service-user". Spark UI also shows this, but when you go to the "All Runs" view, is clearly knows the user ID of the Submitter.
Solved! Go to Solution.
Hi @JDawsonGLP
Thanks for using Fabric Community.
Apologies for the issue you have been facing. Currently there is no workaround to get the name of the current user that's submitting to spark from the notebook. We will have to wait until mssparkutils environment utils is ready. This is planned and is on road map. ETA : Q4 2023
Appreciate your patience.
Hope this helps. Please let us know if you have any further questions. Glad to help.
OK - thanks for the reply, I was trying the mssparkutils.env methods and saw they weren't available yet.
Appreciate your response, I'll keep an eye on the blog for updates. As long as it's on the roadmap soon it's fine.
Hi @JDawsonGLP
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.
Hi @JDawsonGLP
Thanks for using Fabric Community.
Apologies for the issue you have been facing. Currently there is no workaround to get the name of the current user that's submitting to spark from the notebook. We will have to wait until mssparkutils environment utils is ready. This is planned and is on road map. ETA : Q4 2023
Appreciate your patience.
Hope this helps. Please let us know if you have any further questions. Glad to help.
User | Count |
---|---|
5 | |
4 | |
3 | |
2 | |
1 |
User | Count |
---|---|
16 | |
15 | |
11 | |
6 | |
6 |