Ideas to implement environmental scanning tool

[baby_eye_26]

I'm exploring implementing an environmental scanning tool to help me identify potential risks to my organisation. Examples include scanning news articles or weather forecast to identify possible threats such as weather, pandemic or geopolitics. I will then be notified. Looking for ideas to solve this use case. Any suggestions would be greatly appreciated! I'm familiar with Power Automate and BI. Open to learning other tools as well. Thanks in advance!

[Jai-Rathinavel · Accepted solution]

Hi @baby_eye_26, To address your requirement you can start exploring Microsoft Fabric. You can setup your Fabric Trial capacity at free of cost for 60 days, it can further be extended if Microsoft allows us.

Using the fabric capacity you can convert or create a new workspace as a fabric enabled workspace. You can scrape the articles, get weather information through API's in a fabric notebook and store the results or raw data in a lakehouse. You can further do data transformations using a datalow gen 2 (provides a power query experience) and notebook (using pandas, spark,etc). Since you are willing to learn new tools you could start with learning Fabric notebook and how data ingestion is done to a lakehouse using notebook. Please find the below article and videos to get started with Fabric.

https://learn.microsoft.com/en-us/training/paths/get-started-fabric/

Learn Microsoft Fabric with Will - Youtube

Thanks,

Jai

[Anonymous]

Hi @baby_eye_26 ,

Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.

If these also don't help, please share more detailed information and description to help us clarify your scenario to test.

How to Get Your Question Answered Quickly 

Regards,

Xiaoxin Sheng

[Anonymous]

Hi @baby_eye_26,

In fact, I think these requirements not so suitable for power bi.
You may need to use deploy scraping tool to collection recently informations and use AI or machine learning model to analyse them and send response result based on email.

Regards,

Xiaoxin Sheng

[danextian · Accepted solution]

IMO, your question is more of domain specific than just simply Power BI.  There are third party service providers that provide keyword-based data via APIs or RSS feeds. Weather data are available from service providers like open-meteo or openweathermap via API for free (with limited features) or with a fee. Data collection can possibly be automated using tools like Zapier or Power Automate. For questions like this where I don't know where to start, asking AI for suggestions would be a big help.

[Jai-Rathinavel · Accepted solution]

Hi @baby_eye_26, To address your requirement you can start exploring Microsoft Fabric. You can setup your Fabric Trial capacity at free of cost for 60 days, it can further be extended if Microsoft allows us.

Using the fabric capacity you can convert or create a new workspace as a fabric enabled workspace. You can scrape the articles, get weather information through API's in a fabric notebook and store the results or raw data in a lakehouse. You can further do data transformations using a datalow gen 2 (provides a power query experience) and notebook (using pandas, spark,etc). Since you are willing to learn new tools you could start with learning Fabric notebook and how data ingestion is done to a lakehouse using notebook. Please find the below article and videos to get started with Fabric.

https://learn.microsoft.com/en-us/training/paths/get-started-fabric/

Learn Microsoft Fabric with Will - Youtube

Thanks,

Jai