This solution presents an automated framework for dynamic partition creation and granular data refresh management in Power BI semantic models within Microsoft Fabric. It consists of three orchestrated notebooks that work together to optimize refresh performance and resource utilization.
Capabilities:
Dynamic Partitioner: Automatically generates date-based partitions (monthly, quarterly, yearly) on semantic models using customizable date ranges and intervals. It compares against existing partitions to prevent duplicates.
User-Controlled Refresher: Executes selective data refresh operations at table or partition granularity level. Users can specify exactly which tables and partitions to refresh, while the framework automatically identifies and includes dependent tables based on semantic model relationships to preserve the referential integrity. This eliminates unnecessary full dataset refreshes.
Orchestrator: Coordinates the complete workflow, validating configurations, executing partitioning, and triggering refresh operations based on user selections with transaction support (transactional/partialBatch modes).
All the code and documentation can be found in the GitHub repository.
https%3A%2F%2Fgithub.com%2Fjavendia%2Ffabric-semantic-model-toolkit%2Ftree%2Fsemantic-link-challenge%2Fdemo%2FREFRESHER
