Forum Discussion
Optimizing Performance in a Star Schema with BigQuery - Need Help with 12 Joins
- Anonymous2 years ago
Hi hselfe_rsa ,
To optimize the performance in a star schema with a large number of joins in BigQuery, you can follow these best practices:
1. Use denormalization: Consider denormalizing your data by combining related tables into a single table. This can reduce the number of joins required and improve query performance. However, keep in mind that denormalization may increase storage costs and data redundancy.
2. Optimize table design: Ensure that your tables are properly indexed and partitioned. Indexing can speed up query execution by allowing BigQuery to quickly locate the relevant data. Partitioning can help improve query performance by reducing the amount of data that needs to be scanned.
3. Use query optimization techniques: When writing queries, consider using query optimization techniques such as filtering and aggregating data as early as possible in the query execution process. This can help reduce the amount of data that needs to be processed and improve query performance.
4. Monitor query performance: Regularly monitor the performance of your queries using BigQuery's query history and query plan features. This can help identify any performance bottlenecks and guide further optimization efforts.
I hope these suggestions help you optimize the performance of your star schema in BigQuery. If you have any further questions or need additional assistance, please let me know.
Best Regards,
Stephen Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
What you are describing, you are doing this in PowerQuery, right? Dont do it in the frontend using calculated tables that will be a disaster for performance
- hselfe_rsa2 years agoRegular Visitor
Not calculated tables, but relationships in model view