Forum Discussion
dataflow source change from aws redshift to databricks
- 8 months ago
Hi bhavyamalik1,
You can change the data source in your dataflow, but it requires recreating the connection. Here's how you can try to approach it:
Option 1: Edit directly in Power BI Service (Recommended)
- Go to your workspace and open the dataflow for editing
- In Power Query Editor, select the query connected to Redshift
- Click Data source settings or Configure connection
- Unfortunately, you cannot switch connector types (Redshift → Databricks) directly
- You'll need to delete the current source step and add a new Databricks connection
- Right-click the Source step → Delete
- Get Data → Databricks → enter your connection details
- Reapply your transformation steps (they should still be there)
Option 2: Use the JSON file (Advanced)
- Open the downloaded JSON file
- Find the data source section (look for "Amazon Redshift" references)
- Replace with Databricks connection string format:
- Change the connector from AmazonRedshift to Databricks
- Update server, database, and authentication details
- This is risky - one syntax error breaks the dataflow
Option 3: Recreate the dataflow (Safest)
- Create a new dataflow
- Connect to Databricks
- Copy/paste the M code from your existing queries (from the JSON or Advanced Editor)
- Update reports to point to the new dataflow
Best regards!
PS: If you find this post helpful consider leaving kudos or mark it as solution
Hii bhavyamalik1
You should not edit the exported dataflow JSON. Changing sources via JSON is unsupported and can break the dataflow. The correct approach is to edit the dataflow in Power BI Service (Power Query Online), update the Source step from Amazon Redshift to Databricks in the Advanced Editor, then update credentials and refresh. As long as the schema matches, downstream transformations and reports will continue to work.