Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Microsoft is giving away 50,000 FREE Microsoft Certification exam vouchers. Get Fabric certified for FREE! Learn more

Reply
EK97
Frequent Visitor

Spark Source to Power BI Issue

Hello Experts!

I am currently facing a problem with Power BI while trying to apply my queries which pending changes that have not been applied yet.
When trying to load all tables, I get a message that "the name of a column is already used in a column in another table and I should choose another name". How can I fix this problem or rather why does this problem occur when importing data from Spark to BI?
The same data from another source does not cause any problem. However, I need it through spark. 

3 REPLIES 3
EK97
Frequent Visitor

I have additional information which could help to understand the import problem to PowerBI. After Spark, the tables are loaded without relationships to each other. And I suspect that this could be the reason. But I don't see a setting on the PowerBI side that allows me to ignore these relationships between the tables.

 

just possible thoughts. still don't understand the error message that the name already exists in another table.

EK97
Frequent Visitor

I'm sorry maybe i asked the question in the wrong direction. 

The data is uploaded from an Azure Database to PowerBI and i think the problem lies here and not so much with spark.

JamesRobson
Resolver II
Resolver II

What Data Connection type are you using? I had a similar sounding issue when trying to connect to a 4D database with an ODBC connection. The solution was to use ODBC > Advanced options and specify the columns I wanted to bring through (something to do with a key that was present on every table of the DB or something beyond my understanding) rather than allowing it to naturally select all columns.

JamesRobson_1-1686150774090.png

 

Never used Spark but wonder if its a similar sort of issue? Apologies if this sends you in the wrong direction though!

Helpful resources

Announcements
March PBI video - carousel

Power BI Monthly Update - March 2025

Check out the March 2025 Power BI update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.