Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
EK97
Frequent Visitor

Spark Source to Power BI Issue

Hello Experts!

I am currently facing a problem with Power BI while trying to apply my queries which pending changes that have not been applied yet.
When trying to load all tables, I get a message that "the name of a column is already used in a column in another table and I should choose another name". How can I fix this problem or rather why does this problem occur when importing data from Spark to BI?
The same data from another source does not cause any problem. However, I need it through spark. 

3 REPLIES 3
EK97
Frequent Visitor

I have additional information which could help to understand the import problem to PowerBI. After Spark, the tables are loaded without relationships to each other. And I suspect that this could be the reason. But I don't see a setting on the PowerBI side that allows me to ignore these relationships between the tables.

 

just possible thoughts. still don't understand the error message that the name already exists in another table.

EK97
Frequent Visitor

I'm sorry maybe i asked the question in the wrong direction. 

The data is uploaded from an Azure Database to PowerBI and i think the problem lies here and not so much with spark.

JamesRobson
Resolver II
Resolver II

What Data Connection type are you using? I had a similar sounding issue when trying to connect to a 4D database with an ODBC connection. The solution was to use ODBC > Advanced options and specify the columns I wanted to bring through (something to do with a key that was present on every table of the DB or something beyond my understanding) rather than allowing it to naturally select all columns.

JamesRobson_1-1686150774090.png

 

Never used Spark but wonder if its a similar sort of issue? Apologies if this sends you in the wrong direction though!

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Jan25PBI_Carousel

Power BI Monthly Update - January 2025

Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.

Jan NL Carousel

Fabric Community Update - January 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors