Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
EK97
Regular Visitor

Spark Source to Power BI Issue

Hello Experts!

I am currently facing a problem with Power BI while trying to apply my queries which pending changes that have not been applied yet.
When trying to load all tables, I get a message that "the name of a column is already used in a column in another table and I should choose another name". How can I fix this problem or rather why does this problem occur when importing data from Spark to BI?
The same data from another source does not cause any problem. However, I need it through spark. 

3 REPLIES 3
EK97
Regular Visitor

I have additional information which could help to understand the import problem to PowerBI. After Spark, the tables are loaded without relationships to each other. And I suspect that this could be the reason. But I don't see a setting on the PowerBI side that allows me to ignore these relationships between the tables.

 

just possible thoughts. still don't understand the error message that the name already exists in another table.

EK97
Regular Visitor

I'm sorry maybe i asked the question in the wrong direction. 

The data is uploaded from an Azure Database to PowerBI and i think the problem lies here and not so much with spark.

JamesRobson
Resolver II
Resolver II

What Data Connection type are you using? I had a similar sounding issue when trying to connect to a 4D database with an ODBC connection. The solution was to use ODBC > Advanced options and specify the columns I wanted to bring through (something to do with a key that was present on every table of the DB or something beyond my understanding) rather than allowing it to naturally select all columns.

JamesRobson_1-1686150774090.png

 

Never used Spark but wonder if its a similar sort of issue? Apologies if this sends you in the wrong direction though!

Helpful resources

Announcements
July 2024 Power BI Update

Power BI Monthly Update - July 2024

Check out the July 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors
Top Kudoed Authors