Forum Discussion
BigQuery Issue - not importing all rows
Hello All,
I am having an issue with BigQuery: in short, I have 573,347 rows in my table in BigQuery, yet PBI only imports 3,072 of them. Does anyone know why this is happening and how to fix it? I have tried 'import' mode vs 'DirectQuery' and it still doesn't work. I am using the latest version of PBI Desktop.
Thank you!
9 Replies
- aj1973Community Champion
Hi PBI_ponderer
You might wanna check the limitations on Google Big Query
https://cloud.google.com/bigquery/quotas
I don't think this has to do with Power Bi
- PBI_pondererFrequent Visitor
Hi Amine,
Thanks for taking the time to reply. I found that it was actually a PBI issue: I was trying to import some text data and for some reason PBI didn't like it, when I removed that column containing text from the import - everything worked and it imported all of the rows. Have you ever had this experience before? It is strange because up until last week PBI was importing all of the rows with the text data but then just stopped.
- aj1973Community Champion
Hi PBI_ponderer
No I haven't met that issue. But before pointing finger on PBI you need to make sure what that column contains that causes the issue then act upon it. so by elemination look inside that column what is not correct, empty some rows from that column and verify... step by step you can find the issue.
Let me know
- AnonymousNot applicable
Hello, I ran in a similar issue and problem comes from the fact that Power BI does not support long strings. When creating a view truncating long fields, all the rows are ingested.
This has nothing to do with Google Big Query limitations, it's a Power BI limitation
I think it's perfectly legitimate to point finger to PBI because even if data is in an unsupported format, or in my case, length , having silent errors is not acceptable.
Thank you
- aj1973Community Champion
Hi Anonymous
Can you please share the doc where you get the info?
- AnonymousNot applicable
https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-data-types#text-type
But looking twice that was not my exact issue, text type in PBI is ~500MB and my biggest string was 1.3MB so this is more likely a memory overflow issue. Anyway real issue is that if user does not pay enough attention they'll end up working with incomplete data without any notification
Cheers
- BamakHelper V
Hi
My compagny faces 2 problems when Power BI is connected to GCP Bigquery
- Some lines disappear when loading certain table models WITHOUT warning !!!
- A simple left merge on 2 BQ tables crashes on power query (bad folding send to BQ) , but OK for that we get a yellow warning
Sorry aj1973 , mr champion but since our tool is power ib, I consider it as the "data quality control tower"
Why not integration crashes , but please not without clear Warnings
Clear explanation of each issue (due to PBI limitations or GCP BQ limitations <-- BQ SQL bigdata compliant deals with 100s of millions of rows ;>) )
silent integration + missing lines = very very bad BI reliability
Power BI (on Desktop & Service) is THE integration control tower, so please show each issues messages
Work on data quality or stop native BQ connector on desktop because reliability is not good for customers