Forum Discussion
Issue With Google BiqQuery Connection in Dataflow 2. 'LargeResultDataset' are not valid BigQuery
- 9 months ago
Hi DarrenCooper ,
Thank you for reaching out to the Microsoft Community Forum.
The error 'LargeResultDataset' are not valid BigQuery options is due to the Dataflow Gen 2 service passing an unsupported parameter to BigQuery during connection setup.
The 'LargeResultDataset' parameter is not a valid option for BigQuery connections in Dataflow Gen 2. Please refer below the valid options currently supported.1. BillingProject
2. Implementation
3. UseStorageApi
4. ConnectionTimeout
5. CommandTimeout
6. ProjectIdNote: Even if you haven't explicitly set LargeResultDataset, it seems the system might be injecting it automatically due to a bug or misconfiguration in the underlying Power Query M code.
Please try below steps.
1. Open the Advanced Editor in your Dataflow setup. Check the BigQuery connection line, like below syntax.
GoogleBigQuery.Database([LargeResultDataset = null, ...])
2. Replace above syntax with below syntax.GoogleBigQuery.Database([
UseStorageApi = null,
ConnectionTimeout = null,
CommandTimeout = null,
BillingProject = "billing-project-id"
])
3. Save and revalidate the connection.I hope this information helps. Please do let us know if you have any further queries.
Regards,
Dinesh
DarrenCooper
Can you send the M code that is generated on that connection?
It looks like it's putting a random Option to it.