Setup:
Power BI
Connected to Spark SQL Data Source
So I used spark SQL data source to connect to power bi application.
On the receiving end on the spark thrift server, I parse the query to optimize it further.
The issue I am facing is when I apply a filter visual level from the dimension dropdown
The query I am receiving on my end is
select top 100001 group1, group2 from (sql * from table where filter in (?,?)) group by group1,group2
I cannot understand why I am getting ? in filter values even when I have selected correct lookup
It works when there is only a filter value applied.
I am attaching the logs from my end
ExecuteDirect","ResourceKind":"Spark","ResourcePath":"","cliservice","HostProcessId":"324","CommandText":"select top 1000001\r\n `dimension`,\r\n sum(`measurement`) as `C1`\r\nfrom \r\n(\r\n select `<dimension>`\r\n from `SPARK`.`table`\r\n where `group` in (?, ?)\r\n) as `ITBL`\r\ngroup by `group`","ParameterCount":"2","Skip":"0","Take":"Infinite","PageRowCount":"0","ProductVersion":"2.79.5768.1082
The query which is working
SELECT SUM(C_43) AS C_4331 FROM (SELECT C_61756469656e63655f61637469766974795f61756469656e63655f6163746976697479.`dimension1` AS C_43 FROM `table` C_61756469656e63655f61637469766974795f61756469656e63655f6163746976697479 WHERE C_61756469656e63655f61637469766974795f61756469656e63655f6163746976697479.`dimension2` IN ('val1','val2','val3') C_4954424c
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.