Forum Discussion

PJStevens's avatar
PJStevens
Icon for Advocate II rankAdvocate II
2 years ago
Solved

Help optimizing a row by row calculated column that filters on the past 30 minutes

Hello All,

 

I have spent all day today and yesterday trying to solve an issue I have with a calculated column a former colleague made. It is taking extremely long to run over data sets of 300-400k rows, and I haven't been able to solve the issue.

  var Summed = CALCULATE(
                    (SUM('Leveringszekerheid MI'[Counter Onderbreking CV]))/4,
                    FILTER(
                        ALL('Leveringszekerheid MI'),
                        'Leveringszekerheid MI'[DateTimeKey] <= CurrenDateTime && 'Leveringszekerheid MI'[DateTimeKey] > 'Leveringszekerheid MI'[DateTimeKey] - Time(0, 30, 0)
                        )
                    )
return
    IF(Summed = 1,1,0)
 
Seems to be an issue summing the values over the filtered period (datetimekey)-time(0,30,0) combined with the logic if statement. The column Counter Onderbreking CV is a simply calculated column that is counting the amount of interferences their were recorded (based on certain conditions that aren't really relevant, but they result in 1's or 0's)
 
Any tips would be greatly appreciated as I cannot seem to solve this
Need Help
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi PJStevens ,

     

    Maybe you can try below formula to create calculated column:

    Summed Calculation = 
VAR CurrentDateTime = 'Table'[DateTimeKey]
VAR StartTime = CurrentDateTime - TIME(0, 30, 0)
VAR Summed = 
    CALCULATE(
        SUM('Table'[Counter Onderbreking CV]) / 4,
        FILTER(
            'Table',
            'Table'[DateTimeKey] <= CurrentDateTime &&
            'Table'[DateTimeKey] > StartTime
        )
    )
RETURN
    IF(Summed = 1, 1, 0)

    Best Regards,
    Adamk Kong

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

3 Replies

  • lbendlin's avatar
    lbendlin
    Icon for Super User rankSuper User
    2 years ago

    Install DAX Studio and then use it to examine the query plan and modify according to your findings.

     

    No need to specify FILTER inside CALCULATE - that will be done for you automatically.

     

    Consider using aggregation functions instead of CALCULATE.

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi PJStevens ,

     

    Maybe you can try below formula to create calculated column:

    Summed Calculation = 
VAR CurrentDateTime = 'Table'[DateTimeKey]
VAR StartTime = CurrentDateTime - TIME(0, 30, 0)
VAR Summed = 
    CALCULATE(
        SUM('Table'[Counter Onderbreking CV]) / 4,
        FILTER(
            'Table',
            'Table'[DateTimeKey] <= CurrentDateTime &&
            'Table'[DateTimeKey] > StartTime
        )
    )
RETURN
    IF(Summed = 1, 1, 0)

    Best Regards,
    Adamk Kong

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • PJStevens's avatar
      PJStevens
      Icon for Advocate II rankAdvocate II
      2 years ago

      Hello,

       

      Thanks for the reply. This is indeed the solution I went with, unfortunately, due to the nature of the calculation, I have decided to only apply it to the past 2 months as to not overload it.


      I will mark it as solved, as this is essentially the same calculation I am using, but instead of using it on the entire data set, I only use it on the past 2 months.

       

      Thanks anyways for the reply.