Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Shape the future of the Fabric Community! Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions. Take survey.

Reply
GuidoMS
Helper II
Helper II

Having trouble enabling Incremental Refresh

Hi,

I've been trying to apply incremental refresh to some of out tables with our dataset but so far, didn´t succeed. Did the following:

 

- Create new parameters RangeStart and RangeEnd.

- Apply parameters to new filter on one table called VW_TURNOS

- Configure Incremental Refresh setting up months to refresh, etc.

 

My team has been troubleshooting this for a long time searching on forums (this one and others) and trying new methods with no positive result. The problem now is that our ammount of data exceeds the 1024mb limit for the refresh. So our solution is to leave behind data from previous years, which is a limitation on potential analysis agains previous years.

 

I don't fully understand Query Folding concept but from what i've seen, if "View native query" is greyed out on the new step with applied parameters, then it's not folding (others say it's not 100% confirmation).

 

For reference we use:

- FireBird 3.0 SQL server for database.

- IBexpert as our data base Manager 

- ODBC to connect to Power BI.

- Working with Power Bi PRO (license by user)

 

Created View structure (VW_TURNOS)

 

CREATE OR ALTER VIEW VW_TURNOS(
CODIGO,
MEDICO,
ESPECIALIDAD,
FECHA_TURNO,
SOBRE_TURNO,
HORA_TURNO,
PRESENTE,
PACIENTE,
OBRA_SOCIAL,
IDPLAN,
OPERADOR,
FECHA_ALTA,
MEDICO_SOLICITANTE,
OPERADOR_2,
ASUCARGO,
HORA_ALTA,
HORAPRESENTE,
CONFIRMADO,
USUARIOCONFIRMA,
FECHACONFIRMA,
CANCELADO,
IDUSUARIOCANCELA,
ALTAMISMODIA,
ATENDIDO,
TIPOIVA,
SECTOR_TURNO,
SECTOR_PRESENTE,
HORA_ATENDIDO,
USUARIO_ATENDIDO,
CANCELADO_FECHA,
SECTOR_CANCELADO,
SECTOR_CONFIRMADO,
USUARIO_BAJAPRESENTE,
FECHA_BAJAPRESENTE,
SOBRETURNO_ESPECIAL,
IDMOTIVOBAJAPRESENTE,
IDCENTRO,
IDCONSULTORIO,
EVOLUCIONADO,
IDMEDICOEFECTOR,
IDCENTRODERIVADOR,
IDCENTROLIQUIDA,
CENTRODERIVADOR)
AS
select
MAESTRO_TURNOS.CODIGO,
MAESTRO_TURNOS.MEDICO,
MAESTRO_TURNOS.ESPECIALIDAD,
MAESTRO_TURNOS.FECHA_TURNO,
MAESTRO_TURNOS.SOBRE_TURNO,
MAESTRO_TURNOS.HORA_TURNO,
MAESTRO_TURNOS.PRESENTE,
MAESTRO_TURNOS.PACIENTE,
MAESTRO_TURNOS.OBRA_SOCIAL,
MAESTRO_TURNOS.IDPLAN,
MAESTRO_TURNOS.OPERADOR,
MAESTRO_TURNOS.FECHA_ALTA,
MAESTRO_TURNOS.MEDICO_SOLICITANTE,
MAESTRO_TURNOS.OPERADOR_2,
MAESTRO_TURNOS.ASUCARGO,
MAESTRO_TURNOS.HORA_ALTA,
MAESTRO_TURNOS.HORAPRESENTE,
MAESTRO_TURNOS.confirmado,
MAESTRO_TURNOS.confirmado_idusuario,
MAESTRO_TURNOS.confirmado_fecha,
MAESTRO_TURNOS.CANCELADO,
MAESTRO_TURNOS.IDUSUARIOCANCELA,
MAESTRO_TURNOS.ALTAMISMODIA,
MAESTRO_TURNOS.ATENDIDO,
MAESTRO_TURNOS.TIPOIVA,
MAESTRO_TURNOS.SECTOR_TURNO,
MAESTRO_TURNOS.SECTOR_PRESENTE,
MAESTRO_TURNOS.HORA_ATENDIDO,
MAESTRO_TURNOS.USUARIO_ATENDIDO,
MAESTRO_TURNOS.CANCELADO_FECHA,
MAESTRO_TURNOS.SECTOR_CANCELADO,
MAESTRO_TURNOS.SECTOR_CONFIRMADO,
MAESTRO_TURNOS.USUARIO_BAJAPRESENTE,
MAESTRO_TURNOS.FECHA_BAJAPRESENTE,
MAESTRO_TURNOS.SOBRETURNO_ESPECIAL,
MAESTRO_TURNOS.IDMOTIVOBAJAPRESENTE,
MAESTRO_TURNOS.IDCENTRO,
MAESTRO_TURNOS.IDCONSULTORIO,
MAESTRO_TURNOS.EVOLUCIONADO,
MAESTRO_TURNOS.IDMEDICOEFECTOR,
MAESTRO_TURNOS.IDCENTRODERIVADOR,
MAESTRO_TURNOS.IDCENTROLIQUIDA,
MAESTRO_TURNOS.idcentroderivador
From MAESTRO_TURNOS
where Maestro_Turnos.fecha_turno >= '2020-09-01'
And Maestro_Turnos.fecha_turno <= dateadd (3 month to current_date)
And not coalesce (Maestro_Turnos.presente, -1) = -1
And not coalesce (Maestro_Turnos.idcentro, -1) = -1
And not coalesce (Maestro_Turnos.obra_social, '') = ''
;

 

Please let me know if more information is needed to help us diagnose our issue. 

2 REPLIES 2
amitchandak
Super User
Super User

@GuidoMS , Usual, when we set up incremental Range, in file we set only set 1-month range RangeStart and RangeEnd. and we give long data archive range

and then load it service. But if you are a pro user, you will lose data with every republish

 

Join us as experts from around the world come together to shape the future of data and AI!
At the Microsoft Analytics Community Conference, global leaders and influential voices are stepping up to share their knowledge and help you master the latest in Microsoft Fabric, Copilot, and Purview.
️ November 12th-14th, 2024
 Online Event
Register Here

Thanks for the quick answer. I'll look for those settings later today.

If we don't have a Premium account then older data is lost?

 

From what i understand about incremental refresh, we can update data uploading or editing data frox X past months, acumulating older unchanged data. Is this concept correct? 

Then maybe the limitation with a pr account is that we can acumulate older data if the set size is bigger than 1gb. 

 

Can we get to 10gb with only 1 premium user (manager of the set)?

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Dec Fabric Community Survey

We want your feedback!

Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.