Report semantic model not refreshing properly

Hello everyone, for some reason a report I am working on that uses several data sources sometimes feels to refresh and reason I get is weird because it does not mention any data sources so I am not sure what is causing it to fail.

oddly enough, I have gotten this error few times and the fix is just to try to refresh it again and it works but then few days later it fails again with the same message. 
it took an hour and half to finish the refresh just to fail.
the error message  is "       Power BI On-Premise Data Gateway Error: DM_GWPipeline_Gateway_SpooledOperationMissing”,”parameters”:{},”details”:[],”exceptionCulprit”:1     "
Side note: the report uses direct query and imported data, so not just one type if that helps