My suggestion is to retain all the imported custom visuals permanently in Power BI desktop, unless until we remove it manually.
I believe this may have been enabled already in June 2019 update (https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/15638169-custom-visuals-enabled-every-time-power-bi-desktop)
