How do I use powerbi-visuals-webpack-plugin

I am trying to add scss imports to my custom visuals and since the webpack.config.js is not exposed via the pbiviz project, I need to use powerbi-visuals-webpack-plugin, I need some help in understanding whether I start a create-react-app and then go through the directions in the ReadMe or I need a different setup since I remember we need pbiviz.json etc to setup a custom visual.