Detach Dataset <-> Report, when using PBIP

My workflow is:
1. create a datamodel in PBI Desktop
2. Save as PBIP (it saves 3 items: 1 Dataset folder, 1 Report folder and 1 PBIP file)
3. Commit and Push all in GIT (using AzureDev to synch with a PIB webservice Workspace)
4. Apply the changes in the PIB webservice Workspace, using the integrated source control.

So I end up with a Dataset and a Report in PIB webservice Workspace.
Question: how can I have only the Dataset in PIB webservice Workspace? If I delete the Report and synch with GIT, it will delete it locally as well and I will not be able to make changes to the Dataset anymore.