Connecting Multiple Data Sources without duplicating dataset

I would like to be able to connect to data any of the 3 ways (Direct Query, Live Connect, or import) for multiple data sources in a single report without Power BI creating duplicate semantic models when pushing the report to a workspace.