Problem using custom shape map

[ChristianDiscer]

Converted shapefile (projection "transverse_mercator") to a Topo JSON file using the website http://mapshaper.org/ but the resulting JSON file has display problems.  Here's a screenshot: (1) The left image displays the shapefile in ArcGIS. (2) The top & bottom right are the JSON maps displayed within PBI using different projections.

ScreenCapture

I've even "simplified" the edges of the original shapefile to reduce the number of verticies before converting to JSON.

FYI - The location attributes (from an excel file) are correctly applying to the different areas within PBI.

Any ideas of what I should do?  Thank you.

Power BI version: 2.37.4464.361 64-bit (July, 2016)

Windows version: Windows 7 Pro 64-bit (SP1)

[deldersveld · Accepted solution]

I believe that when I converted your file, I lined it up with WGS 84 / EPSG 4326 -- geographic.

[v-caliao-msft]

Hi @ChristianDiscer,

I just tested to import an map.shp file into http://mapshaper.org/ and then export the map into TopoJSON file format. Loading it into Power BI works without any additional configuration from my side, with Power BI the same version as you posted.

So I suspect the issue here should be mostly related with the shapefile you used here. If convenient, would it be available for you to share the .shp file here for us to take a further test?

In addition, take a try to modify the Format section (the paintbrush icon) General part and see if it would help in such situation.
Adding some reference: Shape Maps in Power BI Desktop (Preview).

Regards,

Charlie Liao

[Anonymous]

Hi Charlie,

I am facing the same issue. Will you please be able to assist me. I can share the .shp file with you.

Thank you very much in advance. 

[ChristianDiscer]

Thanks @v-caliao-msft

Did not see a way to attach a file so use this Dropbox link to grab the file.  The shapefile files are in the ZIP along with an Excel spreadsheet to "link" the map area names to: PolTwpPoly.ZIP via dropbox

Also, tried various format settings but no luck.

[deldersveld]

@ChristianDiscer: This ended up being an issue with the original transverse mercator projection. I opened the file in QGIS, converted it to mercator, and exported it back out as a shapefile. From there, it was the same process using mapshaper to convert to topojson.

This file should work: https://www.dropbox.com/s/mx4lig1vmvk4ihw/PolyTestShape.json

[ChristianDiscer]

@deldersveld Your file conversion works very well - thank you.

However, I don't know how to properly re-project and/or transform a shapefile from my system for mapshaper.org.  ArcGIS contains conversion tools, but I'm not familiar enough to know what settings to use.

Should I use a "Geographic" or "Projected" Coordinate System?  Then there are many choices below these two options.

I used mapshaper.org to convert your json to a shapefile hoping to see its geographic information, but ArcGIS shows the coordinate system as "undefined."  Which means I don't know what to geographic transformation data settings to use.

Does anyone have an idea? 

[deldersveld · Accepted solution]

I believe that when I converted your file, I lined it up with WGS 84 / EPSG 4326 -- geographic.

[Kane_PowerUser]

I know it's been a few years since this thread was discussed - but I have recently experienced the same issues as (in England) the ONS (government data department) changed their default projection mapping in the 2023 updates - this means PowerBI doesn't, by default, recognise the projection settings. I don't have ArcGIS or QGIS, so was struggling to follow this thread, but I came up with a workaround that's fixed all my issues. 

This is only helpful to those who are not expert mappers, or who do not have access to QGIS/ArcGIS/other mapping software.

Background: I was downloading either GeoJSON or Shapefile documents and using MapShaper (www.mapshaper.org), then simplifying and converting to TopoJSON for use in PowerBI. When I used this in PowerBI, I was getting a picasso-esque visualisation that was mad. Basically, PowerBI uses the WGS84 (EPSG:4326) settings to use the custom mapping tool, and my maps had a different co-ordinate system (which I didn't know, or know how to change). 

Fix: I used a GeoData converter to identify what the default projection/co-ordinate system settings on my file was (www.mygeodata.cloud/converter/) - in my case, the ONS file was using the OSGB 1936 / British National Grid (EPSG:27700) (that will make sense to some people, but it didn't to me). You can then confidently change the co-ordinate settings for the shapefile/GeoJSON by doing the following:

1. Download the GeoJSON/Shapefile.
2. Upload the file to www.mapshaper.org
3. Simplify as needed
4. In a separate tab, use a tool to identify your file's co-ordinate system (www.mygeodata.cloud/conversion) - you're looking for the current EPSG code used by your file.
5. Back in MapShaper, go to Consol and type the following: -proj from=EPSG:27700 crs=EPSG:4326
6. Change the "from" EPSG code in red to the EPSG code you found in step (4) (in this case it was the 27700 code from the National Grid system referenced above, and I was changing it to the WGS84 system (EPSG: 4326) needed for PowerBI.
7. Press enter!
8. Export from MapShaper as a TopoJSON
9. Voila! 

You can then import to the shape map in PowerBI with no problems.

Hope this helps someone else ...

[ChristianDiscer · Accepted solution]

@deldersveld Thank you so much, that works great!!  Here's are screen captures of the process.

Step #1: select the shapefile using ArcGIS Project tool & set parameters

 Step #2: Parameters selected

 Step #3: Use mapshaper.org to convert shapefile to json format

 Step #4: Save as TopoJSON

 Step #5: Use TopoJSON file in Power BI

[nallaa]

Hello @deldersveld ,

I am trying to display City of Detroit along with Counties in Michigan map. I have downloaded and imported the City of Detroit shape file and Michigan Counties shape file to Mapshaper. I have merged 2 layers using "merge-layers" command in Mapshaper console. I was able to see the City of Detroit boundary under Wayne County of Michigan map in the output of merged file.

I have exported the output in TopoJSON format as a local file. I have converted the output coordinate system to WGS 1984 as suggested in this thread. But, when I loaded this custom map to Shape Map visual in Power BI, I am not able to find the City of Detroit's boundary in Power BI. It is displaying the whole Wayne County with out Detroit polygon.

 I have checked Map keys. It is fine. When I filtered City of Detroit in my fields, the Shape Map is approximately zooming in to Detroit's geographic location in default grey color.

I need to display boundary for City of Detroit to appear so that one can select Detroit or rest of Wayne County in Power BI Shape map.

Am I missing some steps to be done in Mapshaper? Can you please help me with this?

I am sharing the source file download links below,

http://gis-michigan.opendata.arcgis.com/datasets/cities-v17a/data?where=NAME%20%3D%20%27Detroit%27

http://gis-michigan.opendata.arcgis.com/datasets/counties-v17a/data

Power BI Desktop Version: 2.84.861.0 64-bit (August 2020)

Windows 10 Enterprise

Thank you,

Abhinav

[nallaa]

The issue has been resolved. I have uploaded 2 source files to Mapshaper. One is of Detroit City map and the Other is of Michigan County Map. I have used "erase" command in Mapshaper to erase interecting boundary between Wayne County and Detroit city. Later, I have merged 2 layers using "merge-layers" command. Finally I have used Simplify in mapshaper to repair any interscetions resulted due to above 2 operations.

Thank you,

Abhinav

[nallaa]

The issue has been resolved. I have uploaded 2 source files to Mapshaper. One is of Detroit City map and the Other is of Michigan County Map. I have used "erase" command in Mapshaper to erase interecting boundary between Wayne County and Detroit city. Later, I have merged 2 layers using "merge-layers" command. Finally I have used Simplify in mapshaper to repair any interscetions resulted due to above 2 operations.

Thank you,

Abhinav

[deldersveld]

@ChristianDiscer: Great. I don't have an ArcGIS license, and I used QGIS. If/when I blog this, can I use your screenshots for ArcGIS users alongside my own?

[Anonymous]

Hi there. Will you please be able to help me with the similar problems? Thank you in advance. My email bipinjha@live.com

[mjfulke]

I  was able to take Shape Files straight to http://MapShaper.org, import them, and in the Console window, run -proj wgs84 and convert the map to something Power BI would accept.  

[sweidlich]

This response needs to be ranked higher. Our security settings at work prevent us from installing qgis, and arcgis is too expensive. But running "-proj wgs84" in the console dialog worked like a freaking charm.

[ChristianDiscer]

Yes, by all means use the images in anyway possible.  Thanks again for your help!!

[deldersveld]

Did a quick writeup on it here: https://dataveld.wordpress.com/2016/09/01/overcoming-potential-power-bi-shape-map-rendering-issues/

[sf09]

Hi, I'm having this issue with shape maps in powerbi so I think your writeup on the solution might be exactly what I need (I know almost nothing about ArcGIS!) but when I follow the link I get, "

Private Site

This site is currently private. Log in to WordPress.com to request access."

I don't have a WordPress login so I wondered if there's any other way I could access this please?

[oblitasss]

I have tried for weeks to convert to the correct projection, but it does not work...  could someone convert this shape to topojson please? I have tried with QGIS, ARCMAP, used http://mapshaper.org/ but it continues showing in powerbi the Picaso Effect, The link of the shape is this : https://drive.google.com/file/d/1kbY_HkCulQzWD8SgJkP9nHu9bjmILY3U/view?usp=sharing

[amarcos]

Can you help me

i want to use some countries shape maps that are not in Power BI, for example Finland, i downloaded the GeoJSON file from here

http://code.highcharts.com/mapdata/

Finland http://code.highcharts.com/mapdata/countries/fi/fi-all.geo.json

Then I opened in http://mapshaper.org/ and exported as TopoJSON

When i open it in Power IB I can not see the map onliy lines as previous user

Can you help me?

[androidtemplar]

Hi!

The GeoJson you had behind the link has things throwing PowerBI off,

1. it has Scandinavian chars (e.g. &auml = ä "Itä-Uudenmaan maakunta") - reading this evening through several stack traces when trying to feed multipolygon GeoJson for PowerBI, it just rolls down and cries if it sees something outside Latin1. meh.
2. according to validation feedback from GeoJsonLINT the GeoJson you have there also does not follow the right hand rule, which seems to be a thing also.

Having run around internjets for a moment now seeking for a suitable source, I am not seeing a clean WGS-84 compliant, right-hand rule -following GeoJson of Finnish borders, let alone one with e.g. postalcode area geographies. I will do something about it (create one, validate it, test it with PowerBI) tomorrow and be back. In case I succeed and you are still struggling with this, ping me at

androidtemplar@outlook.com