Error: DataFormat.Error: We couldn't convert to Number. Details: #N/A

In your case CrazyAnalyst you must have Type Detection on, and it created the change type step, and did it incorrectly.

You don't need to remove it, nor make everything text. You just need to make it correct. For example, Power BI will usually detect numbers in US zip codes so automatically make that a whole number. But if later in the data (it only looks at 200 rows to decide the type) there are 5+4 zips, (12345-4444), or foreign code like Canada that has letters, it creates errors. 

That is why I have that feature off. I know my data better than Power BI, so I set my data types correctly based on my knowledge of the business.