Forum Discussion
The Source has too many files
Hi experts, we ingesting the data through API , for some data sources the business has shared nearly 150 files for one source, the schema is different sparing one or two similar columns , by going th...
Thank you Olufemi7 jubinsoni v-aatheeque , what I can see is suggestion along the lines to refrain from 150 tables , and that makes sense. But having them all in one table also a not a productive and efficient solution either. The schema varies, and that is the real issue here. What to transverse forward from this tricky situation. Thank again for your help.