topic Re: Need automatic script(Query) for JSON file in Pipelines

Need automatic script(Query) for JSON file

sudhav — Mon, 17 Jul 2023 10:47:25 GMT

Hi Team,

I have a JSON file, I need automatic script in sql/python for that file, so that i can run that code in my pipeline to copy that file to my lakehouse.

is there any way. please let me know.

TIA

Re: Need automatic script(Query) for JSON file

GraceGu — Tue, 18 Jul 2023 02:06:57 GMT

You can do copy file to file or file to table into lakehouse. Can you elaborate a bit more on "automatic script"?

Re: Need automatic script(Query) for JSON file

sudhav — Wed, 19 Jul 2023 11:40:55 GMT

Hi Grace,

below is my JSON script

and i have Json table below with name Student(for assumption)

it is having the columns of

studentId,studentName,studentBranch

and data is

101 Adam Finance

102 Scott Accounts

103 Saran Finance

104 Aantony Sales

so if you want to create the same table in SQL, you need to write one query like below

create table Student(studentId int,studentName varchar(50),StudentBranch varchar(50))

insert into Student values(

101 Adam Finance),

(102 Scott Accounts),

(103 Saran Finance),

(104 Aantony Sales)

then the same table will create in SSMS.

so GraceGu what I want to achieve here is, that sql script i want to generate automatically from that JSON file/script. in SQL or in Python or pyspark also(in any language) that enough for me.

is there any way, please let me know. its very need for me.