Conf file in spark job definition

[easwarkilari]

Is there a way to add a conf file in spark job definition?. I dont want to add it in build as building jar with new conf everytime can be tedious.

[GilbertQ]

Hi @easwarkilari 

You could create this using a new Environment? Create, configure, and use an environment in Fabric - Microsoft Fabric | Microsoft Learn

[easwarkilari]

But this is applied across all spark job definitions right. I just want to specify configurations like loglevel, buffersize, batchsizes, records, partitions and all in a .CONF file