Forum Discussion

Mauro89's avatar
Mauro89
Super User
8 months ago
Solved

AI functions with PySpark error

Hi there,   I have tried the AI functions capabilities in notebooks. The example with pandas dataframe worked for me. But the example as of the MS documentation with PySpark does not work. Example...
Notebook
  • Mauro89's avatar
    Mauro89
    8 months ago

    v-karpurapud sooooo. I turned out to be the issue was sitting infront of the screen not in the screen ğŸ˜…

    I was only importing the libary for pandas and was not award that the pyspark library is a different one. So for all ready this post, the solution is to import the correct relevant library.

     

    import synapse.ml.aifunc as aifunc --> for Pandas
    import synapse.ml.spark.aifunc as aifunc --> for PySpark
     
    Nevertheless, thanks for the support here in this thread!
    v-karpurapud may I can take my own answer as solution?

     

v-karpurapud's avatar
v-karpurapud
Community Support
8 months ago

Hi Mauro89

Could you let us know if the issue was resolved after creating the support case?If you have any further questions, please let us know. we can assist you further.

 

Regards,

Microsoft Fabric Community Support Team

Mauro89's avatar
Mauro89
Super User
8 months ago

Hi v-karpurapud,

 

we are still on it, trying to figure out whats the issue.

I will keep the thread posted 🙂

 

Best regards!

  • v-karpurapud's avatar
    v-karpurapud
    Community Support
    8 months ago

    Hi Mauro89 

    Thank You for the response.

    • Mauro89's avatar
      Mauro89
      Super User
      8 months ago

      v-karpurapud sooooo. I turned out to be the issue was sitting infront of the screen not in the screen ğŸ˜…

      I was only importing the libary for pandas and was not award that the pyspark library is a different one. So for all ready this post, the solution is to import the correct relevant library.

       

      import synapse.ml.aifunc as aifunc --> for Pandas
      import synapse.ml.spark.aifunc as aifunc --> for PySpark
       
      Nevertheless, thanks for the support here in this thread!
      v-karpurapud may I can take my own answer as solution?

       

      • v-karpurapud's avatar
        v-karpurapud
        Community Support
        8 months ago

        Hi Mauro89 

        Glad to hear, you found the solution. Yeah, You can mark your own post as Solution.