Forum Discussion

P_work's avatar
P_work
Helper I
7 months ago

Intermittent errors jdbc spark

   
server_name =
database_name =
    jdbc_url = f"jdbc:sqlserver://{server_name}:1433;database={database_name};loginTimeout=30;"
    access_token = notebookutils.credentials.getToken("pbi") 
    connection_properties = {
        "accessToken": access_token
    }
    spark read or write jdbc(jdbc_url, "<MY_TABLE>", read or append, properties=connection_properties)
​
The above code results in the below error very intermittently. Note, with reads or writes.
 
An error occurred while calling o6642.jdbc.
: com.microsoft.sqlserver.jdbc.SQLServerException: Login failed for user ''.Reason: Validation of user's permissions failed. 
Verify the user has the Read item permission. For more information, see https://go.microsoft.com/fwlink/?linkid=2281595. 
ClientConnectionId
com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:259)
com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:304)
com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:137)
com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:42)
com.microsoft.sqlserver.jdbc.SQLServerConnection.sendLogon(SQLServerConnection.java:6612)
com.microsoft.sqlserver.jdbc.SQLServerConnection.logon(SQLServerConnection.java:5154)
com.microsoft.sqlserver.jdbc.SQLServerConnection.access$300(SQLServerConnection.java:94)
com.microsoft.sqlserver.jdbc.SQLServerConnection$LogonCommand.doExecute(SQLServerConnection.java:5087)
com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7675)
com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:4137)
com.microsoft.sqlserver.jdbc.SQLServerConnection.connectHelper(SQLServerConnection.java:3583)
com.microsoft.sqlserver.jdbc.SQLServerConnection.login(SQLServerConnection.java:3172)
com.microsoft.sqlserver.jdbc.SQLServerConnection.connectInternal(SQLServerConnection.java:3014)
com.microsoft.sqlserver.jdbc.SQLServerConnection.connect(SQLServerConnection.java:1836)
com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:1246)
org.apache.spark.sql.execution.datasources.jdbc.connection.BasicConnectionProvider.getConnection(BasicConnectionProvider.scala:49)
org.apache.spark.sql.execution.datasources.jdbc.connection.ConnectionProviderBase.create(ConnectionProvider.scala:102)
org.apache.spark.sql.jdbc.JdbcDialect.$anonfun$createConnectionFactory$1(JdbcDialects.scala:161)
org.apache.spark.sql.jdbc.JdbcDialect.$anonfun$createConnectionFactory$1$adapted(JdbcDialects.scala:157)
org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.getQueryOutputSchema(JDBCRDD.scala:63)
org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:58)
org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation$.getSchema(JDBCRelation.scala:241)
org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:37)
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:346)
org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:236)
org.apache.spark.sql.DataFrameReader.$anonfun$load$2(DataFrameReader.scala:219)
scala.Option.getOrElse(Option.scala:189)
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:219)
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:174)
org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:261)
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base/java.lang.reflect.Method.invoke(Method.java:566)
py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374)
py4j.Gateway.invoke(Gateway.java:282)
py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
py4j.commands.CallCommand.execute(CallCommand.java:79)
py4j.GatewayConnection.run(GatewayConnection.java:238)
java.base/java.lang.Thread.run(Thread.java:829)
SQL database

5 Replies

Replies have been turned off for this discussion
  • dlevy's avatar
    dlevy
    Microsoft Employee
    7 months ago

    Hi P_work - I'm Dave from the SQL drivers team.

     

    Any chance this is happening when the notebook takes longer than an hour to run?

  • P_work's avatar
    P_work
    Helper I
    7 months ago

    I investigated the payload. The token expires in an hour. My notebook job completes in well under an hour. I have multiple instance of this notebook running (3). Each notebooks token is distinct.  All three notebook instances also complete in well under an hour.

  • spaceman127's avatar
    spaceman127
    Super User
    7 months ago

    Hi P_work 

    I would like to recreate the problem.
    Can you tell me more about your setup?
    There are several factors involved, and it would be helpful if we knew what they were.

     

    Best regards

  • Anonymous's avatar
    Anonymous
    Not applicable
    7 months ago

    Hi P_work,

     

    Thank you for reaching out to the Microsoft Fabric Forum Community, and special thanks to dlevy and spaceman127  for prompt and helpful responses.

     

    Just checking, have you had a chance to open a support ticket, as suggested by dlevy . If so, we'd love to hear the current status or any updates from that.

    If the issue was resolved through the support ticket, it would be great if you could share the solution here as well. It could really help other community members find answers more quickly.

     

    Warm regards,
    Prasanna Kumar