Forum Discussion

aesposito's avatar
aesposito
Frequent Visitor
7 years ago

Update data in Import mode and refresh graphic elements in DirectQuery mode - Hadoop tables

Hi, I'm Andrea from Italy, sorry for my bad english.

 

I have 2 problems exposed in the following.
I'd like to plan the auto refresh of data (the data source are 3 Hadoop Tables) in order to auto update my Power BI reports.
I'm in test phase, and I have some problem in doing that.

  1. I have installed and configured the OPDG on a machine that should be always on;
  2. I have signed in with my enterprise account;
  3. In the Power BI online work-space I have connected to the OPDG 2 sets of data (these sets of data are connected to the same 3 tables: the first set is configured as DirectQuery, the second one as Import)

With this configuration, if I try to update the data, it is succesfull only for the first set (the one connected in DirectQuery to the source tables), the other one (connected in Import mode) gives me an error -> PROBLEM 1

On the other hand, if I plan the update, even if in the history update the the DQ set of data is updated, the reports built on that set of data cannot auto-refresh the graphic elements -> PROBLEM 2

As regards the Import set of data the planned data refreshing appear to fail, as in "manual" case.

 

This is the error given to the first problem:

 

Codice errore sottostante: -2147467259 Table: aircrowd_affollamento_rt.
Messaggio di errore sottostante: ERROR [HY000] [Microsoft][ImpalaODBC] (120) Error while retrieving data from in Impala: [HY000] : Disk I/O error: Failed to open HDFS file hdfs://prodhdpsave/user/hive/warehouse/produzione.db/aircrowd_affollamento_rt/year_dt=2019/month_dt=5/day_dt=13/e44580aaf76dba11-1847479e00000019_286854767_data.0.parq Error(2): No such file or directory Root cause: RemoteException: File does not exist: /user/hive/warehouse/produzione.db/aircrowd_affollamento_rt/year_dt=2019/month_dt=5/day_dt=13/e44580aaf76dba11-1847479e00000019_286854767_data.0.parq at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:66) at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:56) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:2157) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2127) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2040) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:583) at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.getBlockLocations(AuthorizationProviderProxyClientProtocol.java:94) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:377) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2281) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2277) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2275)
DM_ErrorDetailNameCode_UnderlyingHResult: -2147467259
Microsoft.Data.Mashup.ValueError.Reason: DataSource.Error
URI cluster: WABI-EUROPE-NORTH-B-redirect.analysis.windows.net
ID attività: 2d235986-5b37-465a-98b5-b743653ba5d3
ID richiesta: ccde7f06-0f1d-756a-d85e-4699cbc9043f
Ora: 2019-05-13 09:19:09Z

 

Reproduction of the problems:

 

PROBLEM 1

The problem of the auto refresh of the report after the update of the DQ-connected dataset always persist. To refresh the graphic objects I have to click the refresh button, and my client don't want it.

 

PROBLEM2

The other problem (about the planned update of Import-connected dataset) can be reproduced: by clicking the updating button.

 

 

Thanks,

Andrea

2 Replies

  • v-yuta-msft's avatar
    v-yuta-msft
    Community Support

    aesposito ,

     

    I would suggest you to create a support ticket here.

     

    Community Support Team _ Jimmy Tao

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • aesposito's avatar
      aesposito
      Frequent Visitor

      v-yuta-msft 

       

      Thanks for the answer.

       

      Yesterday, before writing the post, I tried to open a ticket about the problem.

      I cannot do it because the uploaded image (15 Kb!!!!) is considered too big :smileyfrustrated: 

      I tried to upload different formats of images, but the problem was always the same.

       

      Thanks for the suggestion, I retry today.

       

       

      Andrea

       

      Andrea