Toad for Hadoop Community

Toad for Hadoop Forum

Lukas Knapek
Follow / 28 Jan 2015 at 12:31pm / Toad for Hadoop

Troubleshooting: How to post a new question

Expand content
Hi guys! We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as: Do you use Toad...

Hi guys!

We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as:

  • Do you use Toad for Apache Hadoop on Windows or on Mac OS?
  • Do you use Cloudera QuickStart VM? If so, what version?
  • Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version?
    • In case of Cloudera solutions, do you use Cloudera Manager?
    • In case of Hortonworks, do you use Ambari?
  • Can you describe your Hadoop ecosystem?
    • Do you use virtualization?
    • How many nodes are there in your Hadoop cluster approximately?
    • Do you use FQDN (fully qualified domain names) to identify your nodes, or IP addresses?

  • What error/issue have you encountered? Can you send us the specific error message or screenshot it?
  • Do you remember what you did before you encountered the error/issue? Does it happen everytime?

Please, try to answer these questions as best as you can when you create a new troubleshooting post. The more details you provide us, the faster we can resolve the issue.

Additionally, you can send us logs located in:

Win:

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\log 

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\.metadata\.log.

Mac

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/log/log4j.log

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/.metadata/.log

 

12464 0 / Create an account to join the discussion.
bhargavp
Follow / 21 Aug 2017 at 1:36pm / Toad for Hadoop

error in transferring data from Oracle to Hive

Expand content
I am getting below error while transferring data from Oracle to Hive The table ban_errors has not been transfered: Cannot start transfer execution. UnknownHostException: HDFSNS

I am getting below error while transferring data from Oracle to Hive

The table ban_errors has not been transfered:

Cannot start transfer execution.
UnknownHostException: HDFSNS

 

 

21 0 / Create an account to join the discussion.
bhargavp
Follow / 21 Aug 2017 at 1:33pm / Toad for Hadoop

error in transferring data from HIVE to Oracle

Expand content
I am getting below error while transferring data from HIVE to Oracle. The table CYCLE_STATE has not been transfered: An exception was caught. org.apache.hadoop.ipc.RemoteException(java.io.IOException...

I am getting below error while transferring data from HIVE to Oracle.

The table CYCLE_STATE has not been transfered:

An exception was caught.
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/admin/.tfah/SQOOP_EXPORT/20170821_173943_587/lib/ToadManager.jar could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are excluded in this operation.

 

 

18 0 / Create an account to join the discussion.
boris.tyukin
Follow / 17 Aug 2017 at 6:57pm / Toad for Hadoop

is this product in active development?

Expand content
I love this tool but before I suggest it to my organization I wanted to ask if it is still in development. I noticed the last version came out last year. This tool really stands out from a crowd of other...

I love this tool but before I suggest it to my organization I wanted to ask if it is still in development. I noticed the last version came out last year.

This tool really stands out from a crowd of other SQL client. I was specifically looking for a client that can access logs and could not find one. Then I stumbled upon SO post and gave it a try. It is almost perfect as I can see map reduce logs but it looks like they are shown only once query is finished.

I love that I can check on jobs running and finished right from the tool. HDFS files capability and copy from oracle is pretty neat too.

thanks for such a great little tool!

48 0 / Create an account to join the discussion.
bambam229
Follow / 23 Jul 2015 at 3:29pm / Toad for Hadoop
Latest post by on 11 Aug 2017 at 1:20pm

Error Getting Cluster Configuration on v1.1.8

Expand content
Toad Hadoop Team, I tried out the v1.1.8 and the SSL component is working great. Thanks! During the New Ecosystem configuration, I got a red declamation point error in the wizard setup with the "Getting...

Toad Hadoop Team,

I tried out the v1.1.8 and the SSL component is working great.  Thanks!  

During the New Ecosystem configuration, I got a red declamation point error in the wizard setup with the "Getting Cluster Configuration" step.  We are using CDH 5.4.3.  Here is the error below.  There was no information in the Status or Notes fields in that wizard.

Thanks,

Brett

3671 5 / Create an account to join the discussion.
chetanm
Follow / 10 Aug 2017 at 6:08pm / Toad for Hadoop

After installing Tod for hadoop we got OS compatible issue

Expand content
Am using 32 bit Windows OS can i have Toad for this version.

Am using 32 bit Windows OS can i have Toad for this version.

39 0 / Create an account to join the discussion.
neilwangip
Follow / 21 Jul 2017 at 6:32am / Toad for Hadoop

when export to csv, fetch row one by one! dear devs, what're you...

Expand content
select * from t; returns over 100000 rows. i click save as csv, waiting... waiting... wait... then, i use wireshark to capture network traffic to see what's happening. i am totally shocked! can...

select * from t;

returns over 100000 rows. i click save as csv, waiting... waiting... wait...

then, i use wireshark to capture network traffic to see what's happening.

i am totally shocked! can you guess what i have seen? there is many many thrift request "FetchResults". fetching result one row by one row!

YOU ARE DELL INC. so i thinging it is not just a trivial performance issue for you big company, but a big bug! can you fix it?

91 0 / Create an account to join the discussion.
shales
Follow / 20 Jul 2017 at 9:42pm / Toad for Hadoop

Port 8088 is unreachable

95 0 / Create an account to join the discussion.
Chandra3
Follow / 7 Mar 2017 at 11:21am / Toad for Hadoop
Latest post by on 20 Jul 2017 at 9:15am

Toad for Hadoop - CDH 5.1 Error

Expand content
Hi Experts, I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported. Is there...

Hi Experts,

I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported.

Is there any workaround for the same.

Thanks.

740 8 / Create an account to join the discussion.
kadarinarendra
Follow / 14 Jul 2017 at 11:20am / Toad for Hadoop
Latest post by on 17 Jul 2017 at 11:54pm

how to compare data between hive table and XSD file with Data Diff...

Expand content
Hi My system configurations Toad Data point version : 4.2 system Ram : 6 GB Harddisk : 256 GB OS : windows 7 I am trying to compare Hive table with XSD file with Data Diff Viewer I have connected to...

Hi

My system configurations

Toad Data point  version :   4.2
system Ram                    :   6 GB 
Harddisk                          :   256 GB
OS                                   :   windows 7

I am trying to compare Hive table with XSD file with Data Diff Viewer

I have connected to hive database and Drag Drop employee table to Data Diff Viewer and From other side I have loaded XSD file

The source is Hive table and target is XSD file.


In the above screen, Target Columns are not viewing ?

This my XSD Format 

<?xml version="1.0" encoding="UTF-8"?>
<xs:schema attributeFormDefault="unqualified" elementFormDefault="qualified" xmlns:xs="www.w3.org/.../XMLSchema">
<xs:element name="DataTable" type="DataTableType"/>
<xs:complexType name="DataTableType">
<xs:sequence>
<xs:element type="employeeType" name="employee" maxOccurs="unbounded" minOccurs="0"/>
</xs:sequence>
</xs:complexType>
<xs:complexType name="employeeType">
<xs:sequence>
<xs:element name="eid">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="1201"/>
<xs:enumeration value="1202"/>
<xs:enumeration value=""/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="name">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Gopal1"/>
<xs:enumeration value="Manish2"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="salary">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="45000"/>
<xs:enumeration value="40000"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="destination">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Technical manager"/>
<xs:enumeration value="Proof reader"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element type="xs:string" name="address1"/>
<xs:element type="xs:string" name="address2"/>
</xs:sequence>
</xs:complexType>
</xs:schema>



Is there any alternative to compare data  between hive table and XSD file ?  


Regards
Narendra k

132 1 / Create an account to join the discussion.
tspecht
Follow / 26 Jun 2017 at 7:34pm / Toad for Hadoop

New Ecosystem initialization

Expand content
Running Toad for Apache Hadoop version 1.5.3 on Mac OSX Sierra connecting to Cloudera 5.8 environment with 5 virtual data nodes I have tried using FQDN and IP addresses Quick configuration works...

Running Toad for Apache Hadoop version 1.5.3 on Mac OSX Sierra

connecting to Cloudera 5.8 environment with 5 virtual data nodes

I have tried using FQDN and IP addresses

Quick configuration works as expected

Ecosystem Configuration works, check credentials works

use keytab option

password blank

Username and realm will be overridden by keytab, continue YES

JCE is active

When I get to the screen to the next screen

SQL, Charts, and Logs are Green

HDFS and Transfer are Red the following errors are thrown

HDFS fails:

A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu123.nh.corp@HADOOP.NANTHEALTH.COM

when I retry

A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu121.nh.corp@HADOOP.NANTHEALTH.COM

these are name nodes

In the toad logs I see errors like this:

!ENTRY com.dell.tfh.library.hadoop.cdh5.8 4 0 2017-06-26 10:34:44.179
!MESSAGE FrameworkEvent ERROR
!STACK 0
java.io.IOException: Exception in opening zip file: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar

Caused by: java.io.FileNotFoundException: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar (No such file or directory)

138 0 / Create an account to join the discussion.
Anson1000
Follow / 23 Jun 2017 at 5:22pm / Toad for Hadoop
Latest post by on 26 Jun 2017 at 2:43am

How to connect to HUE browser in Microsoft Azure cloud

Expand content
I just install Toad for Hadoop. How to connect to HUE browser in Microsoft Azure cloud We have HUE browser URL, username, and password Thanks

I just install Toad for Hadoop. How to connect to HUE browser in Microsoft Azure cloud 

We have HUE browser  URL, username, and password

Thanks

154 1 / Create an account to join the discussion.
ram3881
Follow / 25 Apr 2017 at 6:48pm / Toad for Hadoop
Latest post by on 22 May 2017 at 10:44pm

Toad High CPU usage and Memory issues

Expand content
Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed. Looks like there is some background process is taking lot of CPU & RAM Only work...

Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed.

Looks like there is some background process is taking lot of CPU & RAM

Only work around I'm using is restarting Toad after few queries executed!

385 2 / Create an account to join the discussion.
hotcat312
Follow / 4 May 2017 at 3:20am / Toad for Hadoop

Toad for Hadoop query not progress

Expand content
when query ,the state alway is submitting and not progress,but can return result

when query ,the state alway is submitting and not progress,but can return result

199 0 / Create an account to join the discussion.
g3uuam
Follow / 27 Dec 2016 at 4:44pm / Toad for Hadoop
Latest post by on 2 May 2017 at 4:52pm

Issues connecting to HDP Hadoop platform from Toad for Hadoop too...

Expand content
Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment. ◦ Do you...

Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment.

◦ Do you use Toad for Apache Hadoop on Windows or on Mac OS? -- (Windows)

◦ Do you use Cloudera QuickStart VM? If so, what version? -- (NO)

◦ Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version? --(HDP 2.5)

◦ In case of Cloudera solutions, do you...

In case of Hortonworks, do you use Ambari?

--For only Administration purpose.

2545 26 / Create an account to join the discussion.
shales
Follow / 6 Apr 2017 at 9:33pm / Toad for Hadoop

Error when configuring new Ecosystem - Checking YARN RM Port, Port...

272 0 / Create an account to join the discussion.
bquinart
Follow / 8 Jul 2016 at 3:13pm / Toad for Hadoop
Latest post by on 5 Apr 2017 at 10:14pm

CDH config detection not working because not able to connect to YARN...

Expand content
I'm trying to configure Toad for Hadoop with our Cloudera 5.5 cluster (16 nodes). Unfortunately, I get stuck immediately with the config window (YARN part). However, we have SSL/TLS enabled...

I'm trying to configure Toad for Hadoop with our Cloudera 5.5 cluster (16 nodes).

Unfortunately, I get stuck immediately with the config window (YARN part).

However, we have SSL/TLS enabled for the webapp for YARN RM. So the info is on port 8090. Nothing can be found on port 8088.

I don't know if Toad just assumes it can find it there or if Cloudera Manager is somehow not giving the right information (the yarn-site.xml has both the yarn.resourcemanager.webapp.address.xyz and yarn.resourcemanager.webapp.https.address values).

Any help?

1937 5 / Create an account to join the discussion.
oliverbuckleysalmon
Follow / 29 Mar 2017 at 11:55am / Toad for Hadoop
Latest post by on 30 Mar 2017 at 11:50am

Error Connecting to Hive - PermGen error

Expand content
Hi, I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error 2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to...

Hi,

I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error

2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://gmcctd05.uk.db.com:10015: java.net.ConnectException: Connection refused: connect
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:217)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:155)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.SparkTester.testConnection(SparkTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused: connect
 at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
 at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
 at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
 ... 16 common frames omitted
Caused by: java.net.ConnectException: Connection refused: connect
 at java.net.DualStackPlainSocketImpl.connect0(Native Method)
 at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
 at java.net.PlainSocketImpl.connect(Unknown Source)
 at java.net.SocksSocketImpl.connect(Unknown Source)
 at java.net.Socket.connect(Unknown Source)
 at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
 ... 19 common frames omitted
2017-03-29 10:18:02 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 common frames omitted
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 common frames omitted
Caused by: java.lang.OutOfMemoryError: PermGen space
2017-03-29 10:18:02 INFO  DefaultExceptionParser:58 - com.dell.tfh.control.connection.test.TestException
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:42)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: java.security.PrivilegedActionException: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 ... 5 more
Caused by: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:120)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 ... 10 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 ... 11 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 more
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 more
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 more
Caused by: java.lang.OutOfMemoryError: PermGen space

I can connect to Hive via the shell and query the table no problem.

Thanks in advance for your help,

Oliver

423 1 / Create an account to join the discussion.
vetechsoftware
Follow / 9 Mar 2017 at 11:46am / Toad for Hadoop
Latest post by on 16 Mar 2017 at 7:20am

Unable to transfer MYSQL data in Hive Database

Expand content
Hello guys, I am running Toad for Appache Hadoop 1.5.3 , Virtual Box 5.0.12, and Cloudera Quickstart VM 5.8.0. to perfrom data clustering of MYSQL data in Hadoop Hive However, I am Unable to transfer...

Hello guys,

I  am running Toad for Appache Hadoop 1.5.3 , Virtual  Box 5.0.12,  and Cloudera Quickstart VM 5.8.0.  to perfrom data clustering of  MYSQL data in Hadoop Hive

However, I am Unable to transfer MYSQL data in Hive Database

1. First, I connect MYSQL DB , its show all tables 

2. Select the Required table for execution

3. Perfrom Execution to Hive Data Conversion

4. Finally, I go this error 

5. Sqoop command

sqoop export -Dsqoop.throwOnError=true --connect jdbc:mysql://localhost:3306/ twopp?useUnicode=true&characterEncoding=utf8 --username root --password-file hdfs://quickstart.cloudera:8020/user/cloudera/.tfah/SQOOP_EXPORT/20170309_134140_458/.password --num-mappers 1 --table "data" --columns T__,COL,COL_ --export-dir hdfs://quickstart.cloudera:8020/user/hive/warehouse/harendra.db/data --input-fields-terminated-by \0x1 --escaped-by \

6. Console Output

Failed to tranfer the data into hive

Please give me suggestion  ASAP

Regards

Gyan

435 1 / Create an account to join the discussion.
bepisugaman
Follow / 3 Mar 2017 at 9:31am / Toad for Hadoop
Latest post by on 3 Mar 2017 at 10:00am

Support for Windows SSO

Expand content
Hello, We are using Toad on Windows to connect to a Kerberized CDH 5.8.3. Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows...

Hello,

We are using Toad on Windows to connect to a Kerberized CDH 5.8.3.

Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows ticket cache? So the user can login to the cluster without typing username/password again?

I know that the access to the windows' ticket cache from java is a grey area (it requires a register key as stated here) but does it works with toad?

Thanks,
bepi

364 1 / Create an account to join the discussion.