Toad for Hadoop Forum - Toad for Hadoop - Toad World

Toad for Hadoop Community

Toad for Hadoop Forum

Danny Torres
Follow / 1 Nov 2016 at 1:37pm / Toad for Hadoop

We are now on Twitter!!! Contact a Technical Support expert today...

Expand content
Do you have a quick support question and short of time? Contact us Via Twitter @ QuestExperts and we will take care of you. #Jointheinnovation #WeareQuest

Do you have a quick support question and short of time? Contact us Via Twitter  @QuestExperts and we will take care of you. #Jointheinnovation #WeareQuest

493 0 / Create an account to join the discussion.
Lukas Knapek
Follow / 28 Jan 2015 at 12:31pm / Toad for Hadoop

Troubleshooting: How to post a new question

Expand content
Hi guys! We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as: Do you use Toad...

Hi guys!

We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as:

  • Do you use Toad for Apache Hadoop on Windows or on Mac OS?
  • Do you use Cloudera QuickStart VM? If so, what version?
  • Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version?
    • In case of Cloudera solutions, do you use Cloudera Manager?
    • In case of Hortonworks, do you use Ambari?
  • Can you describe your Hadoop ecosystem?
    • Do you use virtualization?
    • How many nodes are there in your Hadoop cluster approximately?
    • Do you use FQDN (fully qualified domain names) to identify your nodes, or IP addresses?

  • What error/issue have you encountered? Can you send us the specific error message or screenshot it?
  • Do you remember what you did before you encountered the error/issue? Does it happen everytime?

Please, try to answer these questions as best as you can when you create a new troubleshooting post. The more details you provide us, the faster we can resolve the issue.

Additionally, you can send us logs located in:

Win:

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\log 

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\.metadata\.log.

Mac

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/log/log4j.log

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/.metadata/.log

 

12187 0 / Create an account to join the discussion.
ram3881
Follow / 25 Apr 2017 at 6:48pm / Toad for Hadoop
Latest post by on 22 May 2017 at 10:44pm

Toad High CPU usage and Memory issues

Expand content
Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed. Looks like there is some background process is taking lot of CPU & RAM Only work...

Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed.

Looks like there is some background process is taking lot of CPU & RAM

Only work around I'm using is restarting Toad after few queries executed!

128 2 / Create an account to join the discussion.
hotcat312
Follow / 4 May 2017 at 3:20am / Toad for Hadoop

Toad for Hadoop query not progress

Expand content
when query ,the state alway is submitting and not progress,but can return result

when query ,the state alway is submitting and not progress,but can return result

58 0 / Create an account to join the discussion.
g3uuam
Follow / 27 Dec 2016 at 4:44pm / Toad for Hadoop
Latest post by on 2 May 2017 at 4:52pm

Issues connecting to HDP Hadoop platform from Toad for Hadoop too...

Expand content
Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment. ◦ Do you...

Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment.

◦ Do you use Toad for Apache Hadoop on Windows or on Mac OS? -- (Windows)

◦ Do you use Cloudera QuickStart VM? If so, what version? -- (NO)

◦ Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version? --(HDP 2.5)

◦ In case of Cloudera solutions, do you...

In case of Hortonworks, do you use Ambari?

--For only Administration purpose.

1539 26 / Create an account to join the discussion.
shales
Follow / 6 Apr 2017 at 9:33pm / Toad for Hadoop

Error when configuring new Ecosystem - Checking YARN RM Port, Port...

130 0 / Create an account to join the discussion.
bquinart
Follow / 8 Jul 2016 at 3:13pm / Toad for Hadoop
Latest post by on 5 Apr 2017 at 10:14pm

CDH config detection not working because not able to connect to YARN...

Expand content
I'm trying to configure Toad for Hadoop with our Cloudera 5.5 cluster (16 nodes). Unfortunately, I get stuck immediately with the config window (YARN part). However, we have SSL/TLS enabled...

I'm trying to configure Toad for Hadoop with our Cloudera 5.5 cluster (16 nodes).

Unfortunately, I get stuck immediately with the config window (YARN part).

However, we have SSL/TLS enabled for the webapp for YARN RM. So the info is on port 8090. Nothing can be found on port 8088.

I don't know if Toad just assumes it can find it there or if Cloudera Manager is somehow not giving the right information (the yarn-site.xml has both the yarn.resourcemanager.webapp.address.xyz and yarn.resourcemanager.webapp.https.address values).

Any help?

1631 5 / Create an account to join the discussion.
oliverbuckleysalmon
Follow / 29 Mar 2017 at 11:55am / Toad for Hadoop
Latest post by on 30 Mar 2017 at 11:50am

Error Connecting to Hive - PermGen error

Expand content
Hi, I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error 2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to...

Hi,

I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error

2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://gmcctd05.uk.db.com:10015: java.net.ConnectException: Connection refused: connect
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:217)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:155)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.SparkTester.testConnection(SparkTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused: connect
 at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
 at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
 at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
 ... 16 common frames omitted
Caused by: java.net.ConnectException: Connection refused: connect
 at java.net.DualStackPlainSocketImpl.connect0(Native Method)
 at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
 at java.net.PlainSocketImpl.connect(Unknown Source)
 at java.net.SocksSocketImpl.connect(Unknown Source)
 at java.net.Socket.connect(Unknown Source)
 at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
 ... 19 common frames omitted
2017-03-29 10:18:02 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 common frames omitted
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 common frames omitted
Caused by: java.lang.OutOfMemoryError: PermGen space
2017-03-29 10:18:02 INFO  DefaultExceptionParser:58 - com.dell.tfh.control.connection.test.TestException
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:42)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: java.security.PrivilegedActionException: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 ... 5 more
Caused by: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:120)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 ... 10 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 ... 11 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 more
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 more
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 more
Caused by: java.lang.OutOfMemoryError: PermGen space

I can connect to Hive via the shell and query the table no problem.

Thanks in advance for your help,

Oliver

179 1 / Create an account to join the discussion.
vetechsoftware
Follow / 9 Mar 2017 at 11:46am / Toad for Hadoop
Latest post by on 16 Mar 2017 at 7:20am

Unable to transfer MYSQL data in Hive Database

Expand content
Hello guys, I am running Toad for Appache Hadoop 1.5.3 , Virtual Box 5.0.12, and Cloudera Quickstart VM 5.8.0. to perfrom data clustering of MYSQL data in Hadoop Hive However, I am Unable to transfer...

Hello guys,

I  am running Toad for Appache Hadoop 1.5.3 , Virtual  Box 5.0.12,  and Cloudera Quickstart VM 5.8.0.  to perfrom data clustering of  MYSQL data in Hadoop Hive

However, I am Unable to transfer MYSQL data in Hive Database

1. First, I connect MYSQL DB , its show all tables 

2. Select the Required table for execution

3. Perfrom Execution to Hive Data Conversion

4. Finally, I go this error 

5. Sqoop command

sqoop export -Dsqoop.throwOnError=true --connect jdbc:mysql://localhost:3306/ twopp?useUnicode=true&characterEncoding=utf8 --username root --password-file hdfs://quickstart.cloudera:8020/user/cloudera/.tfah/SQOOP_EXPORT/20170309_134140_458/.password --num-mappers 1 --table "data" --columns T__,COL,COL_ --export-dir hdfs://quickstart.cloudera:8020/user/hive/warehouse/harendra.db/data --input-fields-terminated-by \0x1 --escaped-by \

6. Console Output

Failed to tranfer the data into hive

Please give me suggestion  ASAP

Regards

Gyan

241 1 / Create an account to join the discussion.
Chandra3
Follow / 7 Mar 2017 at 11:21am / Toad for Hadoop
Latest post by on 8 Mar 2017 at 2:18pm

Toad for Hadoop - CDH 5.1 Error

Expand content
Hi Experts, I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported. Is there...

Hi Experts,

I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported.

Is there any workaround for the same.

Thanks.

323 4 / Create an account to join the discussion.
bepisugaman
Follow / 3 Mar 2017 at 9:31am / Toad for Hadoop
Latest post by on 3 Mar 2017 at 10:00am

Support for Windows SSO

Expand content
Hello, We are using Toad on Windows to connect to a Kerberized CDH 5.8.3. Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows...

Hello,

We are using Toad on Windows to connect to a Kerberized CDH 5.8.3.

Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows ticket cache? So the user can login to the cluster without typing username/password again?

I know that the access to the windows' ticket cache from java is a grey area (it requires a register key as stated here) but does it works with toad?

Thanks,
bepi

223 1 / Create an account to join the discussion.
bepisugaman
Follow / 1 Mar 2017 at 9:51am / Toad for Hadoop
Latest post by on 3 Mar 2017 at 6:14am

Specify custom krb5.conf/krb5.ini file location

Expand content
Hello, We are using toad to connect to a Kerberized CDH cluster. With some work I've managed to get it working by copying the /etc/krb5.conf file from the cluster and saving it to c:\Windows\krb5...

Hello,

We are using toad to connect to a Kerberized CDH cluster. With some work I've managed to get it working by copying the /etc/krb5.conf file from the cluster and saving it to c:\Windows\krb5.ini: without this file, toad fails with generic GSS exceptions.

Is it possibile to customize the location for this file?

According to java documentation the user can specify a JVM parameter (java.security.krb5.conf) but I haven't found a way to pass these to toad on startup. Any suggestion?

Thanks,
Bepi

336 5 / Create an account to join the discussion.
khurram.majeed
Follow / 22 Feb 2017 at 9:17am / Toad for Hadoop
Latest post by on 24 Feb 2017 at 9:44pm

Apache Knox integration

Expand content
Its been a while since last update for T4H. Can you please advise me when can we expect the next release? Are there are any plans to support Apache Knox in the next version? As I saw in the forum and...

Its been a while since last update for T4H. Can you please advise me when can we expect the next release?

Are there are any plans to support Apache Knox in the next version?

As I saw in the forum and Idea Pond, there are quite a few people asking for Knox support. 

many thanks

321 1 / Create an account to join the discussion.
pdevault2
Follow / 24 Feb 2017 at 1:16pm / Toad for Hadoop

Add feature for Impala (JDBC Connection String)

Expand content
I am not able to use impala, The connection string generate with Impala using SSL and LDAP is not good Bad URL format. Hostname not found in authority part of the url: sirius-test.ubisoft.org:21050;ssl...

I am not able to use impala,
The connection string generate with

Impala using SSL and LDAP is not good

Bad URL format. Hostname not found  in authority part of the url: sirius-test.ubisoft.org:21050;ssl=true;sslTrustStore=C:. Are you missing a '/' after the hostname ?

Missing "/default"

It will be nice to have same feature as hive connection to allow us to set jdbc connection string for impala.

Thnaks

243 0 / Create an account to join the discussion.
vbolla01
Follow / 9 May 2016 at 1:27pm / Toad for Hadoop
Latest post by on 23 Feb 2017 at 12:04pm

Hadoop Ecosystem Configuration getting stuck at "Getting cluster...

Expand content
Hi, I'm trying to setup TOAD for Hadoop. We use Ambari and Hortonworks HDP 2.4. I enter the credentials and connection information information and it checks out everything until it gets to "Getting...

Hi,

I'm trying to setup TOAD for Hadoop.  We use Ambari and Hortonworks HDP 2.4.  I enter the credentials and connection information information and it  checks out everything until it gets to "Getting cluster configuration" and the status is "detecting...".  It won't advance past that step.

Any suggestions?

Thanks.

6009 27 / Create an account to join the discussion.
nf_bsb
Follow / 22 Feb 2016 at 8:11pm / Toad for Hadoop
Latest post by on 22 Feb 2017 at 9:10am

Connecting to Hive. With Knox enabled on the cluster

Expand content
Was this issue ever resolved. I'm using HDP. Everything works fine except SQL. I get this error. ----- Hive configuration: Could not open client transport with JDBC Uri: jdbc:hive2://xxx:xxx...

Was this issue ever resolved. I'm using HDP. Everything works fine except SQL. I get this error.

-----

Hive configuration:

Could not open client transport with JDBC Uri: jdbc:hive2://xxx:xxx/;: java.net.ConnectException: Connection refused: connect

------

There are no logs. so, hard to tell where error is coming from.

Also, the cluster I'm connecting to has knox. not sure if that's potentially an issue.

2641 4 / Create an account to join the discussion.
Bohdar Herman
Follow / 29 Jun 2016 at 4:19pm / Toad for Hadoop
Latest post by on 13 Feb 2017 at 9:40am

Java Heap Space error

Expand content
I was using the HDFS perspective and got this Internal Error about java heap space. Using Toad for Hadoop 1.5.1 on Windows 7 Professional 64 bit, Java 1.8.0_91

I was using the HDFS perspective and got this Internal Error about java heap space. Using Toad for Hadoop 1.5.1 on Windows 7 Professional 64 bit, Java 1.8.0_91

2771 8 / Create an account to join the discussion.
anver Sadhat
Follow / 10 Feb 2017 at 4:43am / Toad for Hadoop
Latest post by on 13 Feb 2017 at 9:36am

How to run Toad for Hadoop behind a proxy

Expand content
Hi, I used to connect to the cloudera manager Web UI by running tunneling from command prompt "$ssh -C -N -D 1234 servername" and then configure the proxy in Browser using 1234 port. But...

Hi,

       I used to connect to the cloudera manager Web UI by running tunneling from command prompt "$ssh -C -N -D 1234 servername" and then configure the proxy in Browser using 1234 port.   

       But how this can be achieved in Toad for Hadoop - Since I could not see any Proxy setting in Toad for Hadoop.

Regards

Anver

309 1 / Create an account to join the discussion.
alena_1
Follow / 21 Jul 2016 at 1:28pm / Toad for Hadoop
Latest post by on 10 Feb 2017 at 9:53am

Problem with getting results of Hive-queries

Expand content
We use Toad for Hadoop very often and really like it. However, there is one annoying problem. From time to tome Toad does not display the query results, only an empty table. In the status bar there...

We use Toad for Hadoop very often and really like it.

However, there is one annoying problem. 

From time to tome Toad does not display the query results, only an empty table. In the status bar there is label "Row 1 of 0 fetched rows (memory full)".
Sometimes it helps to restart Toads. Sometimes nothing works.

How to cope with this problem?


My computer: RAM 8Gb, CPU i3 3.3oGhz

4076 7 / Create an account to join the discussion.
ramesh123
Follow / 25 Jan 2017 at 4:14pm / Toad for Hadoop
Latest post by on 30 Jan 2017 at 12:14am

IBM BIGINSIGHTS Connection

Expand content
I am trying to connect to IBM BIGINSIGHTS using HDP managed by Ambari Method... it is kind of stuck after "cluster detection is complete'. Below is the snapshot and log Which method should be...

I am trying to connect to IBM BIGINSIGHTS using HDP managed by Ambari Method... it is kind of stuck after "cluster detection is complete'. Below is the snapshot and log

Which method should be used to configure Biginsights cluster

!ENTRY org.eclipse.core.jobs 4 2 2017-01-25 11:01:47.570
!MESSAGE An internal error occurred during: "Ambari Detection Job".
!STACK 0
java.lang.NullPointerException
 at com.dell.tfh.gui.commons.detection.task.HDP2VersionCheckTask.<init>(HDP2VersionCheckTask.java:34)
 at com.dell.tfh.gui.commons.detection.ambari.AmbariConfDetector.startDetection(AmbariConfDetector.java:142)
 at com.dell.tfh.gui.commons.detection.DetectionJob.run(DetectionJob.java:144)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)

Thanks

ramesh

447 2 / Create an account to join the discussion.