Toad for Hadoop Forum - Toad for Hadoop - Toad World

Toad for Hadoop Community

Toad for Hadoop Forum

Danny Torres
Follow / 1 Nov 2016 at 1:37pm / Toad for Hadoop

We are now on Twitter!!! Contact a Technical Support expert today...

Expand content
Do you have a quick support question and short of time? Contact us Via Twitter @ QuestExperts and we will take care of you. #Jointheinnovation #WeareQuest

Do you have a quick support question and short of time? Contact us Via Twitter  @QuestExperts and we will take care of you. #Jointheinnovation #WeareQuest

431 0 / Create an account to join the discussion.
Lukas Knapek
Follow / 28 Jan 2015 at 12:31pm / Toad for Hadoop

Troubleshooting: How to post a new question

Expand content
Hi guys! We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as: Do you use Toad...

Hi guys!

We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as:

  • Do you use Toad for Apache Hadoop on Windows or on Mac OS?
  • Do you use Cloudera QuickStart VM? If so, what version?
  • Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version?
    • In case of Cloudera solutions, do you use Cloudera Manager?
    • In case of Hortonworks, do you use Ambari?
  • Can you describe your Hadoop ecosystem?
    • Do you use virtualization?
    • How many nodes are there in your Hadoop cluster approximately?
    • Do you use FQDN (fully qualified domain names) to identify your nodes, or IP addresses?

  • What error/issue have you encountered? Can you send us the specific error message or screenshot it?
  • Do you remember what you did before you encountered the error/issue? Does it happen everytime?

Please, try to answer these questions as best as you can when you create a new troubleshooting post. The more details you provide us, the faster we can resolve the issue.

Additionally, you can send us logs located in:

Win:

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\log 

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\.metadata\.log.

Mac

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/log/log4j.log

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/.metadata/.log

 

12018 0 / Create an account to join the discussion.
oliverbuckleysalmon
Follow / 29 Mar 2017 at 11:55am / Toad for Hadoop

Error Connecting to Hive - PermGen error

Expand content
Hi, I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error 2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to...

Hi,

I previously had no problem connecting Toad to Hive, but since creating a new large (74 column) table I keep getting the following error

2017-03-29 10:17:33 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://gmcctd05.uk.db.com:10015: java.net.ConnectException: Connection refused: connect
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:217)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:155)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.SparkTester.testConnection(SparkTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused: connect
 at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
 at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
 at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
 at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
 ... 16 common frames omitted
Caused by: java.net.ConnectException: Connection refused: connect
 at java.net.DualStackPlainSocketImpl.connect0(Native Method)
 at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
 at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
 at java.net.PlainSocketImpl.connect(Unknown Source)
 at java.net.SocksSocketImpl.connect(Unknown Source)
 at java.net.Socket.connect(Unknown Source)
 at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
 ... 19 common frames omitted
2017-03-29 10:18:02 ERROR HiveDriverHDP2:119 - Unable to create a Hive connection
org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 common frames omitted
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 common frames omitted
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 common frames omitted
Caused by: java.lang.OutOfMemoryError: PermGen space
2017-03-29 10:18:02 INFO  DefaultExceptionParser:58 - com.dell.tfh.control.connection.test.TestException
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:42)
 at com.dell.tfh.control.connection.TestableConfiguration.testConfiguration(TestableConfiguration.java:45)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:43)
 at com.dell.tfh.control.service.ConnectionTesterCallable.call(ConnectionTesterCallable.java:1)
 at java.util.concurrent.FutureTask.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)
Caused by: java.security.PrivilegedActionException: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Unknown Source)
 at com.dell.tfh.control.hive.JDBCClient.createClient(JDBCClient.java:363)
 at com.dell.tfh.control.hive.JDBCClient.testConnection(JDBCClient.java:1868)
 at com.dell.tfh.control.connection.test.HiveTester.testConnection(HiveTester.java:40)
 ... 5 more
Caused by: com.dell.tfh.library.hadoop.exception.HadoopDriverException: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:120)
 at com.dell.tfh.control.hive.JDBCClient$1.run(JDBCClient.java:373)
 ... 10 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:262)
 at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:253)
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:555)
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:170)
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at java.sql.DriverManager.getConnection(Unknown Source)
 at com.dell.tfh.library.hive.hdp2.HiveDriverHDP2.newHiveConnection(HiveDriverHDP2.java:115)
 ... 11 more
Caused by: org.apache.hive.service.cli.HiveSQLException: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:266)
 at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402)
 at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253)
 at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238)
 at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
 at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
 at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
 at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
 at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
 at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
 at com.sun.proxy.$Proxy19.open(Unknown Source)
 at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:258)
 ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
 at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:137)
 at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
 ... 20 more
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
 at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005)
 at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024)
 at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
 ... 25 more
Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException:null
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
 ... 31 more
Caused by: java.lang.OutOfMemoryError: PermGen space

I can connect to Hive via the shell and query the table no problem.

Thanks in advance for your help,

Oliver

22 0 / Create an account to join the discussion.
vetechsoftware
Follow / 9 Mar 2017 at 11:46am / Toad for Hadoop
Latest post by on 16 Mar 2017 at 7:20am

Unable to transfer MYSQL data in Hive Database

Expand content
Hello guys, I am running Toad for Appache Hadoop 1.5.3 , Virtual Box 5.0.12, and Cloudera Quickstart VM 5.8.0. to perfrom data clustering of MYSQL data in Hadoop Hive However, I am Unable to transfer...

Hello guys,

I  am running Toad for Appache Hadoop 1.5.3 , Virtual  Box 5.0.12,  and Cloudera Quickstart VM 5.8.0.  to perfrom data clustering of  MYSQL data in Hadoop Hive

However, I am Unable to transfer MYSQL data in Hive Database

1. First, I connect MYSQL DB , its show all tables 

2. Select the Required table for execution

3. Perfrom Execution to Hive Data Conversion

4. Finally, I go this error 

5. Sqoop command

sqoop export -Dsqoop.throwOnError=true --connect jdbc:mysql://localhost:3306/ twopp?useUnicode=true&characterEncoding=utf8 --username root --password-file hdfs://quickstart.cloudera:8020/user/cloudera/.tfah/SQOOP_EXPORT/20170309_134140_458/.password --num-mappers 1 --table "data" --columns T__,COL,COL_ --export-dir hdfs://quickstart.cloudera:8020/user/hive/warehouse/harendra.db/data --input-fields-terminated-by \0x1 --escaped-by \

6. Console Output

Failed to tranfer the data into hive

Please give me suggestion  ASAP

Regards

Gyan

100 1 / Create an account to join the discussion.
Chandra3
Follow / 7 Mar 2017 at 11:21am / Toad for Hadoop
Latest post by on 8 Mar 2017 at 2:18pm

Toad for Hadoop - CDH 5.1 Error

Expand content
Hi Experts, I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported. Is there...

Hi Experts,

I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported.

Is there any workaround for the same.

Thanks.

144 4 / Create an account to join the discussion.
g3uuam
Follow / 27 Dec 2016 at 4:44pm / Toad for Hadoop
Latest post by on 7 Mar 2017 at 12:11pm

Issues connecting to HDP Hadoop platform from Toad for Hadoop too...

Expand content
Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment. ◦ Do you...

Hi, I'm trying to connect to Hadoop cluster using Toad for Hadoop tool , as I'm evaluating the tool for the enterprise wise usage. Here is some information regarding the environment.

◦ Do you use Toad for Apache Hadoop on Windows or on Mac OS? -- (Windows)

◦ Do you use Cloudera QuickStart VM? If so, what version? -- (NO)

◦ Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version? --(HDP 2.5)

◦ In case of Cloudera solutions, do you...

In case of Hortonworks, do you use Ambari?

--For only Administration purpose.

981 25 / Create an account to join the discussion.
bepisugaman
Follow / 3 Mar 2017 at 9:31am / Toad for Hadoop
Latest post by on 3 Mar 2017 at 10:00am

Support for Windows SSO

Expand content
Hello, We are using Toad on Windows to connect to a Kerberized CDH 5.8.3. Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows...

Hello,

We are using Toad on Windows to connect to a Kerberized CDH 5.8.3.

Since our Windows PC are connected to the same domain of the cluster is it possible to configure Toad to use directly the windows ticket cache? So the user can login to the cluster without typing username/password again?

I know that the access to the windows' ticket cache from java is a grey area (it requires a register key as stated here) but does it works with toad?

Thanks,
bepi

116 1 / Create an account to join the discussion.
bepisugaman
Follow / 1 Mar 2017 at 9:51am / Toad for Hadoop
Latest post by on 3 Mar 2017 at 6:14am

Specify custom krb5.conf/krb5.ini file location

Expand content
Hello, We are using toad to connect to a Kerberized CDH cluster. With some work I've managed to get it working by copying the /etc/krb5.conf file from the cluster and saving it to c:\Windows\krb5...

Hello,

We are using toad to connect to a Kerberized CDH cluster. With some work I've managed to get it working by copying the /etc/krb5.conf file from the cluster and saving it to c:\Windows\krb5.ini: without this file, toad fails with generic GSS exceptions.

Is it possibile to customize the location for this file?

According to java documentation the user can specify a JVM parameter (java.security.krb5.conf) but I haven't found a way to pass these to toad on startup. Any suggestion?

Thanks,
Bepi

160 5 / Create an account to join the discussion.
khurram.majeed
Follow / 22 Feb 2017 at 9:17am / Toad for Hadoop
Latest post by on 24 Feb 2017 at 9:44pm

Apache Knox integration

Expand content
Its been a while since last update for T4H. Can you please advise me when can we expect the next release? Are there are any plans to support Apache Knox in the next version? As I saw in the forum and...

Its been a while since last update for T4H. Can you please advise me when can we expect the next release?

Are there are any plans to support Apache Knox in the next version?

As I saw in the forum and Idea Pond, there are quite a few people asking for Knox support. 

many thanks

179 1 / Create an account to join the discussion.
pdevault2
Follow / 24 Feb 2017 at 1:16pm / Toad for Hadoop

Add feature for Impala (JDBC Connection String)

Expand content
I am not able to use impala, The connection string generate with Impala using SSL and LDAP is not good Bad URL format. Hostname not found in authority part of the url: sirius-test.ubisoft.org:21050;ssl...

I am not able to use impala,
The connection string generate with

Impala using SSL and LDAP is not good

Bad URL format. Hostname not found  in authority part of the url: sirius-test.ubisoft.org:21050;ssl=true;sslTrustStore=C:. Are you missing a '/' after the hostname ?

Missing "/default"

It will be nice to have same feature as hive connection to allow us to set jdbc connection string for impala.

Thnaks

152 0 / Create an account to join the discussion.
vbolla01
Follow / 9 May 2016 at 1:27pm / Toad for Hadoop
Latest post by on 23 Feb 2017 at 12:04pm

Hadoop Ecosystem Configuration getting stuck at "Getting cluster...

Expand content
Hi, I'm trying to setup TOAD for Hadoop. We use Ambari and Hortonworks HDP 2.4. I enter the credentials and connection information information and it checks out everything until it gets to "Getting...

Hi,

I'm trying to setup TOAD for Hadoop.  We use Ambari and Hortonworks HDP 2.4.  I enter the credentials and connection information information and it  checks out everything until it gets to "Getting cluster configuration" and the status is "detecting...".  It won't advance past that step.

Any suggestions?

Thanks.

5093 27 / Create an account to join the discussion.
nf_bsb
Follow / 22 Feb 2016 at 8:11pm / Toad for Hadoop
Latest post by on 22 Feb 2017 at 9:10am

Connecting to Hive. With Knox enabled on the cluster

Expand content
Was this issue ever resolved. I'm using HDP. Everything works fine except SQL. I get this error. ----- Hive configuration: Could not open client transport with JDBC Uri: jdbc:hive2://xxx:xxx...

Was this issue ever resolved. I'm using HDP. Everything works fine except SQL. I get this error.

-----

Hive configuration:

Could not open client transport with JDBC Uri: jdbc:hive2://xxx:xxx/;: java.net.ConnectException: Connection refused: connect

------

There are no logs. so, hard to tell where error is coming from.

Also, the cluster I'm connecting to has knox. not sure if that's potentially an issue.

2467 4 / Create an account to join the discussion.
Bohdar Herman
Follow / 29 Jun 2016 at 4:19pm / Toad for Hadoop
Latest post by on 13 Feb 2017 at 9:40am

Java Heap Space error

Expand content
I was using the HDFS perspective and got this Internal Error about java heap space. Using Toad for Hadoop 1.5.1 on Windows 7 Professional 64 bit, Java 1.8.0_91

I was using the HDFS perspective and got this Internal Error about java heap space. Using Toad for Hadoop 1.5.1 on Windows 7 Professional 64 bit, Java 1.8.0_91

2493 8 / Create an account to join the discussion.
anver Sadhat
Follow / 10 Feb 2017 at 4:43am / Toad for Hadoop
Latest post by on 13 Feb 2017 at 9:36am

How to run Toad for Hadoop behind a proxy

Expand content
Hi, I used to connect to the cloudera manager Web UI by running tunneling from command prompt "$ssh -C -N -D 1234 servername" and then configure the proxy in Browser using 1234 port. But...

Hi,

       I used to connect to the cloudera manager Web UI by running tunneling from command prompt "$ssh -C -N -D 1234 servername" and then configure the proxy in Browser using 1234 port.   

       But how this can be achieved in Toad for Hadoop - Since I could not see any Proxy setting in Toad for Hadoop.

Regards

Anver

206 1 / Create an account to join the discussion.
alena_1
Follow / 21 Jul 2016 at 1:28pm / Toad for Hadoop
Latest post by on 10 Feb 2017 at 9:53am

Problem with getting results of Hive-queries

Expand content
We use Toad for Hadoop very often and really like it. However, there is one annoying problem. From time to tome Toad does not display the query results, only an empty table. In the status bar there...

We use Toad for Hadoop very often and really like it.

However, there is one annoying problem. 

From time to tome Toad does not display the query results, only an empty table. In the status bar there is label "Row 1 of 0 fetched rows (memory full)".
Sometimes it helps to restart Toads. Sometimes nothing works.

How to cope with this problem?


My computer: RAM 8Gb, CPU i3 3.3oGhz

3728 7 / Create an account to join the discussion.
ramesh123
Follow / 25 Jan 2017 at 4:14pm / Toad for Hadoop
Latest post by on 30 Jan 2017 at 12:14am

IBM BIGINSIGHTS Connection

Expand content
I am trying to connect to IBM BIGINSIGHTS using HDP managed by Ambari Method... it is kind of stuck after "cluster detection is complete'. Below is the snapshot and log Which method should be...

I am trying to connect to IBM BIGINSIGHTS using HDP managed by Ambari Method... it is kind of stuck after "cluster detection is complete'. Below is the snapshot and log

Which method should be used to configure Biginsights cluster

!ENTRY org.eclipse.core.jobs 4 2 2017-01-25 11:01:47.570
!MESSAGE An internal error occurred during: "Ambari Detection Job".
!STACK 0
java.lang.NullPointerException
 at com.dell.tfh.gui.commons.detection.task.HDP2VersionCheckTask.<init>(HDP2VersionCheckTask.java:34)
 at com.dell.tfh.gui.commons.detection.ambari.AmbariConfDetector.startDetection(AmbariConfDetector.java:142)
 at com.dell.tfh.gui.commons.detection.DetectionJob.run(DetectionJob.java:144)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)

Thanks

ramesh

325 2 / Create an account to join the discussion.
Doobles
Follow / 4 Jan 2017 at 1:11pm / Toad for Hadoop
Latest post by on 11 Jan 2017 at 7:20am

Knox Server Integration

Expand content
Hi All, New to the board and hoping you can all help :) Reading through past messages on the board it seems like Knox Server integration was not in place back in February 2016. Based upon experiences...

Hi All, 

New to the board and hoping you can all help :)

Reading through past messages on the board it seems like Knox Server integration was not in place back in February 2016. 

Based upon experiences currently I presume it still doesn't exist.

Is there an expectation of when this may be introduced and/or a link to the backlog so I can upvote this feature?

291 1 / Create an account to join the discussion.
porizj
Follow / 25 Oct 2016 at 9:29pm / Toad for Hadoop
Latest post by on 9 Jan 2017 at 7:44pm

"Columns" tab throwing an error in "Object Detail"...

Expand content
Hi there, Running against an HDP 2.5 cluster (VMs, but not the HDP sandbox). When I go to the "Columns" tab of the "Object Detail" pane, I get this error message: It's...

Hi there,

Running against an HDP 2.5 cluster (VMs, but not the HDP sandbox).

When I go to the "Columns" tab of the "Object Detail" pane, I get this error message:

It's not a big deal because queries still work and I can see the list of columns under the table in the browser to the left, but it's worth figuring out what the problem is.

Here's a log snippet:

2016-10-25 21:53:34 ERROR HiveTableViewerPart:720 - Unable to load Hive table data [Table=city]
com.dell.tfh.control.exception.LoaderException: com.dell.tfh.control.exception.LoaderException: java.lang.IllegalArgumentException: Invalid type
2016-10-25 21:53:34 INFO DefaultExceptionParser:58 - com.dell.tfh.control.exception.LoaderException: com.dell.tfh.control.exception.LoaderException: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.control.loader.hive.HiveColumnCollectionLoader.loadCollection(HiveColumnCollectionLoader.java:107)
at com.dell.tfh.control.service.ModelService.loadCollectionInward(ModelService.java:529)
at com.dell.tfh.control.service.ModelService.loadCollection(ModelService.java:503)
at com.dell.tfh.gui.commons.jobs.JobsService.loadChildrenBlocking(JobsService.java:335)
at com.dell.tfh.gui.commons.jobs.JobsService.loadChildrenBlocking(JobsService.java:368)
at com.dell.tfh.gui.hive.part.AbstractUpdateTableChildrenJob.runJob(AbstractUpdateTableChildrenJob.java:119)
at com.dell.tfh.gui.commons.jobs.AbstractToadJob.run(AbstractToadJob.java:162)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
Caused by: com.dell.tfh.control.exception.LoaderException: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.control.loader.hive.HiveColumnLoader.loadDetails(HiveColumnLoader.java:75)
at com.dell.tfh.control.service.ModelService.loadDetail(ModelService.java:886)
at com.dell.tfh.control.loader.AbstractCollectionLoader.loadDetailsInternal(AbstractCollectionLoader.java:43)
at com.dell.tfh.control.loader.hive.HiveColumnCollectionLoader.loadCollection(HiveColumnCollectionLoader.java:103)
... 7 more
Caused by: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.model.hive.HiveDataTypeInstance.parseStringDataType(HiveDataTypeInstance.java:167)
at com.dell.tfh.control.hive.JDBCClient.fillColumnWithDetails(JDBCClient.java:1075)
at com.dell.tfh.control.hive.JDBCClient.getColumnDetails(JDBCClient.java:1053)
at com.dell.tfh.control.service.QueryService$20.run(QueryService.java:527)
at com.dell.tfh.control.service.QueryService$20.run(QueryService.java:1)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.service.QueryService.getColumnDetail(QueryService.java:524)
at com.dell.tfh.control.loader.hive.HiveColumnLoader.loadDetails(HiveColumnLoader.java:73)
... 10 more

And a metadata log snippet:


!ENTRY com.dell.tfh.gui.hive 4 0 2016-10-25 21:53:45.622
!MESSAGE Unable to load Hive table data
!STACK 0
com.dell.tfh.control.exception.LoaderException: com.dell.tfh.control.exception.LoaderException: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.control.loader.hive.HiveColumnCollectionLoader.loadCollection(HiveColumnCollectionLoader.java:107)
at com.dell.tfh.control.service.ModelService.loadCollectionInward(ModelService.java:529)
at com.dell.tfh.control.service.ModelService.loadCollection(ModelService.java:503)
at com.dell.tfh.gui.commons.jobs.JobsService.loadChildrenBlocking(JobsService.java:335)
at com.dell.tfh.gui.commons.jobs.JobsService.loadChildrenBlocking(JobsService.java:368)
at com.dell.tfh.gui.hive.part.AbstractUpdateTableChildrenJob.runJob(AbstractUpdateTableChildrenJob.java:119)
at com.dell.tfh.gui.commons.jobs.AbstractToadJob.run(AbstractToadJob.java:162)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
Caused by: com.dell.tfh.control.exception.LoaderException: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.control.loader.hive.HiveColumnLoader.loadDetails(HiveColumnLoader.java:75)
at com.dell.tfh.control.service.ModelService.loadDetail(ModelService.java:886)
at com.dell.tfh.control.loader.AbstractCollectionLoader.loadDetailsInternal(AbstractCollectionLoader.java:43)
at com.dell.tfh.control.loader.hive.HiveColumnCollectionLoader.loadCollection(HiveColumnCollectionLoader.java:103)
... 7 more
Caused by: java.lang.IllegalArgumentException: Invalid type
at com.dell.tfh.model.hive.HiveDataTypeInstance.parseStringDataType(HiveDataTypeInstance.java:167)
at com.dell.tfh.control.hive.JDBCClient.fillColumnWithDetails(JDBCClient.java:1075)
at com.dell.tfh.control.hive.JDBCClient.getColumnDetails(JDBCClient.java:1053)
at com.dell.tfh.control.service.QueryService$20.run(QueryService.java:527)
at com.dell.tfh.control.service.QueryService$20.run(QueryService.java:1)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.service.QueryService.getColumnDetail(QueryService.java:524)
at com.dell.tfh.control.loader.hive.HiveColumnLoader.loadDetails(HiveColumnLoader.java:73)
... 10 more

Not sure if this matters, but it's an ORC table.

Any ideas what could be causing this?

Thanks,

JP

818 4 / Create an account to join the discussion.
Roberto
Follow / 31 Mar 2016 at 1:47pm / Toad for Hadoop
Latest post by on 6 Jan 2017 at 12:31pm

Access HDFS using Port-Forwarding (Toad for Hadoop 1.3.1 on Windows...

Expand content
Hi, My question is about how to configure HDFS in case my computer is not able to connect directly to the namenode server. To be more precise, at the moment I have to use a jump server to connect with...

Hi,
My question is about how to configure HDFS in case my computer is not able to connect directly to the namenode server. To be more precise, at the moment I have to use a jump server to connect with the Hadoop Stack. I therefore use putty together with port forwarding to get access to different Hadoop tools with my local (desktop) tools (connection to the jumps server with different port forwarding's to nodes in the cluster). That works pretty fine for Impala but now I struggle with the HDFS connection.  My putty connection forwards the local port 18020 to namenode.hostname:8020. Inside Toad I then use host "localhost" and port 18020 to configure HDFS. But Toad says "HDFS configuration:
A problem has occured. NameNode host is not specified as FQDN." But using FQDN seems to be difficult, or not?

Is there any trick to get the connection working?

Thanks and best regards,

Roberto

2536 4 / Create an account to join the discussion.
liwoxt
Follow / 1 Nov 2016 at 7:07am / Toad for Hadoop
Latest post by on 4 Jan 2017 at 5:27pm

Add Ecosystem and cannot Next or Finsh

Expand content
First time to use toad for apache hadoop, I add my ecosystem in following: 1. Use 'HDP managed by Ambari' to locate my hadoop 2. Input Server Address, User Name, Password ---- [success] 3...

First time to use toad for apache hadoop, I add my ecosystem in following:

1. Use 'HDP managed by Ambari' to locate my hadoop

2. Input Server Address, User Name, Password ---- [success]

3. stuck in this part as below screen cap.

Can not find next or Finsh button can be clicked. What should I do ???

876 6 / Create an account to join the discussion.