Toad for Hadoop Community

Toad for Hadoop Forum

Lukas Knapek
Follow / 28 Jan 2015 at 12:31pm / Toad for Hadoop

Troubleshooting: How to post a new question

Expand content
Hi guys! We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as: Do you use Toad...

Hi guys!

We appreciate your feedback. However, in order to resolve any issues that you may encounter, we would like you to provide us with as much information as possible, such as:

  • Do you use Toad for Apache Hadoop on Windows or on Mac OS?
  • Do you use Cloudera QuickStart VM? If so, what version?
  • Do you use Cloudera Distribution Hadoop (CDH) or other Hadoop Distribution solutions? If so, which version?
    • In case of Cloudera solutions, do you use Cloudera Manager?
    • In case of Hortonworks, do you use Ambari?
  • Can you describe your Hadoop ecosystem?
    • Do you use virtualization?
    • How many nodes are there in your Hadoop cluster approximately?
    • Do you use FQDN (fully qualified domain names) to identify your nodes, or IP addresses?

  • What error/issue have you encountered? Can you send us the specific error message or screenshot it?
  • Do you remember what you did before you encountered the error/issue? Does it happen everytime?

Please, try to answer these questions as best as you can when you create a new troubleshooting post. The more details you provide us, the faster we can resolve the issue.

Additionally, you can send us logs located in:

Win:

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\log 

..\Users\*user*\AppData\Roaming\Dell\Toad for Apache Hadoop\*version*\.metadata\.log.

Mac

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/log/log4j.log

/Users/[user]/Library/Containers/com.dell.ToadForApacheHadoop/Data/.dell/ Toad for Apache Hadoop/[version]/.metadata/.log

 

12857 0 / Create an account to join the discussion.
akshay-x
Follow / 9 Oct 2017 at 5:03pm / Toad for Hadoop
Latest post by on 10 Oct 2017 at 11:38pm

Not able to upload/download file to/from an encrypted area on hdf...

Expand content
Not able to upload/download file to/from an encrypted area on hdfs. Please suggest a resolution. We are getting the following error message while uploading a file via toad.

Not able to upload/download file to/from an encrypted area on hdfs. Please suggest a resolution.

We are getting the following error message while uploading a file via toad.

54 1 / Create an account to join the discussion.
dheeraj.muttreja
Follow / 9 Oct 2017 at 7:15pm / Toad for Hadoop
Latest post by on 10 Oct 2017 at 11:35pm

Toad For Hadoop issue with HDFS encrypted zone

Expand content
We are getting the following error message ERROR HDFSUploadHandler:288 - Error uploading HDFS file java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access...

We are getting the following error message

ERROR HDFSUploadHandler:288 - Error uploading HDFS file java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file

2017-10-09 18:58:54 ERROR HDFSUploadHandler:288 - Error uploading HDFS file
java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
2017-10-09 18:58:54 INFO DefaultExceptionParser:58 - java.security.PrivilegedActionException: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at com.dell.tfh.control.service.HDFSService.copy(HDFSService.java:977)
at com.dell.tfh.control.service.HDFSService.uploadFile(HDFSService.java:840)
at com.dell.tfh.control.service.HDFSService.upload(HDFSService.java:893)
at com.dell.tfh.gui.hdfs.handler.HDFSUploadHandler$1.runJob(HDFSUploadHandler.java:277)
at com.dell.tfh.gui.commons.jobs.AbstractToadJob.run(AbstractToadJob.java:163)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
Caused by: java.io.IOException: No KeyProvider is configured, cannot access an encrypted file
at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(DFSClient.java:1411)
at org.apache.hadoop.hdfs.DFSClient.createWrappedOutputStream(DFSClient.java:1522)
at org.apache.hadoop.hdfs.DFSClient.createWrappedOutputStream(DFSClient.java:1507)
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:408)
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:401)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:401)
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:344)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:920)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:901)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:798)
at com.dell.tfh.library.hadoop.cdh5.FileSystemCDH5.create(FileSystemCDH5.java:60)
at com.dell.tfh.control.service.HDFSService$22.run(HDFSService.java:980)
at com.dell.tfh.control.service.HDFSService$22.run(HDFSService.java:1)
... 8 more

50 1 / Create an account to join the discussion.
Medin
Follow / 30 Nov 2016 at 4:18pm / Toad for Hadoop
Latest post by on 6 Oct 2017 at 4:12am

Problem with JDBC connection in new version of TOAD 1.5.3

Expand content
Previously I used TOAD 1.5.1 and connecting via jdbc. Everything worked. Today I updated to TOAD version 1.5.3. Stopped working connecting via jdbc: The server failed to respond with a valid HTTP response...

Previously I used TOAD 1.5.1 and connecting via jdbc. Everything worked.
Today I updated to TOAD version 1.5.3. Stopped working connecting via jdbc: The server failed to respond with a valid HTTP response.

Looked at the log:
Caused by: org.apache.thrift.transport.TTransportException: Could not create http connection to jdbc:hive2://servername.net:10000/;transportMode=http;httpPath=param1;param2=true. org.apache.http.client.ClientProtocolException

The connection string should be: jdbc:hive2://servername.net:10000/param1;param2=true

Typed it in the tab "JDBC connection string" - all working again. Seem to version 1.5.3, there is a bug with the formation of the http request.

Ask to check.

515 1 / Create an account to join the discussion.
venkatkalyan141
Follow / 6 Oct 2017 at 3:48am / Toad for Hadoop

Unable to connect Hive through Toad.(It is not connecting, and failing...

Expand content
Hi, I have installed Horton Works VM. I downloaded the toad for hadoop plugin and I try to configure. It is not connecting, and failing at Hive host. It is telling host is not reachable. Where...

Hi, 

I have installed Horton Works VM.

I downloaded the toad for hadoop plugin and I try to configure.

It is not connecting, and failing at Hive host. It is telling host is not reachable.

Where as Iam able to run the queries from Hive view from Ambari page.

Please help me. and also find the attached file.

Thanks in advance.Error_Connecting to Hive.docx

44 0 / Create an account to join the discussion.
vbolla01
Follow / 9 May 2016 at 1:27pm / Toad for Hadoop
Latest post by on 27 Sep 2017 at 9:39am

Hadoop Ecosystem Configuration getting stuck at "Getting cluster...

Expand content
Hi, I'm trying to setup TOAD for Hadoop. We use Ambari and Hortonworks HDP 2.4. I enter the credentials and connection information information and it checks out everything until it gets to "Getting...

Hi,

I'm trying to setup TOAD for Hadoop.  We use Ambari and Hortonworks HDP 2.4.  I enter the credentials and connection information information and it  checks out everything until it gets to "Getting cluster configuration" and the status is "detecting...".  It won't advance past that step.

Any suggestions?

Thanks.

9219 28 / Create an account to join the discussion.
sushanta.samantaray
Follow / 25 Sep 2017 at 6:17pm / Toad for Hadoop

Issue in configuring Toad for hadoop with hadoop 2.6 version installed...

Expand content
Hi, I am new to using Toad for Hadoop. I have installed Toad for Hadoop 1.5.3 and Hadoop 2.6 is installed on my Ubuntu VM. I am trying to create a new ecosystem by manually doing the configuration. However...

Hi,

I am new to using Toad for Hadoop. I have installed Toad for Hadoop 1.5.3 and Hadoop 2.6 is installed on my Ubuntu VM. I am trying to create a new ecosystem by manually doing the configuration. However, not able to proceed with this and getting stuck at the first step itself and it is not able to identify the namenode FQDN.

I have attached the error screenshots for reference.

Any help is highly appreciated.

Thanks in Advance!!

52 0 / Create an account to join the discussion.
hive@2317
Follow / 23 Aug 2017 at 4:04pm / Toad for Hadoop

HDFS Configuration Error for CDH - (Class com.wandisco.fs.client.FusionHdfs...

Expand content
Hi Guys, While connecting to CDH server using Toad I am getting this error. HDFS configuration: An exception was caught. Class com.wandisco.fs.client.FusionHdfs not found I am using CDH5.5 driver...

Hi Guys,

While connecting to CDH server using Toad I am getting this error.

HDFS configuration:
An exception was caught.
Class com.wandisco.fs.client.FusionHdfs not found

I am using CDH5.5 driver version and tried same with 5.8 both gives the same error.

All the details for Namenode and Kerberos are entered correctly. Please let us know if this is known defect.

135 0 / Create an account to join the discussion.
bhargavp
Follow / 21 Aug 2017 at 1:36pm / Toad for Hadoop

error in transferring data from Oracle to Hive

Expand content
I am getting below error while transferring data from Oracle to Hive The table ban_errors has not been transfered: Cannot start transfer execution. UnknownHostException: HDFSNS

I am getting below error while transferring data from Oracle to Hive

The table ban_errors has not been transfered:

Cannot start transfer execution.
UnknownHostException: HDFSNS

 

 

90 0 / Create an account to join the discussion.
bhargavp
Follow / 21 Aug 2017 at 1:33pm / Toad for Hadoop

error in transferring data from HIVE to Oracle

Expand content
I am getting below error while transferring data from HIVE to Oracle. The table CYCLE_STATE has not been transfered: An exception was caught. org.apache.hadoop.ipc.RemoteException(java.io.IOException...

I am getting below error while transferring data from HIVE to Oracle.

The table CYCLE_STATE has not been transfered:

An exception was caught.
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/admin/.tfah/SQOOP_EXPORT/20170821_173943_587/lib/ToadManager.jar could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are excluded in this operation.

 

 

89 0 / Create an account to join the discussion.
boris.tyukin
Follow / 17 Aug 2017 at 6:57pm / Toad for Hadoop

is this product in active development?

Expand content
I love this tool but before I suggest it to my organization I wanted to ask if it is still in development. I noticed the last version came out last year. This tool really stands out from a crowd of other...

I love this tool but before I suggest it to my organization I wanted to ask if it is still in development. I noticed the last version came out last year.

This tool really stands out from a crowd of other SQL client. I was specifically looking for a client that can access logs and could not find one. Then I stumbled upon SO post and gave it a try. It is almost perfect as I can see map reduce logs but it looks like they are shown only once query is finished.

I love that I can check on jobs running and finished right from the tool. HDFS files capability and copy from oracle is pretty neat too.

thanks for such a great little tool!

157 0 / Create an account to join the discussion.
bambam229
Follow / 23 Jul 2015 at 3:29pm / Toad for Hadoop
Latest post by on 11 Aug 2017 at 1:20pm

Error Getting Cluster Configuration on v1.1.8

Expand content
Toad Hadoop Team, I tried out the v1.1.8 and the SSL component is working great. Thanks! During the New Ecosystem configuration, I got a red declamation point error in the wizard setup with the "Getting...

Toad Hadoop Team,

I tried out the v1.1.8 and the SSL component is working great.  Thanks!  

During the New Ecosystem configuration, I got a red declamation point error in the wizard setup with the "Getting Cluster Configuration" step.  We are using CDH 5.4.3.  Here is the error below.  There was no information in the Status or Notes fields in that wizard.

Thanks,

Brett

3802 5 / Create an account to join the discussion.
chetanm
Follow / 10 Aug 2017 at 6:08pm / Toad for Hadoop

After installing Tod for hadoop we got OS compatible issue

Expand content
Am using 32 bit Windows OS can i have Toad for this version.

Am using 32 bit Windows OS can i have Toad for this version.

101 0 / Create an account to join the discussion.
neilwangip
Follow / 21 Jul 2017 at 6:32am / Toad for Hadoop

when export to csv, fetch row one by one! dear devs, what're you...

Expand content
select * from t; returns over 100000 rows. i click save as csv, waiting... waiting... wait... then, i use wireshark to capture network traffic to see what's happening. i am totally shocked! can...

select * from t;

returns over 100000 rows. i click save as csv, waiting... waiting... wait...

then, i use wireshark to capture network traffic to see what's happening.

i am totally shocked! can you guess what i have seen? there is many many thrift request "FetchResults". fetching result one row by one row!

YOU ARE DELL INC. so i thinging it is not just a trivial performance issue for you big company, but a big bug! can you fix it?

163 0 / Create an account to join the discussion.
shales
Follow / 20 Jul 2017 at 9:42pm / Toad for Hadoop

Port 8088 is unreachable

185 0 / Create an account to join the discussion.
Chandra3
Follow / 7 Mar 2017 at 11:21am / Toad for Hadoop
Latest post by on 20 Jul 2017 at 9:15am

Toad for Hadoop - CDH 5.1 Error

Expand content
Hi Experts, I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported. Is there...

Hi Experts,

I have downloaded Toad for Hadoop 1.5.3 ( for windows). However when adding a new ecosystem ( I use Cloudera manager), I get the error saying my CDH version 5.1 is not supported.

Is there any workaround for the same.

Thanks.

972 8 / Create an account to join the discussion.
kadarinarendra
Follow / 14 Jul 2017 at 11:20am / Toad for Hadoop
Latest post by on 17 Jul 2017 at 11:54pm

how to compare data between hive table and XSD file with Data Diff...

Expand content
Hi My system configurations Toad Data point version : 4.2 system Ram : 6 GB Harddisk : 256 GB OS : windows 7 I am trying to compare Hive table with XSD file with Data Diff Viewer I have connected to...

Hi

My system configurations

Toad Data point  version :   4.2
system Ram                    :   6 GB 
Harddisk                          :   256 GB
OS                                   :   windows 7

I am trying to compare Hive table with XSD file with Data Diff Viewer

I have connected to hive database and Drag Drop employee table to Data Diff Viewer and From other side I have loaded XSD file

The source is Hive table and target is XSD file.


In the above screen, Target Columns are not viewing ?

This my XSD Format 

<?xml version="1.0" encoding="UTF-8"?>
<xs:schema attributeFormDefault="unqualified" elementFormDefault="qualified" xmlns:xs="www.w3.org/.../XMLSchema">
<xs:element name="DataTable" type="DataTableType"/>
<xs:complexType name="DataTableType">
<xs:sequence>
<xs:element type="employeeType" name="employee" maxOccurs="unbounded" minOccurs="0"/>
</xs:sequence>
</xs:complexType>
<xs:complexType name="employeeType">
<xs:sequence>
<xs:element name="eid">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="1201"/>
<xs:enumeration value="1202"/>
<xs:enumeration value=""/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="name">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Gopal1"/>
<xs:enumeration value="Manish2"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="salary">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="45000"/>
<xs:enumeration value="40000"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="destination">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="Technical manager"/>
<xs:enumeration value="Proof reader"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element type="xs:string" name="address1"/>
<xs:element type="xs:string" name="address2"/>
</xs:sequence>
</xs:complexType>
</xs:schema>



Is there any alternative to compare data  between hive table and XSD file ?  


Regards
Narendra k

258 1 / Create an account to join the discussion.
tspecht
Follow / 26 Jun 2017 at 7:34pm / Toad for Hadoop

New Ecosystem initialization

Expand content
Running Toad for Apache Hadoop version 1.5.3 on Mac OSX Sierra connecting to Cloudera 5.8 environment with 5 virtual data nodes I have tried using FQDN and IP addresses Quick configuration works...

Running Toad for Apache Hadoop version 1.5.3 on Mac OSX Sierra

connecting to Cloudera 5.8 environment with 5 virtual data nodes

I have tried using FQDN and IP addresses

Quick configuration works as expected

Ecosystem Configuration works, check credentials works

use keytab option

password blank

Username and realm will be overridden by keytab, continue YES

JCE is active

When I get to the screen to the next screen

SQL, Charts, and Logs are Green

HDFS and Transfer are Red the following errors are thrown

HDFS fails:

A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu123.nh.corp@HADOOP.NANTHEALTH.COM

when I retry

A problem has occured. Server has invalid Kerberos principal: hdfs/c01nhvu121.nh.corp@HADOOP.NANTHEALTH.COM

these are name nodes

In the toad logs I see errors like this:

!ENTRY com.dell.tfh.library.hadoop.cdh5.8 4 0 2017-06-26 10:34:44.179
!MESSAGE FrameworkEvent ERROR
!STACK 0
java.io.IOException: Exception in opening zip file: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar

Caused by: java.io.FileNotFoundException: /Users/teds/Library/Containers/com.dell.ToadForApacheHadoop/Data/.eclipse/415756717_macosx_cocoa_x86_64/configuration/org.eclipse.osgi/20/0/.cp/lib/sqoop-1.4.6-cdh5.8.0.jar (No such file or directory)

222 0 / Create an account to join the discussion.
Anson1000
Follow / 23 Jun 2017 at 5:22pm / Toad for Hadoop
Latest post by on 26 Jun 2017 at 2:43am

How to connect to HUE browser in Microsoft Azure cloud

Expand content
I just install Toad for Hadoop. How to connect to HUE browser in Microsoft Azure cloud We have HUE browser URL, username, and password Thanks

I just install Toad for Hadoop. How to connect to HUE browser in Microsoft Azure cloud 

We have HUE browser  URL, username, and password

Thanks

251 1 / Create an account to join the discussion.
ram3881
Follow / 25 Apr 2017 at 6:48pm / Toad for Hadoop
Latest post by on 22 May 2017 at 10:44pm

Toad High CPU usage and Memory issues

Expand content
Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed. Looks like there is some background process is taking lot of CPU & RAM Only work...

Toad for Hadoop is taking High CPU usage and Memory which is causing to not return data after few queries executed.

Looks like there is some background process is taking lot of CPU & RAM

Only work around I'm using is restarting Toad after few queries executed!

519 2 / Create an account to join the discussion.