Hadoop - Adding Datanode


 
Thread Tools Search this Thread
Operating Systems Linux Hadoop - Adding Datanode
# 1  
Old 02-21-2014
Hadoop - Adding Datanode

Hi Team ,

I have a new server which needs to be made as datanode for my existing single node cloudera setup .

I did gone through some of the online documentation and most of them said to install to through cloudera manager , However my server cannot open for internet , Hence using Cloudera installing hadoop on new data node is ruled out .

Could some one help me with step by step procedure for installing hadoop on a new server and move that as a new data node to existing Hadoop Cluster .

Thanks again
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. Programming

To check file size in hadoop

Hi Guys, i am writng a script to check if the file size is lessthan limit say 10KB then exit i need to check in hadoop file system , can someone advise Minsize=10 for file in `hadoop fs -ls path/*` do Actualsize=$(du -k "$file" | cut -f 1) if ; then echo "File generated... (7 Replies)
Discussion started by: rohit_shinez
7 Replies

2. UNIX for Dummies Questions & Answers

Hadoop file system

Hi, I am newbie to unix admin. I am doing migration from unix to puppet. Need few clarification in hadoop fille creation. I knew what hadoop file does. But my doubt is, do we need to restart service for hadoop file creation. "DL380p" ha_file_cre='/root/hadoopfile logit echo "Creating... (3 Replies)
Discussion started by: stew
3 Replies

3. Red Hat

Hadoop - Upgrade Issue

Hi All, I was recently trying to upgrade Hadoop from CDH4 to CDH5 ,however after upgrade found below issue , Looks like this is a known issue but unable to find a proper solution for it . log4j:ERROR Could not find value for key log4j.appender.EventCounter log4j:ERROR Could not instantiate... (3 Replies)
Discussion started by: Tomlight
3 Replies

4. Linux

Hadoop - Adding New Name Node

Currently my cloudera env is a single server ( Name node and Data node on the same server ) , Now i would like to create another Name node for HA purpose and configure zookeeper to Automate HA , However I am unware of adding a new server as a name node part of HA , Could some one please suggest the... (0 Replies)
Discussion started by: rakesh_411
0 Replies

5. UNIX for Dummies Questions & Answers

Hadoop HUE - Error

Hi , I have installed Cloudera Hadoop successfully however when i am launching the web page for HUE , I am receiving below error message. Configuration files located in /var/run/cloudera-scm-agent/process/65-hue-HUE_SERVER Potential misconfiguration detected. Fix and restart... (4 Replies)
Discussion started by: rakesh_411
4 Replies
Login or Register to Ask a Question
ipa-replica-install(1)						 IPA Manual Pages					    ipa-replica-install(1)

NAME
ipa-replica-install - Create an IPA replica SYNOPSIS
ipa-replica-install [OPTION]... replica_file DESCRIPTION
Configures a new IPA server that is a replica of the server that generated it. Once it has been created it is an exact copy of the original IPA server and is an equal master. Changes made to any master are automatically replicated to other masters. The replica_file is created using the ipa-replica-prepare utility. If the installation fails you may need to run ipa-server-install --uninstall before running ipa-replica-install again. The installation will fail if the host you are installing the replica on exists as a host in IPA or an existing replication agreement exists (for example, from a previously failed installation). A replica should only be installed on the same or higher version of IPA on the remote system. OPTIONS
BASIC OPTIONS --setup-ca Install and configure a CA on this replica. If a CA is not configured then certificate operations will be forwarded to a master with a CA installed. --ip-address=IP_ADDRESS The IP address of this server. If this address does not match the address the host resolves to and --setup-dns is not selected the installation will fail. If the server hostname is not resolvable, a record for the hostname and IP_ADDRESS is added to /etc/hosts. -p DM_PASSWORD, --password=DM_PASSWORD Directory Manager (existing master) password -w ADMIN_PASSWORD, --admin-password=ADMIN_PASSWORD Admin user Kerberos password used for connection check --mkhomedir Create home directories for users on their first login -N, --no-ntp Do not configure NTP --no-ui-redirect Do not automatically redirect to the Web UI. --ssh-trust-dns Configure OpenSSH client to trust DNS SSHFP records. --no-ssh Do not configure OpenSSH client. --no-sshd Do not configure OpenSSH server. --skip-conncheck Skip connection check to remote master -d, --debug Enable debug logging when more verbose output is needed -U, --unattended An unattended installation that will never prompt for user input CERTIFICATE SYSTEM OPTIONS --skip-schema-check Skip check for updated CA DS schema on the remote master DNS OPTIONS --setup-dns Generate a DNS zone if it does not exist already and configure the DNS server. This option requires that you either specify at least one DNS forwarder through the --forwarder option or use the --no-forwarders option. --forwarder=IP_ADDRESS Add a DNS forwarder to the DNS configuration. You can use this option multiple times to specify more forwarders, but at least one must be provided, unless the --no-forwarders option is specified. --no-forwarders Do not add any DNS forwarders. Root DNS servers will be used instead. --reverse-zone=REVERSE_ZONE The reverse DNS zone to use --no-reverse Do not create new reverse DNS zone. If a reverse DNS zone already exists for the subnet, it will be used. --no-host-dns Do not use DNS for hostname lookup during installation --no-dns-sshfp Do not automatically create DNS SSHFP records. EXIT STATUS
0 if the command was successful 1 if an error occurred 3 if the host exists in the IPA server or a replication agreement to the remote master already exists IPA
May 16 2012 ipa-replica-install(1)