If you are setting up Puppet with Hadoop, you should only need to start the services as the node becomes part of the distributed file system. Normally this service would start at boot and the server would join the Haddoop world.
The script does not create hadoop distributed file systems, the script creates standard linux ext4 file systems which Hadoop will use. Below you can see the output from the command;
You will see under the "id" column the number "83" this identifies the file system type.
To see how the file systems are used you can run the "mount" command like this;
Hi Guys,
i am writng a script to check if the file size is lessthan limit say 10KB then exit
i need to check in hadoop file system , can someone advise
Minsize=10
for file in `hadoop fs -ls path/*`
do
Actualsize=$(du -k "$file" | cut -f 1)
if ; then
echo "File generated... (7 Replies)
Hi All,
I was recently trying to upgrade Hadoop from CDH4 to CDH5 ,however after upgrade found below issue , Looks like this is a known issue but unable to find a proper solution for it .
log4j:ERROR Could not find value for key log4j.appender.EventCounter log4j:ERROR Could not instantiate... (3 Replies)
Hi Team ,
I have a new server which needs to be made as datanode for my existing single node cloudera setup .
I did gone through some of the online documentation and most of them said to install to through cloudera manager , However my server cannot open for internet , Hence using Cloudera... (0 Replies)
Hi ,
I have installed Cloudera Hadoop successfully however when i am launching the web page for HUE , I am receiving below error message.
Configuration files located in /var/run/cloudera-scm-agent/process/65-hue-HUE_SERVER
Potential misconfiguration detected. Fix and restart... (4 Replies)
Hi friends,
In my case, there are serveral PCs running Linux in a LAN.
I would like to to mount the directory /A_river of machine-A to the file system of another machine machine-B so that I can access files in that directory.
I do not know how to do this. The situation is complicated by... (2 Replies)