Script help


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Script help
# 1  
Old 02-22-2016
Script help

Hi
I have data stored under the timestamp folder with subfolders ,i am planning write script to automate take the timestamp and process all the subfolders after completion ,then go to another time stamp and then process subfolders as well .
Can any one having any idea to do that(in that below script is $param1 as need to pass as a timestamp )

Code:
/zz/xx/20101001/a1
/zz/xx/20101001/a2
/zz/xx/20101002/a1
/zz/xx/20101002/a2
.....
.....

a.txt
1,2,3,4,5

for i in `cat /xx/a.txt |tr -s "," '\n' ` ; do
echo $i
input=/zz/xx/$param1/$i/*.z
output=/zz/xx/$param1/$i
sudo  hadoop jar /xx/hadoop-mapreduce/hadoop-streaming.jar -D  mapreduce.task.io.sort.factor=2 -D mapred.output.compress=true \
 -input $input  -output $output
rc=$?
if [ ${rc} -ne 0 ];then
echo "File not exist"
exit 1
fi
done


Last edited by mohan705; 02-22-2016 at 06:58 AM..
# 2  
Old 02-22-2016
Why hardcode when you can read what is there?

Try:
Code:
BASE=/zz/xx

for section in $BASE/*
do
	for item in $BASE/$section/*
	do
		echo "Found $item as content of $section within $BASE"
		echo "As in:	$BASE/$section/$item"
	done
done

hth
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to block first bash script until second bash script script launches web server/site?

I'm new to utilities like socat and netcat and I'm not clear if they will do what I need. I have a "compileDeployStartWebServer.sh" script and a "StartBrowser.sh" script that are started by emacs/elisp at the same time in two different processes. I'm using Cygwin bash on Windows 10. My... (3 Replies)
Discussion started by: siegfried
3 Replies

2. Shell Programming and Scripting

Shell script works fine as a standalone script but not as part of a bigger script

Hello all, I am facing a weird issue while executing a code below - #!/bin/bash cd /wload/baot/home/baotasa0/sandboxes_finance/ext_ukba_bde/pset sh UKBA_publish.sh UKBA 28082015 3 if then echo "Param file conversion for all the areas are completed, please check in your home directory"... (2 Replies)
Discussion started by: ektubbe
2 Replies

3. UNIX for Dummies Questions & Answers

Calling a script from master script to get value from called script

I am trying to call a script(callingscript.sh) from a master script(masterscript.sh) to get string type value from calling script to master script. I have used scripts mentioned below. #masterscript.sh ./callingscript.sh echo $fileExist #callingscript.sh echo "The script is called"... (2 Replies)
Discussion started by: Raj Roy
2 Replies

4. Shell Programming and Scripting

Script will keep checking running status of another script and also restart called script at night

I am using blow script :-- #!/bin/bash FIND=$(ps -elf | grep "snmp_trap.sh" | grep -v grep) #check snmp_trap.sh is running or not if then # echo "process found" exit 0; else echo "process not found" exec /home/Ketan_r /snmp_trap.sh 2>&1 & disown -h ... (1 Reply)
Discussion started by: ketanraut
1 Replies

5. Shell Programming and Scripting

create a shell script that calls another script and and an awk script

Hi guys I have a shell script that executes sql statemets and sends the output to a file.the script takes in parameters executes sql and sends the result to an output file. #!/bin/sh echo " $2 $3 $4 $5 $6 $7 isql -w400 -U$2 -S$5 -P$3 << xxx use $4 go print"**Changes to the table... (0 Replies)
Discussion started by: magikminox
0 Replies
Login or Register to Ask a Question