Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: looping through files
Top Forums Shell Programming and Scripting looping through files Post 302452015 by agama on Wednesday 8th of September 2010 11:06:16 PM
Old 09-09-2010
This is the way I'd approach it:

Code:
#/usr/bin/env ksh

if ! cd $INPUT_DIR
then
        echo "unable to switch to $INPUT_DIR"
        exit 1
fi

need=7                 # number of files needed before we are finished
while (( $need > 0 ))
do
        for file in *.dat          # for all .dat files currently in the directory 
        do
                echo "processing: $file"
                execute_sql_loader $file
                rc=$?
                if (( $rc > 0 ))
                then
                        echo "error loading file: $file rc=$rc"
                else
                        echo "file loaded successfully: $file"
                fi


                mv $file $file.processed        # prevent finding it again; maybe delete it instead?
                need=$(( $need - 1 ))         # one less file needed
        done

        if (( need > 0 ))
        then
                echo "$(date) waiting 15m before making next pass; need $need files"
                sleep $(( 15 * 60 ))                    # wait 15 minutes before trying again
        fi
done

This code is completely untested so there might be a typo or something I missed. You might also want to check to ensure that you don't process the same file twice, assuming that you won't get duplicate file names.

Your code said .txt, but your description said .dat -- I assumed the later.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

looping files

Hi, I have a file a.lst which lists all files. as a.dat b.dat c.dat I want to process these files mentioned in the list file in a loop. Say I want to display only the first line of all the files a.dat , b.dat, c.dat. How can I go about it? Please help. (5 Replies)
Discussion started by: dharmesht
5 Replies

2. Shell Programming and Scripting

Help looping through files, please...

Okay... I've solved one problem. Here's the next. I'm writing a script file that needs to go through a directory and list all files in that directory. I'm using TCL/TK. I figured out how to go through the directory and how to loop through it, but I ran into a little problem. ... (2 Replies)
Discussion started by: kapolani
2 Replies

3. Shell Programming and Scripting

Looping on a list of files...

This isn't working for multiple files. It works for one file though. exists1=$(ls | grep gspp*) for FILES in $exists1 do echo "Loading $exists1" ... (23 Replies)
Discussion started by: lazerfoursix
23 Replies

4. Shell Programming and Scripting

Looping through files...

I posted this in the Solaris forum, but I don't think it's platform specific, so I'm posting it here. Here is the situation. We are a company that has been using a professional publishing system, the software is called "ProType". It runs on Solaris 2.4, however it is no longer supported and we... (6 Replies)
Discussion started by: Fred Goldman
6 Replies

5. Shell Programming and Scripting

Looping through 2 files simultaneously

Hi all, I'm having a problem with a script which should ultimately provide a filename by reading a value from file1 and file2 then join together. I'm planning to use a loop/ loops to get the values out of both files and create a single string unfortunately the code currently treats the second... (7 Replies)
Discussion started by: chris01010
7 Replies

6. Shell Programming and Scripting

looping through files with different extensions

Hi all, I am trying to make a for loop invoking files with different extensions (*.ugrd and *.vgrd) and I cant just make it work. Cant figure out how to load the files so as to use them in subsequent commands like the ones in this pseudo code. the files are arranged such that in one date for... (8 Replies)
Discussion started by: ida1215
8 Replies

7. Shell Programming and Scripting

Conditional Looping In Files

I have a req. where i need to read data from multiple files and take counts of row which satisfy the condition. e.g.: FILE1: Col1 Col2 Col3 12 ab cd 15 de fg 25 gh tm FILE2: Col1 Col2 Col3 21 ab1 cd1 13 de1 fg1 25 gh1 tm1 --- --- FILE-N... i need to find the count of rows... (6 Replies)
Discussion started by: kunal007
6 Replies

8. Shell Programming and Scripting

Not looping or creating files

So my script is supposed to repeat for every server in my file, but as of now it is getting stuck on my awk commands # Read file cred.txt (with one IP per line), connect to servers (one at a time), and download directory listing i=1 param=$(sed -n "{$1}p" $parm_dir/cdm_param.txt) #Get the last... (6 Replies)
Discussion started by: MJCreations
6 Replies

9. Shell Programming and Scripting

Looping through Files

Hi all , I am new on this forum . I have to face a particoular implementation issue and I need some help . Requirement : I need to read a particoular file (an xml file) and after reading it I need to call an Oracle Stored Procedure passing the content of the file as paramenter , in order... (3 Replies)
Discussion started by: Kolas79
3 Replies

10. Shell Programming and Scripting

Looping through files in pairs

Hi all, Please guide. It has to do with parsing the input file names. I have a fairly large number of files, I want to do some operations on them in a pairwise fashion (every file has a pair). The names are in the following pattern, with the pairs of files named with _1 and _2 , the... (4 Replies)
Discussion started by: newbie83
4 Replies

LEARN ABOUT DEBIAN

shtool-echo

SHTOOL-ECHO.TMP(1)					      GNU Portable Shell Tool						SHTOOL-ECHO.TMP(1)

NAME

       shtool-echo - GNU shtool echo(1) extensional command

SYNOPSIS

       shtool echo [-n|--newline] [-e|--expand] string

DESCRIPTION

       shtool echo is an echo(1) style command which prints string to stdout and optionally provides special expansion constructs (terminal bold
       mode, environment details, date, etc) and newline control. The trick of this command is that it provides a portable -n option and hides the
       gory details needed to find out the environment details under option -e.

OPTIONS

       The following command line options are available.

       -n, --newline
	   By default, output is written to stdout followed by a "newline" (ASCII character 0x0a). If option -n is used, this newline character is
	   omitted.

       -e, --expand
	   If option -e is used, string can contain special "%x" constructs which are expanded before the output is written. Currently the
	   following constructs are recognized:

	   %B  switch terminal mode to bold display mode.

	   %b  switch terminal mode back to normal display mode.

	   %u  the current user name.

	   %U  the current user id (numerical).

	   %g  the current group name.

	   %G  the current group id (numerical).

	   %h  the current hostname (without any domain extension).

	   %d  the current domain name.

	   %D  the current day of the month.

	   %M  the current month (numerical).

	   %m  the current month name.

	   %Y  the current year.

EXAMPLE

	#   shell script
	shtool echo -n -e "Enter your name [%B%u%b]: "; read name
	shtool echo -e "Your Email address might be %u@%h%d"
	shtool echo -e "The current date is %D-%m-%Y"

HISTORY

       The GNU shtool echo command was originally written by Ralf S.  Engelschall <rse@engelschall.com> in 1998 for Website META Language (WML)
       under the name buildinfo. It was later taken over into GNU shtool.

SEE ALSO

       shtool(1), echo(1).

18-Jul-2008							   shtool 2.0.8 						SHTOOL-ECHO.TMP(1)
All times are GMT -4. The time now is 04:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy