Generic Filewatcher Post: 302793699

Sponsored Content

Top Forums Shell Programming and Scripting Generic Filewatcher Post 302793699 by dikesm on Saturday 13th of April 2013 05:50:23 AM

04-13-2013

Registered User

Quote:

Originally Posted by Corona688

What do a.sh, b.sh, c.sh, d.sh, e.sh do?

What should happen to the input file after the scripts complete?

These config files sound quite similar to makefiles, or could be made so.

The input file is a file containing some data to be processed.The input file would be archived after processing.

The scripts might do simple stuffs like checking whether the source file name is correct as per logic,or check whether there aint any duplication of records in the files,logic to do a data quality check.

These individual scripts run on their own and export some shell variables along with 0 return code in case of success and non zero return code for any failures.

Regards,
Dikesh Shah.

---------- Post updated at 04:50 AM ---------- Previous update was at 04:47 AM ----------

Quote:

Originally Posted by Chubler_XL

You could try something like this, not they after finding a watch file you should probably delete or move it aside to stop actions repeating on every check:

Code:

function load_conf
{
  POS=0
  while read line
  do
     S[POS]="$line"
     let POS=POS+1
  done < $1
}

while read WATCH CONF
do
    POS=${#WF[@]}
    WF[POS]=$WATCH
    CF[POS]=$CONF
done < master

for((i=0;i<${#WF[@]};i++)) {
    if [ -f "${WF[i]}" ]
    then
        load_conf ${CF[i]}
        for((j=0;j<${#S[@]};j++)) {
            echo "${S[j]}" | while read -a run
            do
                for((k=0;k<${#run[@]};k++)) {
                    eval ${run[k]} \> $(basename ${run[k]}).out "2>" $(basename ${run[k]}).stderr &
                }
                wait
            done
        }
    fi
}

Can you please explain what does the above code does?
I am a bit new to complex shell programming.

dikesm

View Public Profile for dikesm

Find all posts by dikesm

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

GENERIC Kernel

How do I update, change, reconfigure or whatever it is that I have to do, in order to rid the GENERIC label. It just means that it is the basic kernel shipped with the OS right? Im using FBSD 4.5

2. Shell Programming and Scripting

Problem with filewatcher...

Hi everyone, Please find the script for Filewatcher rule file,which does the simple job of moving the files whenever it dectects to another directory.And whenever it detects the cmd_mm.stop file,it should terminate the job. INTERVAL 60 ON_FILEWATCH ${HLD}/CMD/* CREATE 0 1 2 0400 5 THEN...

3. Shell Programming and Scripting

generic way - help required

All, This is what I did: Suppose: $ line="23|12|21" $ eval $(echo "$line" | awk -F'|' '{print "V1="$1";V2="$2";V3="$3}') $ echo $V1 23 $ echo $V2 12 $ echo $V3 21

4. Shell Programming and Scripting

FileWatcher Script

Hi All, Sorry to post these many questions on UNIX. i am new to unix & got only UNIX work in my organization. I need to make a script for File Arrival Check. 1. The script should wait for indicator file for configured amount of time. 2. If the file is not received after the configured...

5. UNIX for Advanced & Expert Users

Is aclocal.m4 generic?

can we copy higher version aclocal to our software. Is there any good book for automake,aclocal.m4,configure.sub,configure.guess that explains clearly about how they are related , how to modify them etc Thanks Gopi

6. Shell Programming and Scripting

Autosys filewatcher + ksh script

Hi, A ------> B ------> C I have a scenario where each day, my server B would ftp to server A and pull (A,B,C,D,E) from a specific directory. Server C would need files (B,D) only when server B finished receiving from server A. These files change everyday, so sometimes it takes longer...

7. UNIX for Dummies Questions & Answers

Filewatcher job

Hi Friends iam using a filewatcher job which checks the path in intervals below is the script #!/bin/ksh fileflag=0 timer1=0 check_interval=120 # check every 2 minutes (( check_interval_minutes=${check_interval}/60 )) while do if then echo "My file exists now..." | mailx -s...

8. Shell Programming and Scripting

Filewatcher

hi All, I ned to write a filewatcher script, with following requirements. 1. The script should look for the file in every 5 min. 2. If the file is found, it should check in every 3 min the size of file. 3. if the file size has not changed in last 4 iterations (i.e. in last 12 min), the...

LEARN ABOUT SUSE

ipc::sysv

IPC::SysV(3pm)						 Perl Programmers Reference Guide					    IPC::SysV(3pm)

NAME

       IPC::SysV - System V IPC constants and system calls

SYNOPSIS

	 use IPC::SysV qw(IPC_STAT IPC_PRIVATE);

DESCRIPTION

       "IPC::SysV" defines and conditionally exports all the constants defined in your system include files which are needed by the SysV IPC
       calls.  Common ones include

	 IPC_CREATE IPC_EXCL IPC_NOWAIT IPC_PRIVATE IPC_RMID IPC_SET IPC_STAT
	 GETVAL SETVAL GETPID GETNCNT GETZCNT GETALL SETALL
	 SEM_A SEM_R SEM_UNDO
	 SHM_RDONLY SHM_RND SHMLBA

       and auxiliary ones

	 S_IRUSR S_IWUSR S_IRWXU
	 S_IRGRP S_IWGRP S_IRWXG
	 S_IROTH S_IWOTH S_IRWXO

       but your system might have more.

       ftok( PATH )
       ftok( PATH, ID )
	   Return a key based on PATH and ID, which can be used as a key for "msgget", "semget" and "shmget". See ftok.

	   If ID is omitted, it defaults to 1. If a single character is given for ID, the numeric value of that character is used.

       shmat( ID, ADDR, FLAG )
	   Attach the shared memory segment identified by ID to the address space of the calling process. See shmat.

	   ADDR should be "undef" unless you really know what you're doing.

       shmdt( ADDR )
	   Detach the shared memory segment located at the address specified by ADDR from the address space of the calling process. See shmdt.

       memread( ADDR, VAR, POS, SIZE )
	   Reads SIZE bytes from a memory segment at ADDR starting at position POS.  VAR must be a variable that will hold the data read. Returns
	   true if successful, or false if there is an error. memread() taints the variable.

       memwrite( ADDR, STRING, POS, SIZE )
	   Writes SIZE bytes from STRING to a memory segment at ADDR starting at position POS. If STRING is too long, only SIZE bytes are used; if
	   STRING is too short, nulls are written to fill out SIZE bytes. Returns true if successful, or false if there is an error.

SEE ALSO

       IPC::Msg, IPC::Semaphore, IPC::SharedMem, ftok, shmat, shmdt

AUTHORS

       Graham Barr <gbarr@pobox.com>, Jarkko Hietaniemi <jhi@iki.fi>, Marcus Holland-Moritz <mhx@cpan.org>

COPYRIGHT

       Version 2.x, Copyright (C) 2007, Marcus Holland-Moritz.

       Version 1.x, Copyright (c) 1997, Graham Barr.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

perl v5.12.1							    2010-04-26							    IPC::SysV(3pm)