Monitoring awk script progress Post: 302330207

Sponsored Content

Top Forums Shell Programming and Scripting Monitoring awk script progress Post 302330207 by vgersh99 on Tuesday 30th of June 2009 12:54:16 PM

06-30-2009

Moderator

here's something I've been using for quite some time for 'large' files to entertain a user:
nawk -f myAWK.awk myFile
OR
nawk -v twirle="${USER}" -f myAWK.awk myFile
OR
nawk -v twirle='str' -f myAWK.awk myFile

myAWK.awk:

Code:

#!/usr/bin/nawk -f
#
#---------------------------------------------------------------------------
function makeTwirleS(twirle, sep,     s,twLength,twSlength,i,left,l,r,right,arrN ,arr)
{

    s=twirle
    twLength=length(twirle)
    twSlength=length(twirle) * ((length(twirle) <= 3) ? 5 : 2)

    for(right=twLength+1; right<=twSlength; right++)
       s=s "."

    # left -> right
    for(i=1; i+twLength<=twSlength; i++) {
      l=r=""
      for(left=1; left<=i; left++)
         l=(l=="")? "." : l "."
      for(right=i+twLength+1; right<=twSlength; right++)
         r=(r=="")? "." : r "."
      s=s sep l twirle r
    }

    # reverse the direction - right -> left
    arrN=split(s, arr, sep)
    for(i=arrN-1; i>1; i--)
       s=s sep arr[i]

    return s
}
#---------------------------------------------------------------------------

BEGIN {

# Progress bar
  PROGRESSdiv=1000
  if (!twirle) twirle="*"
  # deal with the TWIRLE
  twirleS=makeTwirleS(twirle, SUBSEP)
  ntwirleA=split(twirleS, twirleA, SUBSEP)

  stderr="cat 1>&2"

}
#---------------------------------------------------------------------------

!( FNR % PROGRESSdiv) {
     printf("\rProgress [%s]-> [%d] lines [%s]", FILENAME, FNR, twirleA[(++_twirle % ntwirleA+1)])  | stderr;
}
#
# here goes the rest of the awk script......
#---------------------------------------------------------------------------

vgersh99

View Public Profile for vgersh99

Find all posts by vgersh99

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Making a progress gauge in a bash script

Hello once again: One thing that seems to be a nice feature is a progress gauge... so I can see how long an operation will take for a task to complete if it is requiring a lot of processing or the file is enormous. I have seen references to gauge operations, but I don't know anything about it or...

2. Shell Programming and Scripting

Progress indicator script

Can anybody suggest you a good script to show progress of a process. I figured it out some thing like this. But cursor goes to the end of the line and after every loop it goes to the next line. while true ; do for i in \| \/ \- \\ \| \/ \- \\ do echo "\b\b$i \c" sleep 1 done done

3. Shell Programming and Scripting

Urgent: Script.sh: syntax error at line 72: `PROGRESS=$' unexpected

I have written a shell script to Automatically FTP a file. The script runs fine when doing it manually but when I schedule it using a crontab it gives me an error. . . . echo "-----------------Starting File FTP---------------------" >> $PROS_LOAD_LOG echo "open X.XX.XX.XXX" >>...

4. Shell Programming and Scripting

Progress bar using lsof and awk

Hey all. I added this to my script, hoping for a progress bar or percentage complete lsof -o0 -o -p $$ | awk ' BEGIN { CONVFMT = "%.2f" } $4 ~ /^+r$/ && $7 ~ /^0t/ { offset = substr($7, 3) fname = $9 "stat...

5. Shell Programming and Scripting

progress bar in ftp script

dear all , i made script to transfer data through the FTP but i need to add something if you can help me i want in the output message like progress bar |||||||||||||||||||||||||| 30% to know when it will finish

6. Emergency UNIX and Linux Support

Monitoring progress of a process in Linux server

Hi friends, I am quite used to using glance in HPUX servers for analysis performance issues with a particular process as requested by app. folks. The options which are very helpful to me are the "F" , "W" , "L" stats. How can i get the similar details on Linux servers without using glance?...

7. Programming

Program or bash script to see total progress of copy

hi all, i want a program or to make a bash script to find out the total ETA/percent (would be nice aswell a progress bar) of a copy recursive command so lets say i do - cp -r /source_folder/ /destinatation_folder/ and when i run it i get no information on the screen of how the copy is...

8. Programming

Script to monitor progress of find/exec command

hi all, i want to monitor the progress of a find and exec command, this is the code i use - find . -type f -exec md5sum {} \; >> /md5sums/file.txt this command works and produces a text file with all the md5sums but while running it doesnt show the progress is there anyway i can do this...

9. Shell Programming and Scripting

Shell Script and Progress Bar or GUI Wrapper

Hi, I have shell script that I am running under Ubuntu as root. Is it possible to hide the command window and show the user some sort of progress /random progress bar / or other form of GUI interaction? On MAC, I have been using Platypus but on Ubuntu I am not sure what to do.

LEARN ABOUT OPENSOLARIS

ucblinks

ucblinks(1B)					     SunOS/BSD Compatibility Package Commands					      ucblinks(1B)

NAME

       ucblinks - adds /dev entries to give SunOS 4.x compatible names to SunOS 5.x devices

SYNOPSIS

       /usr/ucb/ucblinks [-e rulebase] [-r rootdir]

DESCRIPTION

       ucblinks  creates symbolic links under the /dev directory for devices whose SunOS 5.x names differ from their SunOS 4.x names. Where possi-
       ble, these symbolic links point to the device's SunOS 5.x name rather than to the actual /devices entry.

       ucblinks does not remove unneeded compatibility links; these must be removed by hand.

       ucblinks should be called each time the system is reconfiguration-booted, after any new SunOS 5.x links that are needed have been  created,
       since the reconfiguration may have resulted in more compatibility names being needed.

       In  releases prior to SunOS 5.4, ucblinks used a  nawk rule-base to construct the SunOS 4.x compatible names. ucblinks no longer uses  nawk
       for the default operation, although  nawk rule-bases can still be specifed with the -e option.  The  nawk rule-base equivalent to the SunOS
       5.4 default operation can be found in /usr/ucblib/ucblinks.awk.

OPTIONS

       -e rulebase    Specify rulebase as the file containing nawk(1) pattern-action statements.

       -r rootdir     Specify rootdir as the directory under which dev and devices will be found, rather than the standard root directory /.

FILES

       /usr/ucblib/ucblinks.awk    sample rule-base for compatibility links

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWscpu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       devlinks(1M), disks(1M), ports(1M), tapes(1M), attributes(5)

SunOS 5.11							    13 Apr 1994 						      ucblinks(1B)