How to get this script work on multiple input files Post: 302448771

Sponsored Content

Top Forums Shell Programming and Scripting How to get this script work on multiple input files Post 302448771 by Daniel8472 on Friday 27th of August 2010 03:27:54 AM

08-27-2010

Registered User

Good morning!

I am back in the lab and just used the scipt (needed to midify some parts because some files contain "," instead of ".")

One problem seems to remain so far. While reading a new file the value for "h" is not reset to zero. Thus unless in the following file is a higher value in the $2 the highest $2 value of the previous files is kept and printed.

Code:

BEGIN { h=0 } 
    FNR == 1    { if(header!="") 
                {             
                #printf "%s\n%d\n", header, h;
                print header, h; 
                } 
            header=$0; next; 
            } \
         
    substr($2,3,5)/100000*10^(substr($2,9,3))>h         { h=substr($2,3,5)/100000*10^(substr($2,9,3)) } 

END     { 
    print header, h;
    #printf "%s\n%d\n", header, h;
    }

Output:

Code:

 DWT26R 1 PEP1 CA 10 OH2 SKIPPED: 0 STEP: 1 3,2829
 DWT26R 1 PEP2 CA 10 OH2 SKIPPED: 0 STEP: 1 3,5248
 DWT26R 1 PEP1 CA 11 OH2 SKIPPED: 0 STEP: 1 4,3229
 DWT26R 1 PEP2 CA 11 OH2 SKIPPED: 0 STEP: 1 4,3229
 DWT26R 1 PEP1 CA 12 OH2 SKIPPED: 0 STEP: 1 6,8575
 DWT26R 1 PEP2 CA 12 OH2 SKIPPED: 0 STEP: 1 6,8575
 DWT26R 1 PEP1 CA 13 OH2 SKIPPED: 0 STEP: 1 6,8575
 DWT26R 1 PEP2 CA 13 OH2 SKIPPED: 0 STEP: 1 6,8575
 DWT26R 1 PEP1 CA 14 OH2 SKIPPED: 0 STEP: 1 6,8575
 DWT26R 1 PEP2 CA 14 OH2 SKIPPED: 0 STEP: 1 6,8575

Daniel8472

View Public Profile for Daniel8472

Find all posts by Daniel8472

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

can you redirect multiple files for input?

I have a program that is reading strings into a vector from a file. Currently I am using this command: a.out < file1 The program runs and prints the contents of the vector to the screen, like its supposed to. The problem is that it needs to read in 3 files to fill the vector. Is there anyway...

2. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50...

3. Shell Programming and Scripting

how to redirect multiple input files?

I have a program that runs like "cat f1 - f2 -", I need to write shell script to run the program whose standard input will be redirected from 2 files. I spend a whole day on it, but didn't figure out. Can someone help me out? Thanks!

4. Shell Programming and Scripting

How to make an editing script work for multiple files?

Hey everybody, I have a script for making a string substitution in a file. I am trying to modify it in order to make the same modifcation to multiples files. here is what I have so far. #!/bin/csh set p1="$1" shift set p2="$1" shift foreach x ($*) if ( { grep -w -c "$p1" $x } ) then mv...

5. UNIX for Advanced & Expert Users

Input for multiple files.

Hi, I am trying to come up with a script, and would like the script to pick all the files place within a folder and interactive take my yes/no before processing within the command. Could you someone help me in modifying the script : #!/bin/bash # LDIF_FILES="File Name" for MY_FILE...

6. UNIX for Dummies Questions & Answers

Writing a loop to process multiple input files by a shell script

I have multiple input files that I want to manipulate using a shell script. The files are called 250.1 through 250.1000 but I only want the script to manipulate 250.300 through 250.1000. Before I was using the following script to manipulate the text files: for i in 250.*; do || awk...

7. Shell Programming and Scripting

awk, multiple files input and multiple files output

Hi! I'm new in awk and I need some help. I have a folder with a lot of files and I need that awk do something in each file and print a new file with the output. The input file name should be modified when I print the outpu files. Thanks in advance for help! :-) ciao

8. Shell Programming and Scripting

Script to delete files with an input for directories and an input for path/file

Hello, I'm trying to figure out how best to approach this script, and I have very little experience, so I could use all the help I can get. :wall: I regularly need to delete files from many directories. A file with the same name may exist any number of times in different subdirectories....

9. Shell Programming and Scripting

Script to delete files older than x days and also taking an input for multiple paths

Hi , I am a newbie!!! I want to develop a script for deleting files older than x days from multiple paths. Now I could reach upto this piece of code which deletes files older than x days from a particular path. How do I enhance it to have an input from a .txt file or a .dat file? For eg:...

10. Shell Programming and Scripting

[Solved] Multiple input files and output files

Hi, I have many test*.ft1 files to which I want to read as input for a script called pipe2txt.tcl and print the output in each separate file. For example, pipe2txt.tcl < test001.ft1 > test001.txt How can I read many files in this maner? thank you very much, Best, Pahuja

LEARN ABOUT DEBIAN

bup-margin

bup-margin(1)						      General Commands Manual						     bup-margin(1)

NAME

       bup-margin - figure out your deduplication safety margin

SYNOPSIS

       bup margin [options...]

DESCRIPTION

       bup margin  iterates  through  all  objects  in	your  bup repository, calculating the largest number of prefix bits shared between any two
       entries.  This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.

       For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45.  That  means  a  46-bit
       hash  would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
       its first 46 bits.

       The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects.  Since SHA-1 hashes have 160 bits,
       that  leaves 115 bits of margin.  Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
       with far fewer objects.

       If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see	if
       you're getting dangerously close to 160 bits.

OPTIONS

       --predict
	      Guess  the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
	      from the guess.  This is potentially useful for tuning an interpolation search algorithm.

       --ignore-midx
	      don't use .midx files, use only .idx files.  This is only really useful when used with --predict.

EXAMPLE

	      $ bup margin
	      Reading indexes: 100.00% (1612581/1612581), done.
	      40
	      40 matching prefix bits
	      1.94 bits per doubling
	      120 bits (61.86 doublings) remaining
	      4.19338e+18 times larger is possible

	      Everyone on earth could have 625878182 data sets
	      like yours, all in one repository, and we would
	      expect 1 object collision.

	      $ bup margin --predict
	      PackIdxList: using 1 index.
	      Reading indexes: 100.00% (1612581/1612581), done.
	      915 of 1612581 (0.057%)

SEE ALSO

       bup-midx(1), bup-save(1)

BUP

       Part of the bup(1) suite.

AUTHORS

       Avery Pennarun <apenwarr@gmail.com>.

Bup unknown-															     bup-margin(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

can you redirect multiple files for input?

Discussion started by: Matrix_Prime

2. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Discussion started by: arund_01

3. Shell Programming and Scripting

how to redirect multiple input files?

Discussion started by: microstarwwx

4. Shell Programming and Scripting

How to make an editing script work for multiple files?

Discussion started by: iwatk003

5. UNIX for Advanced & Expert Users

Input for multiple files.

Discussion started by: john_prince

6. UNIX for Dummies Questions & Answers

Writing a loop to process multiple input files by a shell script

Discussion started by: evelibertine

7. Shell Programming and Scripting

awk, multiple files input and multiple files output

Discussion started by: gabrysfe

8. Shell Programming and Scripting

Script to delete files with an input for directories and an input for path/file

Discussion started by: ShadowCat

9. Shell Programming and Scripting

Script to delete files older than x days and also taking an input for multiple paths

Discussion started by: jhilmil

10. Shell Programming and Scripting

[Solved] Multiple input files and output files

Discussion started by: Pahuja

LEARN ABOUT DEBIAN

bup-margin

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Discussion started by: Matrix_Prime

2. Shell Programming and Scripting

Discussion started by: arund_01

3. Shell Programming and Scripting

Discussion started by: microstarwwx

4. Shell Programming and Scripting

Discussion started by: iwatk003

5. UNIX for Advanced & Expert Users

Discussion started by: john_prince

6. UNIX for Dummies Questions & Answers

Discussion started by: evelibertine

7. Shell Programming and Scripting

Discussion started by: gabrysfe

8. Shell Programming and Scripting

Discussion started by: *ShadowCat*

9. Shell Programming and Scripting

Discussion started by: jhilmil

10. Shell Programming and Scripting

Discussion started by: Pahuja

LEARN ABOUT DEBIAN

bup-margin

Discussion started by: ShadowCat