Visit Our UNIX and Linux User Community


Comparing Counts Within Separate Files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Comparing Counts Within Separate Files
# 1  
Old 01-08-2008
Comparing Counts Within Separate Files

Hey all,

So I have this challenge where I am attempting to compare record counts from within several different log files. I want input and output counts for each file, and I want to compare that with the result of the input/output comparison from a separate--but related file.

Example:

File 1A has input and output rec count of 4, I need to then check
File 1B to ensure that it, too, has an input/output rec count of 4.

Then I move on to files 2A and 2B, 3A and 3B, etc.

Here is what I have set up so far:

I have each file set to its own variable, so file1A=/dir/dir/.../file1A.out, etc.
Then, I have a variable which contains all the file variables, so FILELIST="$file1A $file1B...", etc.
Next, I have a for loop--for i in $FILELIST; do...
Inside that for loop, I am making my file i/o comparisons.

My question is this, is there a way to increment that variable (pointer?) to the related second file for each, so that I can compare the i/o record counts between them? In other words, outside of the looping construct, which increments the counter, how do I make the variable go ahead and increment before it reaches the top of the for loop again. And also, can I--after comparing a set of related files--move to the THIRD file in the list, skipping over both the files I just compared.

I hope I have explained my situation clearly enough. If I am going completely down the wrong path with my logic constructs, please tell me that, too. I am using ksh.

Thank you
# 2  
Old 01-09-2008
Hope this will help u

file1A="./file1A.out"
file1B="./file1B.out"
FILELIST="$file1A $file1B"
for fname in `eval echo $FILELIST`
do
cnt=`wc -l $fname|cut -d' ' -f1`
echo $cnt
done
# 3  
Old 01-09-2008
Thank you for your reply.

I guess the crux of what I'm asking is, is there a way to specify which in a list of files your "pointer" points to?

So, when you have a variable that looks like FILELIST="$file1A $file1B...", how can you pull, say, the third variable from that list, without stating the name of the variable explicitly. I'm assuming the shell somehow stores a "bookmark", so to speak, of where it currently is in that list, or else the for loop wouldn't work. How can I find and use that bookmark to compare these files, if there is a way.

I don't really understand the eval statement, but through doing some testing, it doesn't seem to behave much differently than just the for statement itself (for fname in $files).

Please excuse my ignorance. I know just enough ksh scripting to be dangerous! Smilie

Previous Thread | Next Thread
Test Your Knowledge in Computers #308
Difficulty: Easy
The first computer bug was created by a broken keyboard input.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need separate vi files in shell

Input: I have input file below mentioned.Input file has Yahoo,gmail,yuimn etc..are websites and there are users listed under it. I have many other unique websites but i mentioned just few as below. For example: Yahoo is website and 123,fsfd are members of website "yahoo". See below input... (19 Replies)
Discussion started by: buzzme
19 Replies

2. Shell Programming and Scripting

Output in separate files

Hi all, i have the bash script for remote conection, for hosts in $(cat /list); do ssh user1@$hosts "hostname"; done execute hostname command by all hosts and show standar ouput, how i can send to file by each host in lists, so e.g. $cat list 10.0.0.1 10.0.0.2... (1 Reply)
Discussion started by: aav1307
1 Replies

3. Web Development

Two separate domains - and files

Hi, I've been asked to 'troubleshoot' a webserver where two different TLDs are being served. Or to be more accurate, 'domain.com' and 'domain.fr'. So we have /var/www/domain.com /var/www/domain.fr And then for some reason, the httpd.conf file points to two different configuration files.... (1 Reply)
Discussion started by: davidm123SED
1 Replies

4. Shell Programming and Scripting

Using bash to separate files files based on parts of a filename

Hey guys, Sorry for the basic question but I have a lot of files that I want to separate into groups based on filenames which I can then cat together. Eg I have: (a_b_c.txt) WB34_2_SLA8.txt WB34_1_SLA8.txt WB34_1_DB10.txt WB34_2_DB10.txt WB34_1_SLA8.txt WB34_2_SLA8.txt 77_1_SLA8.txt... (1 Reply)
Discussion started by: Breentax
1 Replies

5. Shell Programming and Scripting

Comparing columns in two separate files

Hey all, I have a file structure that looks something like this: file1 306708278 88954535 234167885 file2 2012-03-27T12:32:56+00:00 137 Orchotorena 184616310003601409 306708278 es 40.4777947 Majadahonda -3.6416896333333333 0 false atlante83 "<a href=""http://tapbots.com/tweetbot""... (8 Replies)
Discussion started by: dgaff
8 Replies

6. Shell Programming and Scripting

Divide data into separate files

frnds: i want to divide data on the behalf of dotted line and redirectd into new files ) ------------------------- M-GET CONFIRMATION ( ------------------------- M-GET CONFIRMATION ( INVOKE IDENTIFIER final data shuld be into 3 files ...... (6 Replies)
Discussion started by: dodasajan
6 Replies

7. Shell Programming and Scripting

Need to combine counts from diff files

Ok i have a script that goes into the last 3 files, grabs a value from that file which is a date, counts the number of results of that date. So this is the output: FILED001.20110407.175709.086912 49995 04-07T12 4 04-07T07 1 04-07T17 FILED001.20110407.180111.086913 50000 04-07T12 ... (5 Replies)
Discussion started by: cinderella
5 Replies

8. Shell Programming and Scripting

Sending e-mail of record counts in 3 or more files

I am trying to load data into 3 tables simultaneously (which is working fine). Then when loaded, it should count the total number of records in all the 3 input files and send an e-mail to the user. The script is working fine, as far as loading all the 3 input files into the database tables, but... (3 Replies)
Discussion started by: msrahman
3 Replies

9. Shell Programming and Scripting

Get counts for multiple files

How do get the counts by excluding header and tailer. wc -l customer_data*.0826 31 customer_data_1.0826 57 customer_data_2.0826 456 customer_data_3.0826 668 customer_data_4.0826 789 customer_data_5.0826 2344 customer_data_6.0826 13457 customer_data_7.0826... (6 Replies)
Discussion started by: zooby
6 Replies

10. Shell Programming and Scripting

how to compare counts in two separate files

Hi all, what will be the code to compare count present in two seperate files for e.g file (a) contains counts 100 and file (b) contains records 90 since both these files have differnt count so it will display count didnt match and in case of success it display (5 Replies)
Discussion started by: jojo123
5 Replies

Featured Tech Videos