01-08-2008
Comparing Counts Within Separate Files
Hey all,
So I have this challenge where I am attempting to compare record counts from within several different log files. I want input and output counts for each file, and I want to compare that with the result of the input/output comparison from a separate--but related file.
Example:
File 1A has input and output rec count of 4, I need to then check
File 1B to ensure that it, too, has an input/output rec count of 4.
Then I move on to files 2A and 2B, 3A and 3B, etc.
Here is what I have set up so far:
I have each file set to its own variable, so file1A=/dir/dir/.../file1A.out, etc.
Then, I have a variable which contains all the file variables, so FILELIST="$file1A $file1B...", etc.
Next, I have a for loop--for i in $FILELIST; do...
Inside that for loop, I am making my file i/o comparisons.
My question is this, is there a way to increment that variable (pointer?) to the related second file for each, so that I can compare the i/o record counts between them? In other words, outside of the looping construct, which increments the counter, how do I make the variable go ahead and increment before it reaches the top of the for loop again. And also, can I--after comparing a set of related files--move to the THIRD file in the list, skipping over both the files I just compared.
I hope I have explained my situation clearly enough. If I am going completely down the wrong path with my logic constructs, please tell me that, too. I am using ksh.
Thank you
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
what will be the code to compare count present in two seperate files
for e.g file (a) contains counts
100
and file (b) contains records
90
since both these files have differnt count so it will display count didnt match
and in case of success it display (5 Replies)
Discussion started by: jojo123
5 Replies
2. Shell Programming and Scripting
How do get the counts by excluding header and tailer.
wc -l customer_data*.0826
31 customer_data_1.0826
57 customer_data_2.0826
456 customer_data_3.0826
668 customer_data_4.0826
789 customer_data_5.0826
2344 customer_data_6.0826
13457 customer_data_7.0826... (6 Replies)
Discussion started by: zooby
6 Replies
3. Shell Programming and Scripting
I am trying to load data into 3 tables simultaneously (which is working fine). Then when loaded, it should count the total number of records in all the 3 input files and send an e-mail to the user.
The script is working fine, as far as loading all the 3 input files into the database tables, but... (3 Replies)
Discussion started by: msrahman
3 Replies
4. Shell Programming and Scripting
Ok i have a script that goes into the last 3 files, grabs a value from that file which is a date, counts the number of results of that date.
So this is the output:
FILED001.20110407.175709.086912
49995 04-07T12
4 04-07T07
1 04-07T17
FILED001.20110407.180111.086913
50000 04-07T12
... (5 Replies)
Discussion started by: cinderella
5 Replies
5. Shell Programming and Scripting
frnds:
i want to divide data on the behalf of dotted line and redirectd into new files
)
-------------------------
M-GET CONFIRMATION (
-------------------------
M-GET CONFIRMATION (
INVOKE IDENTIFIER
final data shuld be into 3 files ...... (6 Replies)
Discussion started by: dodasajan
6 Replies
6. Shell Programming and Scripting
Hey all, I have a file structure that looks something like this:
file1
306708278
88954535
234167885
file2
2012-03-27T12:32:56+00:00 137 Orchotorena 184616310003601409 306708278 es 40.4777947 Majadahonda -3.6416896333333333 0 false atlante83 "<a href=""http://tapbots.com/tweetbot""... (8 Replies)
Discussion started by: dgaff
8 Replies
7. Shell Programming and Scripting
Hey guys,
Sorry for the basic question but I have a lot of files that I want to separate into groups based on filenames which I can then cat together. Eg I have:
(a_b_c.txt)
WB34_2_SLA8.txt
WB34_1_SLA8.txt
WB34_1_DB10.txt
WB34_2_DB10.txt
WB34_1_SLA8.txt
WB34_2_SLA8.txt
77_1_SLA8.txt... (1 Reply)
Discussion started by: Breentax
1 Replies
8. Web Development
Hi,
I've been asked to 'troubleshoot' a webserver where two different TLDs are being served. Or to be more accurate, 'domain.com' and 'domain.fr'.
So we have
/var/www/domain.com
/var/www/domain.fr
And then for some reason, the httpd.conf file points to two different configuration files.... (1 Reply)
Discussion started by: davidm123SED
1 Replies
9. Shell Programming and Scripting
Hi all,
i have the bash script for remote conection,
for hosts in $(cat /list); do
ssh user1@$hosts "hostname";
done
execute hostname command by all hosts and show standar ouput,
how i can send to file by each host in lists, so
e.g.
$cat list
10.0.0.1
10.0.0.2... (1 Reply)
Discussion started by: aav1307
1 Replies
10. Shell Programming and Scripting
Input:
I have input file below mentioned.Input file has Yahoo,gmail,yuimn etc..are websites and there are users listed under it. I have many other unique websites but i mentioned just few as below.
For example: Yahoo is website and 123,fsfd are members of website "yahoo". See below input... (19 Replies)
Discussion started by: buzzme
19 Replies
sort(1) General Commands Manual sort(1)
Name
sort - sort file data
Syntax
sort [options] [-k keydef] [+pos1[-pos2]] [file...]
Description
The command sorts lines of all the named files together and writes the result on the standard output. The name `-' means the standard
input. If no input files are named, the standard input is sorted.
Options
The default sort key is an entire line. Default ordering is lexicographic by bytes in machine collating sequence. The ordering is
affected globally by the following options, one or more of which may appear.
-b Ignores leading blanks (spaces and tabs) in field comparisons.
-d Sorts data according to dictionary ordering: letters, digits, and blanks only.
-f Folds uppercase to lowercase while sorting.
-i Ignore characters outside the ASCII range 040-0176 in nonnumeric comparisons.
-k keydef The keydefargument is a key field definition. The format is field_start, [field_end] [type], where field_start and field_end
are the definition of the restricted search key, and type is a modifier from the option list [bdfinr]. These modifiers have the
functionality, for this key only, that their command line counter-parts have for the entire record.
-n Sorts fields with numbers numerically. An initial numeric string, consisting of optional blanks, optional minus sign, and zero
or more digits with optional decimal point, is sorted by arithmetic value. (Note that -0 is taken to be equal to 0.) Option n
implies option b.
-r Reverses the sense of comparisons.
-tx Uses specified character as field separator.
The notation +pos1 -pos2 restricts a sort key to a field beginning at pos1 and ending just before pos2. Pos1 and pos2 each have the form
m.n, optionally followed by one or more of the options bdfinr, where m tells a number of fields to skip from the beginning of the line and
n tells a number of characters to skip further. If any options are present they override all the global ordering options for this key. If
the b option is in effect n is counted from the first nonblank in the field; b is attached independently to pos2. A missing .n means .0; a
missing -pos2 means the end of the line. Under the -tx option, fields are strings separated by x; otherwise fields are nonempty nonblank
strings separated by blanks.
When there are multiple sort keys, later keys are compared only after all earlier keys compare equal. Lines that otherwise compare equal
are ordered with all bytes significant.
These are additional options:
-c Checks sorting order and displays output only if out of order.
-m Merges previously sorted data.
-o name Uses specified file as output file. This file may be the same as one of the inputs.
-T dir Uses specified directory to build temporary files.
-u Suppresses all duplicate entries. Ignored bytes and bytes outside keys do not participate in this comparison.
Examples
Print in alphabetical order all the unique spellings in a list of words. Capitalized words differ from uncapitalized.
sort -u +0f +0 list
Print the password file, sorted by user id number (the 3rd colon-separated field).
sort -t: +2n /etc/passwd
Print the first instance of each month in an already sorted file of (month day) entries. The options -um with just one input file make the
choice of a unique representative from a set of equal lines predictable.
sort -um +0 -1 dates
Restrictions
Very long lines are silently truncated.
Diagnostics
Comments and exits with nonzero status for various trouble conditions and for disorder discovered under option c.
Files
/usr/tmp/stm*, /tmp/* first and second tries for temporary files
See Also
comm(1), join(1), rev(1), uniq(1)
sort(1)