Shell Programming and Scripting

this works but how do we pull it for the whole month of february and then the ouput doesntcome for subscriber id's which arenot there thats if a 203 is not in the file it doesnt show for
2 0
144 0

one more thing can we put in an echo statement there like this echo "$i 203's"

You are not very clear explaining what you want. Your original request is to only include lines starting with 203. If you wish get all records irrespective of whether the subscriber has used or not used, then you can do this:

Code:

nawk -F, 'NR==FNR&&$1==203{_[$3]++;next}NF<2{b[$0]++}END{for(i in b){_[i]=="" && _[i]=0; print i,_[i]}}'  datafile subscriber.list

My question was only how do i pull out stats for the whole month.
also it gives the number of 203's only for the subcribers ids which are there in the log file. even if a 203 is not there in the traffic log file for the subscriber id 2 or any other subscriber id it should show a zero.

like for example its doesnt give
2 0
7 0
if there are no 203's.

also can i put an echo statement there.echo "$Y 203's = "

where $Y is the subcriber id

grep ^203 testS | cut -d, -f3 | sort | uniq -c | while read line; do
cnt=$(echo $line | cut -d" " -f1)
acct=$(echo $line | cut -d" " -f2)
echo "Account $acct had $cnt 203's"
done

This is not as elegant as awk but you don't have to keep a list of accounts. You can change the "echo" line to contain your date variables etc..

thanks you testS and where do i put the log file in there.
-rw-r--r-- 1 ins users 203905773 Dec 15 00:00 08121400010202.TLG
-rw-r--r-- 1 ins users 236227823 Dec 16 00:00 08121500010202.TLG
-rw-r--r-- 1 ins users 243940118 Dec 17 00:00 08121600010202.TLG
-rw-r--r-- 1 ins users 237871341 Dec 18 00:00 08121700010202.TLG
-rw-r--r-- 1 ins users 250888222 Dec 19 00:00 08121800010202.TLG
-rw-r--r-- 1 ins users 224493872 Dec 20 00:00 08121900010202.TLG
-rw-r--r-- 1 ins users 218388629 Dec 21 00:00 08122000010202.TLG
-rw-r--r-- 1 ins users 186587338 Dec 22 00:00 08122100010202.TLG
-rw-r--r-- 1 ins users 212704014 Dec 23 00:00 08122200010202.TLG
-rw-r--r-- 1 ins users 223440201 Dec 24 00:00 08122300010202.TLG
-rw-r--r-- 1 ins users 205148228 Dec 25 00:00 08122400010202.TLG
-rw-r--r-- 1 ins users 190723897 Dec 26 00:00 08122500010202.TLG
-rw-r--r-- 1 ins users 196810206 Dec 27 00:00 08122600010202.TLG
-rw-r--r-- 1 ins users 207268885 Dec 28 00:00 08122700010202.TLG
-rw-r--r-- 1 ins users 192394546 Dec 29 00:00 08122800010202.TLG
-rw-r--r-- 1 ins users 213904424 Dec 30 00:00 08122900010202.TLG
-rw-r--r-- 1 ins users 227873419 Dec 31 00:00 08123000010202.TLG
-rw-r--r-- 1 ins users 261625589 Jan 1 00:00 08123100010202.TLG
-rw-r--r-- 1 ins users 930495 Feb 10 10:00 sqlnet.log
-rw-r--r-- 1 ins users 195611078 Feb 11 00:00 09021000010202.TLG
-rw-r--r-- 1 ins users 183961342 Feb 12 00:00 09021100010202.TLG
-rw-r--r-- 1 ins users 195541787 Feb 13 00:00 09021200010202.TLG
-rw-r--r-- 1 ins users 188403819 Feb 14 00:00 09021300010202.TLG
-rw-r--r-- 1 ins users 180083539 Feb 15 00:00 09021400010202.TLG
-rw-r--r-- 1 ins users 174935554 Feb 16 00:00 09021500010202.TLG
-rw-r--r-- 1 ins users 184086392 Feb 17 00:00 09021600010202.TLG
-rw-r--r-- 1 ins users 183132340 Feb 18 00:00 09021700010202.TLG
-rw-r--r-- 1 ins users 204216062 Feb 19 00:00 09021800010202.TLG
-rw-r--r-- 1 ins users 197424799 Feb 20 00:00 09021900010202.TLG
-rw-r--r-- 1 ins users 194341059 Feb 21 00:00 09022000010202.TLG
-rw-r--r-- 1 ins users 184951088 Feb 22 00:00 09022100010202.TLG
-rw-r--r-- 1 ins users 163008982 Feb 23 00:00 09022200010202.TLG
-rw-r--r-- 1 ins users 187907245 Feb 24 00:00 09022300010202.TLG
-rw-r--r-- 1 ins users 210837242 Feb 25 00:00 09022400010202.TLG
-rw-r--r-- 1 ins users 186564560 Feb 26 00:00 09022500010202.TLG
-rw-r--r-- 1 ins users 214959454 Feb 27 00:00 09022600010202.TLG
-rw-r--r-- 1 ins users 209203339 Feb 28 00:00 09022700010202.TLG
-rw-r--r-- 1 ins users 201840157 Mar 1 00:00 09022800010202.TLG
-rw-r--r-- 1 ins users 173722179 Mar 2 00:00 09030100010202.TLG
-rw-r--r-- 1 ins users 221884036 Mar 3 00:00 09030200010202.TLG
-rw-r--r-- 1 ins users 210510974 Mar 4 00:00 09030300010202.TLG

thank u all for helping me out once again as i am not very good at NR and FNR which something very new to me.please bear with me and help me out.

Ok. Suppose you have only these two TLG files for December:

Code:

$ cat 08121500010202.TLG
203,0903100000042C,110,29,3,
207,0903100000042C,670,133,1
207,0903100000052C,36,25,7,0
203,0903100000052C,54,24,3,
203,0903100000052C,36,79,3,0
$
$ cat 08121400010202.TLG
203,0903100000042C,710,29,3,
207,0903100000042C,670,133,1
207,0903100000042C,26,9,7,09
207,0903100000052C,36,25,7,0
203,0903100000052C,720,24,3,
203,0903100000052C,36,79,3,0

Assume this is the subscriber list:

Code:

$ cat subscriber.list
1
2
3
110
218
26
36
42
50
54
670
710
720

Then this is the code & output:

Code:

nawk -F, 'NR==FNR{_[$0]=0;next}$1==203{a[$3]++}END{for(i in _){a[i]==""&&a[i]=0;print i" 203s = "a[i]}}' subs.list 0812*.TLG
2 203s = 0
3 203s = 0
720 203s = 1
26 203s = 0
110 203s = 1
42 203s = 0
710 203s = 1
218 203s = 0
36 203s = 2
50 203s = 0
54 203s = 1
670 203s = 0
1 203s = 0

1. This shows for full month of December (0812*.TLG)
2. This shows count for subscriber which have 203 + those who are NOT in TLG file. No subscriber is missed.
3. It does the echo you wanted.

grep ^203 09022400010202.TLG | cut -d, -f3 | sort | uniq -c | while read line; do
cnt=$(echo $line | cut -d" " -f1)
acct=$(echo $line | cut -d" " -f2)
echo "Account $acct had $cnt 203's"
done

if you want to do each file then wrap it in a for loop

Code:

for file in $(ls `date +%y%m%d0010202.TLG`)
  echo "FILE: $file"
  grep ^203 $file | cut -d, -f3 | sort | uniq -c | while read line; do
    cnt=$(echo $line | cut -d" " -f1)
    acct=$(echo $line | cut -d" " -f2)
    echo "Account $acct had $cnt 203's"
  done
done