UNIX for Dummies Questions & Answers

Hello,

I'm trying to get lists of the frequency distributions for each of two variables (vars C and N in the examples). I'd like the distribution for each variable to range from the min of the two variables to the max of the two variables. I can work out the max value beforehand by ordering the data by variable. Not sure how to calculate the frequency distribution though.
Any notes on the functions of different parts of the commands, would be much appreciated too! Still learning...

Thank you!


Example input file:

Var, Num
C,5
C,0
C,5
C,2
C,0
N,1
N,1
N,0
C,5
C,3

request output file:

Var, Num, Frq
C,0,2
C,1,0
C,2,1
C,3,1
C,4,0
C,5,3
N,0,1
N,1,2
N,2,0
N,3,0
N,4,0
N,5,0

OR,

Num, Frq_C, Frq_N
0,2,1
1,0,2
2,1,0
3,1,0
4,0,0
5,3,0

Since you want zero frequency you have to provide the classes you want to report on - ahead of time. The program cannot know what to expect.
So edit a file, call it "expected"

Code:

C,0
C,1
C,2
C,3
C,4
C,5
N,0
N,1
N,2
N,3
N,4
N,5

Code:

awk 'FILENAME=="expected" {arr[$0]=0}
       FILENAME=="input" {arr[$0]++}
       END {for (i in arr){ print i "," arr[i]}} '  expected input > newfile

Thanks for your help! Sorry for delayed reply.
The real file that I'm working from is pretty big (over 20 million rows) and the max value is about 10,000. Is there a quick way to generate the "expected" file with all values from 0 to 10,000 for each of C and N?

Thanks again!