01-26-2009
Thanks Rubin..I think I left out some info though. Your script works great but not for my data...I think the reason is...
1.) My IDs are not linear (i.e. ID001, ID002..rather random ID005, ID001, ID999)
2.) My IDs are not ID001 rather BC followed by a random 6 digits such ..BC000601, BC015656, etc.
3.) All the data is stored in a file called data.txt
such the format is
BC001061
56.66
51.1
12.1223
68
..n
BC567123
1
15.6
12.111
..n
etc etc
Also I am using cygwin and presumably gnu awk
thanks again. I hope that helps
cheers
John
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Dear Guyz:)
I have 2 different input files like this. I would like to pick the values or letters from the inputfile2 based on inputfile1 keys (A,F,N,X,Z).
I have done similar task by using awk but in that case the inputfiles are similar like in inputfile2 (all keys in 1st column and values in... (16 Replies)
Discussion started by: repinementer
16 Replies
2. Shell Programming and Scripting
Hello,
I have 2 columns (1st column has multiple entries but the corresponding values in the column 2 may be the same or different.) however I want to extract unique values for each entry in column 1 by assigning the max value from column 2
SDF4 -0.211654
SDF4 0.978068
... (1 Reply)
Discussion started by: Diya123
1 Replies
3. Shell Programming and Scripting
Hello
I have file that consist of 2 columns of millions of entries
timestamp and throughput
I want to find the average (throughput ) for each equal timestamp before change it to proper format
e.g : i want to average 2 coloumnd fot all 1308154800 values in column 1
and then
print... (4 Replies)
Discussion started by: aadel
4 Replies
4. Shell Programming and Scripting
Hi all, I'm needing help again on scripting. I have weekly files with 3 columns, and I need to do monthly averaging on the values on column 3, the file naming convention is as follows:
20000105.u- 2000:year 01:month 05:day
20000112.u
20000119.u
20000126.u
20000202.u
20020209.u
I need to... (15 Replies)
Discussion started by: ida1215
15 Replies
5. Shell Programming and Scripting
Hi all,
I want to compute for the average of a file with null values (NaN) for each row. any help on how to do it. the sample file looks like this.
1.4 1.2 1.5 NaN 1.6
1.3 1.1 NaN 1.3 NaN
2.4 1.3 1.5 NaN 1.5
NaN 1.2 NaN 1.4 NaN
I need to do a row-wise averaging such that it will sum only... (14 Replies)
Discussion started by: ida1215
14 Replies
6. UNIX for Dummies Questions & Answers
Hello,
I have a table as shown below. I want to concatenate values in col2 and col3 based on a value in col4.
1 X Y A
3 Y Z B
4 A W B
5 T W A
If col4 is A, then I want to concatenate col3 with itself. Otherwise it should concateneate col2 with col3.
1 X Y YY
3 Y Z YZ... (10 Replies)
Discussion started by: Gussifinknottle
10 Replies
7. Shell Programming and Scripting
Hi, I have the following data:
2860377|"DATA1"|"DATA2"|"65343"|"DATA2"|"DATA4"|"11"|"DATA5"|"DATA6"|"65343"|"DATA7"|"0"|"8"|"1"|"NEGATIVE"
32340377|"DATA1"|"DATA2"|"65343"|"DATA2"|"DATA4"|"11"|"DATA5"|"DATA6"|"65343"|"DATA7"|"0"|"8"|"1"|"NEG-DID"... (3 Replies)
Discussion started by: sdohn
3 Replies
8. Shell Programming and Scripting
I have a file of the form.
16:00:26,83.33 16:05:26,83.33 16:10:26,83.33 16:15:26,83.33 16:20:26,90.26 16:25:26,83.33 16:30:26,83.33 17:00:26,83.33 17:05:26,83.33 17:10:26,83.33 17:15:26,83.33 17:20:26,90.26 17:25:26,83.33 17:30:26,83.33
For the timestamp 16:00:00 to 16:55:00, I need to... (5 Replies)
Discussion started by: Saidul
5 Replies
9. Shell Programming and Scripting
Hi,
My input files is like this
axis1 0 1 10
axis2 0 1 5
axis1 1 2 -4
axis2 2 3 -3
axis1 3 4 5
axis2 3 4 -1
axis1 4 5 -6
axis2 4 5 1
Now, these are my following tasks
1. Print a first column for every two rows that has the same value followed by a string.
2. Match on the... (3 Replies)
Discussion started by: jacobs.smith
3 Replies
10. Shell Programming and Scripting
Please help me to get required output for both scenario 1 and scenario 2 and need separate code for both scenario 1 and scenario 2
Scenario 1
i need to do below changes only when column1 is CR and column3 has duplicates rows/values. This inputfile can contain 100 of this duplicated rows of... (1 Reply)
Discussion started by: as7951
1 Replies
LEARN ABOUT MOJAVE
random
RANDOM(4) BSD Kernel Interfaces Manual RANDOM(4)
NAME
random , urandom -- random data source devices.
SYNOPSIS
pseudo-device random
DESCRIPTION
The random device produces uniformly distributed random byte values of potentially high quality.
To obtain random bytes, open /dev/random for reading and read from it.
The same random data is also available from getentropy(2). Using the getentropy(2) system call interface will provide resiliency to file
descriptor exhaustion, chroot, or sandboxing which can make /dev/random unavailable. Additionally, the arc4random(3) API provides a fast
userspace random number generator built on the random data source and is preferred over directly accessing the system's random device.
/dev/urandom is a compatibility nod to Linux. On Linux, /dev/urandom will produce lower quality output if the entropy pool drains, while
/dev/random will prefer to block and wait for additional entropy to be collected. With Yarrow, this choice and distinction is not necessary,
and the two devices behave identically. You may use either.
The random device implements the Yarrow pseudo random number generator algorithm and maintains its entropy pool. The kernel automatically
seeds the algorithm with additional entropy during normal execution.
FILES
/dev/random
/dev/urandom
HISTORY
A random device appeared in the Linux operating system.
Darwin September 6, 2001 Darwin