awk sort based on difference of fields and print all fields Post: 302952884

Sponsored Content

Top Forums Shell Programming and Scripting awk sort based on difference of fields and print all fields Post 302952884 by RudiC on Monday 24th of August 2015 04:36:20 AM

08-24-2015

Registered User

Please use code tags as required by forum rules.

Try an adaption of vgersh99's proposal (and adapt to taste), applied on a fictious input file prepared from your above "sample":

Code:

awk '$0=sprintf("%14.12f", $5-$7) OFS $0' file1 | sort -k1,1n
-0.000000000081 DC: XY_CLK__Q__F_E__MODE2 G:-2L quad:slmx 3.900000e-11 -> 1.200000e-10
-0.000000000081 DC: XY_CLK__Q__F_E__MODE2 G:-2 quad:slmx 3.900000e-11 -> 1.200000e-10
-0.000000000081 DC: XY_CLK__Q__F_E__MODE3 G:-2L quad:slmx 3.900000e-11 -> 1.200000e-10
-0.000000000081 DC: XY_CLK__Q__F_E__MODE3 G:-2 quad:slmx 3.900000e-11 -> 1.200000e-10
-0.000000000076 DC: XY_CLK__Q__F_E__MODE4 G:-1 quad:slmn 1.700000e-11 -> 9.300000e-11
-0.000000000009 DC: XY_CE__Q G:-2LV quad:slmn 1.850000e-10 -> 1.940000e-10
-0.000000000009 DC: XY_CE__Q__MODE4 G:-2L quad:slmn 1.200000e-10 -> 1.290000e-10
-0.000000000009 DC: XY_CE__Q__MODE4 G:-2 quad:slmn 1.200000e-10 -> 1.290000e-10
-0.000000000009 DC: XY_CLK__CE__HOLD_FALLING G:-2LV quad:ftmn -1.600000e-11 -> -7.000000e-12
-0.000000000008 DC: XY_CE__Q__MODE1 G:-2LV quad:ftmn 9.200000e-11 -> 1.000000e-10
-0.000000000008 DC: XY_CE__Q__MODE1 G:-3 quad:slmn 1.130000e-10 -> 1.210000e-10
-0.000000000008 DC: XY_CE__Q__MODE2 G:-2LV quad:ftmn 9.200000e-11 -> 1.000000e-10

Had you supplied a sample input file in the first place, an immediate taylored solution would have been possible .

RudiC

View Public Profile for RudiC

Find all posts by RudiC

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Perl function to sort a file based on key fields

Hi, I am new to PERL.I want to sort all the lines in a file based on 1,2 and 4th filelds. Can U suggest me a command/function in perl for this operation..

2. Shell Programming and Scripting

awk sed cut? to rearrange random number of fields into 3 fields

I'm working on formatting some attendance data to meet a vendors requirements to upload to their system. With some help on the forums here, I have the data close. But they've since changed what they want. The vendor wants me to submit three fields to them. Field 1 is the studentid field,...

3. Shell Programming and Scripting

awk /nawk :: print the everything except the first and the last fields

format of file1 "file1.txt" 1 2 3 4 A B C XX YY ZZ AA WWW The output must contain except the first and last column the output must be 2 3 B YY ZZ AA

4. Shell Programming and Scripting

awk - print all fields except for last field

How do I print all the fields of a record except for the $(NF) field?

5. Shell Programming and Scripting

awk to print range of fields

Hi file.in and file.out are in csv format. the code I have now is, cat file.in | awk -F"," '!($1$2$3$4$5$6$7$8 in a){a;print $0}' > file.out Here, I am printing entire line using $0. however, I want to print $1 to $150 and it should be in csv format. Cut -d is not good in performace....

6. Shell Programming and Scripting

How to print 1st field and last 2 fields together and the rest of the fields after it using awk?

Hi experts, I need to print the first field first then last two fields should come next and then i need to print rest of the fields. Input : a1,abc,jsd,fhf,fkk,b1,b2 a2,acb,dfg,ghj,b3,c4 a3,djf,wdjg,fkg,dff,ggk,d4,d5 Expected output: a1,b1,b2,abc,jsd,fhf,fkk...

7. Shell Programming and Scripting

awk - compare 1st 15 fields of record with 20 fields

I'm trying to compare 2 files for differences in a selct number of fields. When differnces are found it will write the whole record of the second file including appending '|C' out to a delta file. Each record will have 20 fields, but only want to do comparison of 1st 15 fields. The 1st field of...

8. Shell Programming and Scripting

awk print even fields of file

Hello: I want to print out the even number of fields plus the first column as row identifiers. input.txt ID X1 ID X2 ID X3 ID X4 A 700 A 1200 A 400 A 1300 B 2000 B 1000 B 2000 B 600 C 1400 C 200 C 1000 C 1200 D 1300 D 500 D 600 D 200and the output is: output.txt ID X1 X2 X3...

9. Shell Programming and Scripting

Print . in blank fields to prevent fields from shifting

The below code works great, kindly provided by @Don Cragun, the lines in bold print the current output. Since some of the fields printed can be blank some of the fields are shifted. I can not seem too add . to the blank fields like in the desired output. Basically, if there is nothing in the field...

10. Shell Programming and Scripting

awk to print lines based on text in field and value in two additional fields

In the awk below I am trying to print the entire line, along with the header row, if $2 is SNV or MNV or INDEL. If that condition is met or is true, and $3 is less than or equal to 0.05, then in $7 the sub pattern :GMAF= is found and the value after the = sign is checked. If that value is less than...

LEARN ABOUT DEBIAN

bup-margin

bup-margin(1)						      General Commands Manual						     bup-margin(1)

NAME

       bup-margin - figure out your deduplication safety margin

SYNOPSIS

       bup margin [options...]

DESCRIPTION

       bup margin  iterates  through  all  objects  in	your  bup repository, calculating the largest number of prefix bits shared between any two
       entries.  This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.

       For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45.  That  means  a  46-bit
       hash  would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
       its first 46 bits.

       The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects.  Since SHA-1 hashes have 160 bits,
       that  leaves 115 bits of margin.  Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
       with far fewer objects.

       If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see	if
       you're getting dangerously close to 160 bits.

OPTIONS

       --predict
	      Guess  the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
	      from the guess.  This is potentially useful for tuning an interpolation search algorithm.

       --ignore-midx
	      don't use .midx files, use only .idx files.  This is only really useful when used with --predict.

EXAMPLE

	      $ bup margin
	      Reading indexes: 100.00% (1612581/1612581), done.
	      40
	      40 matching prefix bits
	      1.94 bits per doubling
	      120 bits (61.86 doublings) remaining
	      4.19338e+18 times larger is possible

	      Everyone on earth could have 625878182 data sets
	      like yours, all in one repository, and we would
	      expect 1 object collision.

	      $ bup margin --predict
	      PackIdxList: using 1 index.
	      Reading indexes: 100.00% (1612581/1612581), done.
	      915 of 1612581 (0.057%)

SEE ALSO

       bup-midx(1), bup-save(1)

BUP

       Part of the bup(1) suite.

AUTHORS

       Avery Pennarun <apenwarr@gmail.com>.

Bup unknown-															     bup-margin(1)