Normalize text field or sort values Post: 303045958

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to sort a field in a file having date values

Hi All, I am having a pipe delimited file .In this file the 3rd column is having date values.I need to get the min date and max date from that file. I have used cut -d '|' test.dat -f 3|sort -u But it is not sorting the date .How to sort the date column using unix commands Thanks ...

2. Shell Programming and Scripting

Find top N values for field X based on field Y's value

I want to find the top N entries for a certain field based on the values of another field. For example if N=3, we want the 3 best values for each entry: Entry1 ||| 100 Entry1 ||| 95 Entry1 ||| 30 Entry1 ||| 80 Entry1 ||| 50 Entry2 ||| 40 Entry2 ||| 20 Entry2 ||| 10 Entry2 ||| 50...

3. Shell Programming and Scripting

Sort alpha on 1st field, numerical on 2nd field (sci notation)

I want to sort alphabetically on the first field and sort in descending numerical order on the 2nd field. With a normal "sort -r -n" it does this: abc ||| 5e-05 ||| bla abc ||| 3 ||| ble def ||| 1 ||| abc def ||| 0.2 ||| def As you can see it ignores the fact that 5e-05 is actually 0.00005...

4. Shell Programming and Scripting

adding field values if field matches

hi i have file as below , i want to add duplicate records like bell_bb to one record with valuve as 15 ( addition of both ) any oneline awk script to achive this ? header 0 CAMPAIGN_NAME 1 Bell_BB 14 Bell_MONTHLY 803 SOLO_UNBEATABLE 644 Bell_BB 1 Bell_MONTHLY 25 SOLO_UNBEATABLE...

5. Shell Programming and Scripting

awk, comma as field separator and text inside double quotes as a field.

Hi, all I need to get fields in a line that are separated by commas, some of the fields are enclosed with double quotes, and they are supposed to be treated as a single field even if there are commas inside the quotes. sample input: for this line, 5 fields are supposed to be extracted, they...

6. Shell Programming and Scripting

Awk Search text string in field, not all in field.

Hello, I am using awk to match text in a tab separated field and am able to do so when matching the exact word. My problem is that I would like to match any sequence of text in the tab-separated field without having to match it all. Any help will be appreciated. Please see the code below. awk...

7. Shell Programming and Scripting

Read record from the text file contain multiple separated values & assign those values to variables

I have a file containing multiple values, some of them are pipe separated which are to be read as separate values and some of them are single value all are these need to store in variables. I need to read this file which is an input to my script Config.txt file name, first path, second...

8. Shell Programming and Scripting

Sort file by field 1 that has text as well as a number

I am using the below awk that results in the below output: awk '{k=$1 OFS $2; s+=$4; c++} END{for(i in s) print i, s/c}' input.txt > output.txt output.txt chr20:43625799-43625957 STK4:exon.6;STK4:exon.7 310.703 chr20:36770455-36770611 TGM2:exon.6;TGM2:exon.7 614.756...

9. Shell Programming and Scripting

awk to parse field and include the text of 1 pipe in field 4

I am trying to parse the input in awk to include the |gc= in $4 but am not able to. The below is close: awk so far: awk '{sub(/\|]+]++/, ""); print }' input.txt Input chr1 955543 955763 AGRN-6|pr=2|gc=75 0 + chr1 957571 957852 AGRN-7|pr=3|gc=61.2 0 + chr1 970621 ...

10. UNIX for Beginners Questions & Answers

awk GSUB read field values from multiple text files

My program run without error. The problem I am having. The program isn't outputting field values with the column headers to file.txt. Each of the column headers in file.txt has no data. MEMSIZE SECOND SASFoundation Filename The output results in file.txt should show: ...

LEARN ABOUT DEBIAN

maphimbu

MAPHIMBU(1)							   User Commands						       MAPHIMBU(1)

NAME

       maphimbu -  histogram builder for 1-d numerical and text data

SYNOPSIS

       maphimbu [OPTION]... [FILE]

DESCRIPTION

       This  program produces 1-d histograms from numerical or text data input. It can be also used to estimate the probability distribution func-
       tion of a numerical variable - see http://en.wikipedia.org/wiki/Probability_density_function.

OPTIONS

       -x <int>
	      x-data column (default is 1)

       -y <int>
	      y-data column (default is 2); It is considered only when combined with '-m' or '-S'

       -d <float|int>
	      delta size (dx-resolution) in case of numerical data; Keep in mind that 2 is not the same as 2.0: in the first case the numbers  are
	      treated as integers, in the latter as floats.

       -n     normalize  the  result  A)  non-numerical data: n(x) = counts(x)/sum_of_counts B) numerical data: the normalized probability density
	      func.

	      is P(-INF < x <INF) = Int_[-INF:INF] P(x)*dx = 1 ; For the numerical integration an open x-data interval is assumed.

       -N     normalize data against the total sum of counts (same as option '-n' with case A forced)

       -U     normalize the result with x-range mapped to unit; The x-values are mapped to the interval [0:1], respectively Int_[0:1] P(x)*dx = 1;
	      This option is mutually exclusive with '-n'.

       -S     compute sums and normalized sums of y-values; The total sum of all y-values is used for the normalization.

       -m     compute the arithmetic mean of y-values in the respective x-bar

       -s <int>
	      sort output using the specified column; Header is skipped in this case.

       -g <int>
	      sort output numerically using the specified column; Header is skipped in this case.

       -r     do reverse sorting (in combination with '-g' and '-s')

       -C     center histogram bars (shifts x-axis by 0.5*dx)

       -X     treat hole line as one string (single data record)

       -H     print a data description header

       -V     print program version and exit

       --version
	      output version and copyright information

       --help display help

       -h     display short help (options summary)

       Note: this program is not intended for use in high order numerical computations.

REPORTING BUGS

       Report bugs to <gnu@mirendom.net>

COPYRIGHT

       Copyright (C) 2003-2007, 2009, 2011 Dimitar Ivanov

       License: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
       This is free software: you are free to change and redistribute it.  There is NO WARRANTY, to the extent permitted by law.

maphimbu 2.8.4							   February 2012						       MAPHIMBU(1)