Sponsored Content
Top Forums Shell Programming and Scripting the smallest number from 90% of highest numbers from all numbers in file Post 302524206 by ananthap on Sunday 22nd of May 2011 08:16:50 AM
Old 05-22-2011
For a real quick solution, I would
(1) Put the data one on a line.
(2) Sort.
(3) Pass it to 'awk' with the required percentile value as a parameter.
(4) Use pattern $1 < parameter.
(5) For each record make it the minimum if needed.
(6) On END, print the value.
 

10 More Discussions You Might Find Interesting

1. AIX

How to replace many numbers with one number in a file

How to replace many numbers with one number in a file. Many numbers like 444565,454678,443298,etc. i want to replace these with one number (300).Please halp me out. (2 Replies)
Discussion started by: vpandey
2 Replies

2. Shell Programming and Scripting

Perl ? - How to find and print the lowest and highest numbers punched in by the user?

. . . . . . (3 Replies)
Discussion started by: some124one
3 Replies

3. UNIX for Dummies Questions & Answers

seperating records with numbers from a set of numbers

I have two files one (numbers file)contains the numbers(approximately 30000) and the other file(record file) contains the records(approximately 40000)which may or may not contain the numbers from that file. I want to seperate the records which has the field 1=(any of the number from numbers... (15 Replies)
Discussion started by: Shiv@jad
15 Replies

4. Shell Programming and Scripting

read numbers from file and output which numbers belongs to which range

Howdy experts, We have some ranges of number which belongs to particual group as below. GroupNo StartRange EndRange Group0125 935300 935399 Group2006 935400 935476 937430 937459 Group0324 935477 935549 ... (6 Replies)
Discussion started by: thepurple
6 Replies

5. Shell Programming and Scripting

trying to make an AWK code for ordering numbers in a column from least to highest

Hi all, I have a large column of numbers like 5.6789 2.4578 9.4678 13.5673 1.6589 ..... I am trying to make an awk code so that awk can easily go through the column and arrange the numbers from least to highest like 1.6589 2.4578 5.6789 ....... can anybody suggest, how can I do... (5 Replies)
Discussion started by: ananyob
5 Replies

6. Programming

Help with find highest and smallest number in a file with c

Input file: #data_1 AGDG #data_2 ADG #data_3 ASDDG DG #data_4 A Desired result: Highest 7 Slowest 1 code that I try but failed to archive my goal :( #include <stdio.h> (2 Replies)
Discussion started by: cpp_beginner
2 Replies

7. UNIX for Dummies Questions & Answers

Print numbers and associated text belonging to an interval of numbers

##### (0 Replies)
Discussion started by: lucasvs
0 Replies

8. Shell Programming and Scripting

Print numbers between two number ranges

Hi, I have a list.txt file with number ranges and want to print/save new all.txt file with all the numbers and between the numbers. == list.txt == 65936 65938 65942 && 65943 65945 ... (7 Replies)
Discussion started by: AK47
7 Replies

9. Shell Programming and Scripting

Adding (as in arithmetic) to numbers in columns in file, and writing new file with new numbers

Hi again. Sorry for all the questions — I've tried to do all this myself but I'm just not good enough yet, and the help I've received so far from bartus11 has been absolutely invaluable. Hopefully this will be the last bit of file manipulation I need to do. I have a file which is formatted as... (4 Replies)
Discussion started by: crunchgargoyle
4 Replies

10. UNIX for Beginners Questions & Answers

Decimal numbers and letters in the same collums: round numbers

Hi! I found and then adapt the code for my pipeline... awk -F"," -vOFS="," '{printf "%0.2f %0.f\n",$2,$4}' xxx > yyy I add -F"," -vOFS="," (for input and output as csv file) and I change the columns and the number of decimal... It works but I have also some problems... here my columns ... (7 Replies)
Discussion started by: echo manolis
7 Replies
Ufunc(3)						User Contributed Perl Documentation						  Ufunc(3)

NAME
PDL::Ufunc - primitive ufunc operations for pdl DESCRIPTION
This module provides some primitive and useful functions defined using PDL::PP based on functionality of what are sometimes called ufuncs (for example NumPY and Mathematica talk about these). It collects all the functions generally used to "reduce" or "accumulate" along a dimension. These all do their job across the first dimension but by using the slicing functions you can do it on any dimension. The PDL::Reduce module provides an alternative interface to many of the functions in this module. SYNOPSIS
use PDL::Ufunc; FUNCTIONS
prodover Signature: (a(n); int+ [o]b()) Project via product to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the product along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = prodover($b); $spectrum = prodover $image->xchg(0,1) prodover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. dprodover Signature: (a(n); double [o]b()) Project via product to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the product along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = dprodover($b); $spectrum = dprodover $image->xchg(0,1) Unlike prodover, the calculations are performed in double precision. dprodover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. cumuprodover Signature: (a(n); int+ [o]b(n)) Cumulative product This function calculates the cumulative product along the 1st dimension. By using xchg etc. it is possible to use any dimension. The sum is started so that the first element in the cumulative product is the first element of the parameter. $a = cumuprodover($b); $spectrum = cumuprodover $image->xchg(0,1) cumuprodover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. dcumuprodover Signature: (a(n); double [o]b(n)) Cumulative product This function calculates the cumulative product along the 1st dimension. By using xchg etc. it is possible to use any dimension. The sum is started so that the first element in the cumulative product is the first element of the parameter. $a = cumuprodover($b); $spectrum = cumuprodover $image->xchg(0,1) Unlike cumuprodover, the calculations are performed in double precision. dcumuprodover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. sumover Signature: (a(n); int+ [o]b()) Project via sum to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the sum along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = sumover($b); $spectrum = sumover $image->xchg(0,1) sumover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. dsumover Signature: (a(n); double [o]b()) Project via sum to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the sum along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = dsumover($b); $spectrum = dsumover $image->xchg(0,1) Unlike sumover, the calculations are performed in double precision. dsumover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. cumusumover Signature: (a(n); int+ [o]b(n)) Cumulative sum This function calculates the cumulative sum along the 1st dimension. By using xchg etc. it is possible to use any dimension. The sum is started so that the first element in the cumulative sum is the first element of the parameter. $a = cumusumover($b); $spectrum = cumusumover $image->xchg(0,1) cumusumover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. dcumusumover Signature: (a(n); double [o]b(n)) Cumulative sum This function calculates the cumulative sum along the 1st dimension. By using xchg etc. it is possible to use any dimension. The sum is started so that the first element in the cumulative sum is the first element of the parameter. $a = cumusumover($b); $spectrum = cumusumover $image->xchg(0,1) Unlike cumusumover, the calculations are performed in double precision. dcumusumover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. orover Signature: (a(n); int+ [o]b()) Project via or to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the or along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = orover($b); $spectrum = orover $image->xchg(0,1) If "a()" contains only bad data (and its bad flag is set), "b()" is set bad. Otherwise "b()" will have its bad flag cleared, as it will not contain any bad values. bandover Signature: (a(n); int+ [o]b()) Project via bitwise and to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the bitwise and along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = bandover($b); $spectrum = bandover $image->xchg(0,1) If "a()" contains only bad data (and its bad flag is set), "b()" is set bad. Otherwise "b()" will have its bad flag cleared, as it will not contain any bad values. borover Signature: (a(n); int+ [o]b()) Project via bitwise or to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the bitwise or along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = borover($b); $spectrum = borover $image->xchg(0,1) If "a()" contains only bad data (and its bad flag is set), "b()" is set bad. Otherwise "b()" will have its bad flag cleared, as it will not contain any bad values. zcover Signature: (a(n); int+ [o]b()) Project via == 0 to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the == 0 along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = zcover($b); $spectrum = zcover $image->xchg(0,1) If "a()" contains only bad data (and its bad flag is set), "b()" is set bad. Otherwise "b()" will have its bad flag cleared, as it will not contain any bad values. andover Signature: (a(n); int+ [o]b()) Project via and to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the and along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = andover($b); $spectrum = andover $image->xchg(0,1) If "a()" contains only bad data (and its bad flag is set), "b()" is set bad. Otherwise "b()" will have its bad flag cleared, as it will not contain any bad values. intover Signature: (a(n); int+ [o]b()) Project via integral to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the integral along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = intover($b); $spectrum = intover $image->xchg(0,1) Notes: For "n > 3", these are all "O(h^4)" (like Simpson's rule), but are integrals between the end points assuming the pdl gives values just at these centres: for such `functions', sumover is correct to O(h), but is the natural (and correct) choice for binned data, of course. intover ignores the bad-value flag of the input piddles. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. average Signature: (a(n); int+ [o]b()) Project via average to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the average along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = average($b); $spectrum = average $image->xchg(0,1) average does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. daverage Signature: (a(n); double [o]b()) Project via average to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the average along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = daverage($b); $spectrum = daverage $image->xchg(0,1) Unlike average, the calculation is performed in double precision. daverage does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. medover Signature: (a(n); [o]b(); [t]tmp(n)) Project via median to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the median along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = medover($b); $spectrum = medover $image->xchg(0,1) medover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. oddmedover Signature: (a(n); [o]b(); [t]tmp(n)) Project via oddmedian to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the oddmedian along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = oddmedover($b); $spectrum = oddmedover $image->xchg(0,1) The median is sometimes not a good choice as if the array has an even number of elements it lies half-way between the two middle values - thus it does not always correspond to a data value. The lower-odd median is just the lower of these two values and so it ALWAYS sits on an actual data value which is useful in some circumstances. oddmedover does handle bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. pctover Signature: (a(n); p(); [o]b(); [t]tmp(n)) Project via percentile to N-1 dimensions This function reduces the dimensionality of a piddle by one by finding the specified percentile (p) along the 1st dimension. The specified percentile must be between 0.0 and 1.0. When the specified percentile falls between data points, the result is interpolated. Values outside the allowed range are clipped to 0.0 or 1.0 respectively. The algorithm implemented here is based on the interpolation variant described at "/en.wikipedia.org/wiki/Percentile" in http: as used by Microsoft Excel and recommended by NIST. By using xchg etc. it is possible to use any dimension. $a = pctover($b, $p); $spectrum = pctover $image->xchg(0,1) $p pctover does not process bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. oddpctover Signature: (a(n); p(); [o]b(); [t]tmp(n)) Project via percentile to N-1 dimensions This function reduces the dimensionality of a piddle by one by finding the specified percentile along the 1st dimension. The specified percentile must be between 0.0 and 1.0. When the specified percentile falls between two values, the nearest data value is the result. The algorithm implemented is from the textbook version described first at "/en.wikipedia.org/wiki/Percentile" in http:. By using xchg etc. it is possible to use any dimension. $a = oddpctover($b, $p); $spectrum = oddpctover $image->xchg(0,1) $p oddpctover does not process bad values. It will set the bad-value flag of all output piddles if the flag is set for any of the input piddles. pct Return the specified percentile of all elements in a piddle. The specified percentile (p) must be between 0.0 and 1.0. When the specified percentile falls between data points, the result is interpolated. $x = pct($data, $pct); oddpct Return the specified percentile of all elements in a piddle. The specified percentile must be between 0.0 and 1.0. When the specified percentile falls between two values, the nearest data value is the result. $x = oddpct($data, $pct); avg Return the average of all elements in a piddle $x = avg($data); This routine handles bad values (see the documentation for average). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) sum Return the sum of all elements in a piddle $x = sum($data); This routine handles bad values (see the documentation for sumover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) prod Return the product of all elements in a piddle $x = prod($data); This routine handles bad values (see the documentation for prodover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) davg Return the average (in double precision) of all elements in a piddle $x = davg($data); This routine handles bad values (see the documentation for daverage). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) dsum Return the sum (in double precision) of all elements in a piddle $x = dsum($data); This routine handles bad values (see the documentation for dsumover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) dprod Return the product (in double precision) of all elements in a piddle $x = dprod($data); This routine handles bad values (see the documentation for dprodover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) zcheck Return the check for zero of all elements in a piddle $x = zcheck($data); This routine handles bad values (see the documentation for zcover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) and Return the logical and of all elements in a piddle $x = and($data); This routine handles bad values (see the documentation for andover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) band Return the bitwise and of all elements in a piddle $x = band($data); This routine handles bad values (see the documentation for bandover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) or Return the logical or of all elements in a piddle $x = or($data); This routine handles bad values (see the documentation for orover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) bor Return the bitwise or of all elements in a piddle $x = bor($data); This routine handles bad values (see the documentation for borover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) min Return the minimum of all elements in a piddle $x = min($data); This routine handles bad values (see the documentation for minimum). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) max Return the maximum of all elements in a piddle $x = max($data); This routine handles bad values (see the documentation for maximum). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) median Return the median of all elements in a piddle $x = median($data); This routine handles bad values (see the documentation for medover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) oddmedian Return the oddmedian of all elements in a piddle $x = oddmedian($data); This routine handles bad values (see the documentation for oddmedover). I still need to decide how to handle the case when the return value is a bad value (eg to make sure it has the same type as the input piddle OR perhaps we should die - makes sense for the conditional ops but not things like sum) any Return true if any element in piddle set Useful in conditional expressions: if (any $a>15) { print "some values are greater than 15 " } See or for comments on what happens when all elements in the check are bad. all Return true if all elements in piddle set Useful in conditional expressions: if (all $a>15) { print "all values are greater than 15 " } See and for comments on what happens when all elements in the check are bad. minmax Returns an array with minimum and maximum values of a piddle. ($mn, $mx) = minmax($pdl); This routine does not thread over the dimensions of $pdl; it returns the minimum and maximum values of the whole array. See minmaximum if this is not what is required. The two values are returned as Perl scalars similar to min/max. perldl> $x = pdl [1,-2,3,5,0] perldl> ($min, $max) = minmax($x); perldl> p "$min $max "; -2 5 qsort Signature: (a(n); [o]b(n)) Quicksort a vector into ascending order. print qsort random(10); Bad values are moved to the end of the array: perldl> p $b [42 47 98 BAD 22 96 74 41 79 76 96 BAD 32 76 25 59 BAD 96 32 BAD] perldl> p qsort($b) [22 25 32 32 41 42 47 59 74 76 76 79 96 96 96 98 BAD BAD BAD BAD] qsorti Signature: (a(n); int [o]indx(n)) Quicksort a vector and return index of elements in ascending order. $ix = qsorti $a; print $a->index($ix); # Sorted list Bad elements are moved to the end of the array: perldl> p $b [42 47 98 BAD 22 96 74 41 79 76 96 BAD 32 76 25 59 BAD 96 32 BAD] perldl> p $b->index( qsorti($b) ) [22 25 32 32 41 42 47 59 74 76 76 79 96 96 96 98 BAD BAD BAD BAD] qsortvec Signature: (a(n,m); [o]b(n,m)) Sort a list of vectors lexicographically. The 0th dimension of the source piddle is dimension in the vector; the 1st dimension is list order. Higher dimensions are threaded over. print qsortvec pdl([[1,2],[0,500],[2,3],[4,2],[3,4],[3,5]]); [ [ 0 500] [ 1 2] [ 2 3] [ 3 4] [ 3 5] [ 4 2] ] Vectors with bad components should be moved to the end of the array: qsortveci Signature: (a(n,m); int [o]indx(m)) Sort a list of vectors lexicographically, returning the indices of the sorted vectors rather than the sorted list itself. As with "qsortvec", the input PDL should be an NxM array containing M separate N-dimensional vectors. The return value is an integer M-PDL containing the M-indices of original array rows, in sorted order. As with "qsortvec", the zeroth element of the vectors runs slowest in the sorted list. Additional dimensions are threaded over: each plane is sorted separately, so qsortveci may be thought of as a collapse operator of sorts (groan). Vectors with bad components should be moved to the end of the array: minimum Signature: (a(n); [o]c()) Project via minimum to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the minimum along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = minimum($b); $spectrum = minimum $image->xchg(0,1) Output is set bad if all elements of the input are bad, otherwise the bad flag is cleared for the output piddle. Note that "NaNs" are considered to be valid values; see isfinite and badmask for ways of masking NaNs. minimum_ind Signature: (a(n); int [o] c()) Like minimum but returns the index rather than the value Output is set bad if all elements of the input are bad, otherwise the bad flag is cleared for the output piddle. minimum_n_ind Signature: (a(n); int[o]c(m)) Returns the index of "m" minimum elements Not yet been converted to ignore bad values maximum Signature: (a(n); [o]c()) Project via maximum to N-1 dimensions This function reduces the dimensionality of a piddle by one by taking the maximum along the 1st dimension. By using xchg etc. it is possible to use any dimension. $a = maximum($b); $spectrum = maximum $image->xchg(0,1) Output is set bad if all elements of the input are bad, otherwise the bad flag is cleared for the output piddle. Note that "NaNs" are considered to be valid values; see isfinite and badmask for ways of masking NaNs. maximum_ind Signature: (a(n); int [o] c()) Like maximum but returns the index rather than the value Output is set bad if all elements of the input are bad, otherwise the bad flag is cleared for the output piddle. maximum_n_ind Signature: (a(n); int[o]c(m)) Returns the index of "m" maximum elements Not yet been converted to ignore bad values minmaximum Signature: (a(n); [o]cmin(); [o] cmax(); int [o]cmin_ind(); int [o]cmax_ind()) Find minimum and maximum and their indices for a given piddle; perldl> $a=pdl [[-2,3,4],[1,0,3]] perldl> ($min, $max, $min_ind, $max_ind)=minmaximum($a) perldl> p $min, $max, $min_ind, $max_ind [-2 0] [4 3] [0 1] [2 2] See also minmax, which clumps the piddle together. If "a()" contains only bad data, then the output piddles will be set bad, along with their bad flag. Otherwise they will have their bad flags cleared, since they will not contain any bad values. AUTHOR
Copyright (C) Tuomas J. Lukka 1997 (lukka@husc.harvard.edu). Contributions by Christian Soeller (c.soeller@auckland.ac.nz) and Karl Glazebrook (kgb@aaoepp.aao.gov.au). All rights reserved. There is no warranty. You are allowed to redistribute this software / documentation under certain conditions. For details, see the file COPYING in the PDL distribution. If this file is separated from the PDL distribution, the copyright notice should be included in the file. perl v5.12.1 2010-07-05 Ufunc(3)
All times are GMT -4. The time now is 09:09 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy