Sponsored Content
Top Forums Shell Programming and Scripting awk pattern match and count unique in column Post 302799407 by Corona688 on Friday 26th of April 2013 12:49:02 PM
Old 04-26-2013
I'm afraid it's not entirely clear what you want, programs which don't work for you are not nearly as illuminating as a good unabridged sample of the input data you have and the output data you want would be.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Finding Unique strings which match pattern

I need to grep for a pattern in a file. Files are huge and have several repeated occurances of the strings which match pattern. I just need the strings which contain the pattern in the output. For eg. The contents of my file are as follows. The pattern I want to match by is ABCD ... (5 Replies)
Discussion started by: tektips
5 Replies

2. Shell Programming and Scripting

awk count how many unique IPs have received that error

Hi all, I want to write a awk script that counts unique IPs that have received one special error. For example 25-04-2012;192.168.70.31;1254545454545417;500.0;SUCCESS 25-04-2012;192.168.70.32;355666650914;315126423993;;General_ERROR_23 30-04-2012;192.168.70.33;e;null;null;Failure... (2 Replies)
Discussion started by: arrals_vl
2 Replies

3. Shell Programming and Scripting

Count frequency of unique values in specific column

Hi, I have tab-deliminated data similar to the following: dot is-big 2 dot is-round 3 dot is-gray 4 cat is-big 3 hot in-summer 5 I want to count the frequency of each individual "unique" value in the 1st column. Thus, the desired output would be as follows: dot 3 cat 1 hot 1 is... (5 Replies)
Discussion started by: owwow14
5 Replies

4. Shell Programming and Scripting

awk to count using each unique value

Im looking for an awk script that will take the unique values in column 5, then print and count the unique values in column 6. CA001011500 11111 11111 -9999 201301 AAA CA001012040 11111 11111 -9999 201301 AAA CA001012573 11111 11111 -9999 201301 BBB CA001012710 11111 11111 -9999 201301... (4 Replies)
Discussion started by: ncwxpanther
4 Replies

5. Shell Programming and Scripting

awk unique count of partial match with semi-colon

Trying to get the unique count of the below input, but if the text in beginning of $5 is a partial match to another line in the file then it is not unique. awk awk '!seen++ {n++} END {print n}' input 7 input chr1 159174749 159174770 chr1:159174749-159174770 ACKR1 chr1 ... (2 Replies)
Discussion started by: cmccabe
2 Replies

6. Shell Programming and Scripting

Count occurrence of column one unique value having unique second column value

Hello Team, I need your help on the following: My input file a.txt is as below: 3330690|373846|108471 3330690|373846|108471 0640829|459725|100001 0640829|459725|100001 3330690|373847|108471 Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are... (4 Replies)
Discussion started by: angshuman
4 Replies

7. UNIX for Beginners Questions & Answers

Awk: count unique element of array

Hi, tab-separated input: blabla_1 A,B,C,C blabla_2 A,E,G blabla_3 R,Q,A,B,C,R,Q output: blabla_1 3 blabla_2 3 blabla_3 5 After splitting $2 in an array, I am trying to store the number of unique elements in a variable, but have some difficulties resetting the variable to 0 before... (6 Replies)
Discussion started by: beca123456
6 Replies

8. UNIX for Beginners Questions & Answers

Count unique column

Hello, I am trying to count unique rows in my file based on 4 columns (2-5) and to output its frequency in a sixth column. My file is tab delimited My input file looks like this: Colum1 Colum2 Colum3 Colum4 Coulmn5 1.1 100 100 a b 1.1 100 100 a c 1.2 200 205 a d 1.3 300 301 a y 1.3 300... (6 Replies)
Discussion started by: nans
6 Replies

9. Shell Programming and Scripting

Count number of unique values in each column of array

What is an efficient way of counting the number of unique values in a 400 column by 1000 row array and outputting the counts per column, assuming the unique values in the array are: A, B, C, D In other words the output should look like: Value COL1 COL2 COL3 A 50 51 52... (16 Replies)
Discussion started by: Geneanalyst
16 Replies

10. Shell Programming and Scripting

If pattern match in other column, modify column 3.

My command sed will modify everything in column 3 if i will use the command below. I want to search for a pattern then modify everything in column 3. sed -i 's/\|165\|/server1/g' file.txt Input: 01-31-2019 19:14:05|device|165|1548962040165|5c5348f9-0804-1111|file_attach|7271|587|smtp|... (6 Replies)
Discussion started by: invinzin21
6 Replies
GRDGRADIENT(l)															    GRDGRADIENT(l)

NAME
grdgradient - Compute directional derivative or gradient from 2-D grd file representing z(x,y) SYNOPSIS
grdgradient in_grdfile -Gout_grdfile [ -Aazim[/azim2] ] [ -D[c][o][n] ] [ -Lflag ] [ -M ] [ -N[e][t][amp][/sigma[/offset]] ] [ -Sslopefile ] [ -V ] DESCRIPTION
grdgradient may be used to compute the directional derivative in a given direction (-A), or the direction (-S) [and the magnitude (-D)] of the vector gradient of the data. Estimated values in the first/last row/column of output depend on boundary conditions (see -L). in_grdfile 2-D grd file from which to compute directional derivative. -G Name of the output grdfile for the directional derivative. OPTIONS
No space between the option flag and the associated arguments. Use upper case for the option flags and lower case for modifiers. -A Azimuthal direction for a directional derivative; azim is the angle in the x,y plane measured in degrees positive clockwise from north (the +y direction) toward east (the +x direction). The negative of the directional derivative, -[dz/dx*sin(azim) + dz/dy*cos(azim)], is found; negation yields positive values when the slope of z(x,y) is downhill in the azim direction, the correct sense for shading the illumination of an image (see grdimage and grdview) by a light source above the x,y plane shining from the azim direction. Optionally, supply two azimuths, -Aazim/azim2, in which case the gradients in each of these directions are calcu- lated and the one larger in magnitude is retained; this is useful for illuminating data with two directions of lineated structures, e.g. -A0/270 illuminates from the north (top) and west (left). -D Find the direction of the gradient of the data. By default, the directions are measured clockwise from north, as azim in -A above. Append c to use conventional cartesian angles measured counterclockwise from the positive x (east) direction. Append o to report orientations (0-180) rather than directions (0-360). Append n to add 90 degrees to all angles (e.g., to give orientation of lineated features). -L Boundary condition flag may be x or y or xy indicating data is periodic in range of x or y or both, or flag may be g indicating geo- graphical conditions (x and y are lon and lat). [Default uses "natural" conditions (second partial derivative normal to edge is zero).] -M By default the units of grdgradient are in units_of_z/units_of_dx_and_dy. However, the user may choose this option to convert dx,dy in degrees of longitude,latitude into meters, so that the units of grdgradient are in z_units/meter. -N Normalization. [Default: no normalization.] The actual gradients g are offset and scaled to produce normalized gradients gn with a maximum output magnitude of amp. If amp is not given, default amp = 1. If offset is not given, it is set to the average of g. -N yields gn = amp * (g - offset)/max(abs(g - offset)). -Ne normalizes using a cumulative Laplace distribution yielding gn = amp * (1.0 - exp(sqrt(2) * (g - offset)/sigma)) where sigma is estimated using the L1 norm of (g - offset) if it is not given. -Nt normal- izes using a cumulative Cauchy distribution yielding gn = (2 * amp / PI) * atan( (g - offset)/sigma) where sigma is estimated using the L2 norm of (g - offset) if it is not given. -S Name of output grdfile with scalar magnitudes of gradient vectors. Requires -D. -V Selects verbose mode, which will send progress reports to stderr [Default runs "silently"]. HINTS
If you don't know what -N options to use to make an intensity file for ' grdimage or grdview, a good first try is -Ne0.6. If you want to make several illuminated maps of subregions of a large data set, and you need the illumination effects to be consistent across all the maps, use the -N option and supply the same value of sigma and offset to grdgradient for each map. A good guess is offset = 0 and sigma found by grdinfo -L2 or -L1 applied to an unnormalized gradient grd. If you simply need the x- or y-derivatives of the grid, use grdmath. EXAMPLES
To make a file for illuminating the data in geoid.grd using exp-normalized gradients imitating light sources in the north and west direc- tions, do grdgradient geoid.grd -A0/270 -Ggradients.grd -Ne0.6 -V To find the azimuth orientations of seafloor fabric in the file topo.grd, try grdgradient topo.grd -Snao -Gazimuths.grd -V SEE ALSO
gmt(1gmt), gmtdefaults(1gmt), grdhisteq(1gmt), grdimage(1gmt), grdview(1gmt), grdvector(1gmt) 1 Jan 2004 GRDGRADIENT(l)
All times are GMT -4. The time now is 10:08 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy