Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk to ignore multiple rows based on a condition
Top Forums Shell Programming and Scripting awk to ignore multiple rows based on a condition Post 302967521 by Don Cragun on Wednesday 24th of February 2016 12:39:36 PM
Old 02-24-2016
Hi ks_reddy,
Assuming that the Check values in your input are all numeric values, I note that RudiC's code will sort the header from your input file to the end of your output file. And by using the 2nd field as the primary sort key, the output will be grouped by (alphanumeric; not numeric) Check values while your input seems to be grouped by Key values.

Does your real input have all lines for each distinct Key value grouped together?

Do you want the header line in the output file? If so, does the header need to be kept as the first line in the output?

Does the order of other lines in the output matter? If so, does the input order need to be maintained in the output? Or is a different sort order required (and, if so, what order)?

Approximately how many distinct Key values are there in your real input? Approximately how many of those Key values will need to be removed?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to select rows based on condition on column

I have got a file like this 003ABC00281020091005000100042.810001 ... (8 Replies)
Discussion started by: Maruti
8 Replies

2. Shell Programming and Scripting

Getting rip of multiple rows based on column1

Hi, I want to get rid of multiple rows (duplicate, triplicate etc..) for only column 1. e.g. iu 2 iu 1 iu 3 k 4 jk 3 nm 4 nm 2 output k 4 jk 3 thanks (7 Replies)
Discussion started by: phil_heath
7 Replies

3. Shell Programming and Scripting

Removing rows based on a different file (ignore my earlier post - there was a mistake).

Sorry I made a mistake in my last post (output is suppose to be the opposite). Here is a revised post. Hi, I am not sure if this has already been asked (I tried the search but the search was too broad). Basically I want to remove rows based on another file. So file1 looks like this (tab... (3 Replies)
Discussion started by: kylle345
3 Replies

4. Shell Programming and Scripting

Combining multiple rows in single row based on certain condition using awk or sed

Hi, I'm using AIX(ksh shell). > cat temp.txt "a","b",0 "c",bc",0 "a1","b1",0 "cc","cb",1 "cc","b2",1 "bb","bc",2 I want the output as: "a","b","c","bc","a1","b1" "cc","cb","cc","b2" "bb","bc" I want to combine multiple lines into single line where third column is same. Is... (1 Reply)
Discussion started by: samuelray
1 Replies

5. Shell Programming and Scripting

Selecting rows from a pipe delimited file based on condition

HI all, I have a simple challenge for you.. I have the following pipe delimited file 2345|98|1809||x|969|0 2345|98|0809||y|0|537 2345|97|9809||x|544|0 2345|97|0909||y|0|651 9685|98|7809||x|321|0 9685|98|7909||y|0|357 9685|98|7809||x|687|0 9685|98|0809||y|0|234 2315|98|0809||x|564|0 ... (2 Replies)
Discussion started by: nithins007
2 Replies

6. Shell Programming and Scripting

awk based script to ignore all columns from a file which contains character strings

Hello All, I have a .CSV file where I expect all numeric data in all the columns other than column headers. But sometimes I get the files (result of statistics computation by other persons) like below( sample data) SNO,Data1,Data2,Data3 1,2,3,4 2,3,4,SOME STRING 3,4,Inf,5 4,5,4,4 I... (9 Replies)
Discussion started by: ks_reddy
9 Replies

7. Shell Programming and Scripting

awk code to ignore the first occurence unknown number of rows in a data column

Hello experts, Shown below is the 2 column sample data(there are many data columns in actual input file), Key, Data A, 1 A, 2 A, 2 A, 3 A, 1 A, 1 A, 1 I need the below output. Key, Data A, 2 A, 2 A, 3 A, 1 A, 1 A, 1 (2 Replies)
Discussion started by: ks_reddy
2 Replies

8. Shell Programming and Scripting

Extracting rows and columns in a matrix based on condition

Hi I have a matrix with n rows and m columns like below example. i want to extract all the pairs with values <200. Input A B C D A 100 206 51 300 B 206 100 72 48 C 351 22 100 198 D 13 989 150 100 Output format A,A:200 A,C:51 B,B:100... (2 Replies)
Discussion started by: anurupa777
2 Replies

9. Shell Programming and Scripting

Convert rows to columns based on condition

I have a file some thing like this: GN Name=YWHAB; RC TISSUE=Keratinocyte; RC TISSUE=Thymus; CC -!- FUNCTION: Adapter protein implicated in the regulation of a large CC spectrum of both general and specialized signaling pathways GN Name=YWHAE; RC TISSUE=Liver; RC ... (13 Replies)
Discussion started by: raj_k
13 Replies

10. Shell Programming and Scripting

Combine multiple rows based on selected column keys

Hello I want to collapse a file with multiple rows into consolidated lines of entries based on selected columns as the 'key'. Example: 1 2 3 Abc def ghi 1 2 3 jkl mno p qrts 6 9 0 mno def Abc 7 8 4 Abc mno mno abc 7 8 9 mno mno abc 7 8 9 mno j k So if columns 1, 2 and 3 are... (6 Replies)
Discussion started by: linuxlearner123
6 Replies

LEARN ABOUT DEBIAN

pfspad

pfspad(1)						      General Commands Manual							 pfspad(1)

NAME

       pfspad - Add borders to a frame in PFS stream

SYNOPSIS

       pfspad  [--left	<columns>]  [--right <columns>] [--top <rows>] [--bottom <rows>] [--width <new_width>] [--height <new_height>] [--R <val>]
       [--G <val>] [--B <val>] [--Y <val>] [--help]

DESCRIPTION

       Add borders to each frame in PFS stream. User specifies size of left, right, top and bottom border or size of an  output  image.  Color	of
       borders can be specified as well.

OPTIONS

       --left <columns>, -l <columns>
	      Width in pixels of the left border.

       --right <columns>, -r <columns>
	      Width in pixels of the right border.

       --top <rows>, -t <rows>
	      Height in pixels of the top border.

       --bottom <rows>, -b <rows>
	      Height in pixels of the bottom border.

       --width <new_width>, -W <new_width>
	      Width of an output image. Note that --width can be mixed with either --left or --right option.

       --height <new_height>, -H <new_height>
	      Height of an output image. Note that --height can be mixed with either --top or --bottom option.

       --R <val>, -R <val>, --G <val>, -G <val>, --B <val>, -B <val>
	      Color of borders in RGB mode. Default color is black, and if some of the components is not specified, its value is set to 0.0.

       --Y <val>, -Y <val>
	      Color of borders in luminance mode.

       --help, -h
	      Print a list of commandline options.

EXAMPLES

       pfsin image.hdr | pfspad --left 50 --bottom 20 | pfsout out.hdr
	      Add 50 columns to the left and 20 rows to the bottom side of image.hdr.  Color of borders is default black.

       pfsin image.hdr | pfspad --top 20 --height 500 --width 400 --R 1.0 | pfsout out.hdr
	      Add 20 rows to the top side of image.hdr and create output image out.hdr 500 pixels in height and 400 pixels in width. Color of bor-
	      ders is set to red.

SEE ALSO

       pfsin(1) pfsout(1)

BUGS

       Please report bugs and comments to Dorota Zdrojewska <dzdrojewska@wi.ps.pl>.

																	 pfspad(1)
All times are GMT -4. The time now is 09:51 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy