Sponsored Content
Top Forums Shell Programming and Scripting awk to ignore multiple rows based on a condition Post 302967544 by ks_reddy on Wednesday 24th of February 2016 07:01:15 PM
Old 02-24-2016
Hi rdrtx1,
Your code works very well. Thank you so much.

---------- Post updated at 05:27 AM ---------- Previous update was at 05:26 AM ----------

Hello Don,
As mentioned already the code suggested by rdrtx1 works well as my output require header to be kept as it is and also the original order to be kept.

---------- Post updated at 05:31 AM ---------- Previous update was at 05:27 AM ----------

Quote:
Originally Posted by RudiC
How about
Code:
sort -t, -k2 file | awk -F, '$2 == "" {T[$1]} !($1 in T)'

Hi Rudi,
I should not sort my whole input data. So I followed the code suggested by the user rdrtx1. It works perfectly.
The speed comparison.
Your code took 90 secs on my sample data and rdrtx1's code took 21 secs.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to select rows based on condition on column

I have got a file like this 003ABC00281020091005000100042.810001 ... (8 Replies)
Discussion started by: Maruti
8 Replies

2. Shell Programming and Scripting

Getting rip of multiple rows based on column1

Hi, I want to get rid of multiple rows (duplicate, triplicate etc..) for only column 1. e.g. iu 2 iu 1 iu 3 k 4 jk 3 nm 4 nm 2 output k 4 jk 3 thanks (7 Replies)
Discussion started by: phil_heath
7 Replies

3. Shell Programming and Scripting

Removing rows based on a different file (ignore my earlier post - there was a mistake).

Sorry I made a mistake in my last post (output is suppose to be the opposite). Here is a revised post. Hi, I am not sure if this has already been asked (I tried the search but the search was too broad). Basically I want to remove rows based on another file. So file1 looks like this (tab... (3 Replies)
Discussion started by: kylle345
3 Replies

4. Shell Programming and Scripting

Combining multiple rows in single row based on certain condition using awk or sed

Hi, I'm using AIX(ksh shell). > cat temp.txt "a","b",0 "c",bc",0 "a1","b1",0 "cc","cb",1 "cc","b2",1 "bb","bc",2 I want the output as: "a","b","c","bc","a1","b1" "cc","cb","cc","b2" "bb","bc" I want to combine multiple lines into single line where third column is same. Is... (1 Reply)
Discussion started by: samuelray
1 Replies

5. Shell Programming and Scripting

Selecting rows from a pipe delimited file based on condition

HI all, I have a simple challenge for you.. I have the following pipe delimited file 2345|98|1809||x|969|0 2345|98|0809||y|0|537 2345|97|9809||x|544|0 2345|97|0909||y|0|651 9685|98|7809||x|321|0 9685|98|7909||y|0|357 9685|98|7809||x|687|0 9685|98|0809||y|0|234 2315|98|0809||x|564|0 ... (2 Replies)
Discussion started by: nithins007
2 Replies

6. Shell Programming and Scripting

awk based script to ignore all columns from a file which contains character strings

Hello All, I have a .CSV file where I expect all numeric data in all the columns other than column headers. But sometimes I get the files (result of statistics computation by other persons) like below( sample data) SNO,Data1,Data2,Data3 1,2,3,4 2,3,4,SOME STRING 3,4,Inf,5 4,5,4,4 I... (9 Replies)
Discussion started by: ks_reddy
9 Replies

7. Shell Programming and Scripting

awk code to ignore the first occurence unknown number of rows in a data column

Hello experts, Shown below is the 2 column sample data(there are many data columns in actual input file), Key, Data A, 1 A, 2 A, 2 A, 3 A, 1 A, 1 A, 1 I need the below output. Key, Data A, 2 A, 2 A, 3 A, 1 A, 1 A, 1 (2 Replies)
Discussion started by: ks_reddy
2 Replies

8. Shell Programming and Scripting

Extracting rows and columns in a matrix based on condition

Hi I have a matrix with n rows and m columns like below example. i want to extract all the pairs with values <200. Input A B C D A 100 206 51 300 B 206 100 72 48 C 351 22 100 198 D 13 989 150 100 Output format A,A:200 A,C:51 B,B:100... (2 Replies)
Discussion started by: anurupa777
2 Replies

9. Shell Programming and Scripting

Convert rows to columns based on condition

I have a file some thing like this: GN Name=YWHAB; RC TISSUE=Keratinocyte; RC TISSUE=Thymus; CC -!- FUNCTION: Adapter protein implicated in the regulation of a large CC spectrum of both general and specialized signaling pathways GN Name=YWHAE; RC TISSUE=Liver; RC ... (13 Replies)
Discussion started by: raj_k
13 Replies

10. Shell Programming and Scripting

Combine multiple rows based on selected column keys

Hello I want to collapse a file with multiple rows into consolidated lines of entries based on selected columns as the 'key'. Example: 1 2 3 Abc def ghi 1 2 3 jkl mno p qrts 6 9 0 mno def Abc 7 8 4 Abc mno mno abc 7 8 9 mno mno abc 7 8 9 mno j k So if columns 1, 2 and 3 are... (6 Replies)
Discussion started by: linuxlearner123
6 Replies
PHOTON(1)																 PHOTON(1)

NAME
photon - generates photo albums SYNOPSIS
photon [OPTIONS] [PATH] DESCRIPTION
Photon generates clean, yet configurable, static HTML photo galleries. All of the work is done from the command line, and the resulting output can easily be configured by changing the template files found in /usr/share/photon/templates. To create a new template (skin), first create a new directory: mkdir -p ${HOME}/.photon/templates/my_theme/ Then copy the contents of /usr/share/photon/templates/photonv1/ to this new directory. Photon only needs three files to build pages: index.html used to display the content of a folder image.html used to display the page for an image movie.html used to display the page for a movie If a file is missing, then photon will throw an error and will not run. HOW TO BUILD A GALLERY
Quick start $ photon -o myoutputdir /photos Use the gimp plugin $ photon --resize-plugin=gimp -v -o myoutputdir /photos Change the size for all images and the thumbnail and keep the original photo $ photon --sizelist=0,1600x1200,800x600 --thumbsize=320x240 -o myoutputdir /photos Create a gallery from your custom template (skin) $ photon -k my_theme -o myoutputdir /photos See photon help $ photon --help OPTIONS
-a | --awstats Insert Javascript for Awstats --awstats-url=URL Change default value for Awstats script url -c NAME | --comment Name of the comment file (default .comments) -d NUM | --display-columns=NUM Number of columns in index (default 3) -E | --no-exif Don't include EXIF information in HTML file -f | --force Overwrite non-image generated files (html, javascript, etc) (default no) -ff | --force --force Overwrite image files (default no) -h | --help Print this help -I | --no-index Do not generate the high level index.html -J | --no-javascript Do not use javascript (no shortcuts, ... ) -k | --skin=THEME Skin selector (default photonv1) --print-skins Print out available skins (templates) -l NUM | --display-lines=NUM Number of lines in index (default 5) -m | --movie Movie mode, include link to movie (*.mov) -o NAME | --output-directory=NAME Name of the output directory -s LIST | --sizelist=LIST Image sizes (default 0,1024x768,800x600,640x480). Zero, which is the default, uses the original resolution. W x H specifies the width and height of the image in pixels. -t SIZE | --thumbsize=SIZE Size of thumbnails (default 160x120) -v | --verbose Verbosely print information -V | --version Print program version number -z | --compress Compress the original image if selected (default copy the image) --exif-bordercolor=COLOR Exif window border color (default #008000) --exif-bgcolor=COLOR Exif window background color (default #f0fff0) --exif-fgcolor=COLOR Exif window text color (default black) --body-bgcolor=COLOR Body background color (default #ccccff) --img-bgcolor=COLOR Image background color (default white) --exclude=PATTERN Exclude files matching PATTERN --resize-plugin=PLUG Where PLUG is the program used to create thumbnails internal: fastest method (default) gimp: use Gimp>1.x (better quality) --resize-quality-low=NUM Quality for small image. 0 (bad) and 100 (good) --resize-quality-high=NUM Quality for big image 0 (bad) and 100 (good) --gimp-program=PROG use PROG for gimp SHORTCUTS WHILE VIEWING AN IMAGE
n/SPACE Go to the next image (with the same resolution) p/BACKSPACE Go to the previous image (with the same resolution) s Start/Stop the slideshow +/- Increase/Decrease by one second the slideshow's period h Show shortcut and help i Show Exif information z Change to the higher resolution [NOT YET IMPLEMENTED] SEE ALSO
gimp(1) AUTHOR
Written by Luc Saillard, <luc@saillard.org> Main web site: http://www.saillard.org/programs_and_patches/photon/ This manual page was written by Kevin Coyner <kcoyner@debian.org> for the Debian project but may be used by others. 12/16/2006 PHOTON(1)
All times are GMT -4. The time now is 01:44 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy