Sponsored Content
Top Forums Shell Programming and Scripting Extract duplicate rows with conditions Post 302946337 by RudiC on Monday 8th of June 2015 11:15:34 AM
Old 06-08-2015
How about
Code:
sort -rnk1,1 -k3,3 file | awk 'X[$1] {print X[$1]}   {X[$1]=$0}'

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract duplicate fields in rows

I have a input file with formating: 6000000901 ;36200103 ;h3a01f496 ; 2000123605 ;36218982 ;heefa1328 ; 2000273132 ;36246985 ;h08c5cb71 ; 2000041207 ;36246985 ;heef75497 ; Each fields is seperated by semi-comma. Sometime, the second files is... (6 Replies)
Discussion started by: anhtt
6 Replies

2. Shell Programming and Scripting

extract lines based on few conditions

Hi, I need to extract lines based on some conditions as explained below: File format details: notes: 1. each set starts with AAA only 2. number of columns is fixed 3. number of rows per set may vary (as one set is upto DDD - 4 rows) Now, if any BBB's 5th column is blank then then... (4 Replies)
Discussion started by: prvnrk
4 Replies

3. Shell Programming and Scripting

How to extract duplicate rows

I have searched the internet for duplicate row extracting. All I have seen is extracting good rows or eliminating duplicate rows. How do I extract duplicate rows from a flat file in unix. I'm using Korn shell on HP Unix. For.eg. FlatFile.txt ======== 123:456:678 123:456:678 123:456:876... (5 Replies)
Discussion started by: bobbygsk
5 Replies

4. UNIX for Dummies Questions & Answers

How to get remove duplicate of a file based on many conditions

Hii Friends.. I have a huge set of data stored in a file.Which is as shown below a.dat: RAO 1869 12 19 0 0 0.00 17.9000 82.3000 10.0 0 0.00 0 3.70 0.00 0.00 0 0.00 3.70 4 NULL LEE 1870 4 11 1 0 0.00 30.0000 99.0000 0.0 0 0.00 0 0.00 0.00 0.00 0 ... (3 Replies)
Discussion started by: reva
3 Replies

5. Shell Programming and Scripting

How to extract duplicate rows

Hi! I have a file as below: line1 line2 line2 line3 line3 line3 line4 line4 line4 line4 I would like to extract duplicate lines (not unique, triplicate or quadruplicate lines). Output will be as below: line2 line2 I would appreciate if anyone can help. Thanks. (4 Replies)
Discussion started by: chromatin
4 Replies

6. Shell Programming and Scripting

Extract paragraphs under conditions

Hi all, I want to extract some paragraphs out of a file under certain conditions. - The paragraph must start with 'fmri' - The paragraph must contain the string 'restarter svc:/system/svc/restarter:default' My input is like that : fmri svc:/system/vxpbx:default state_time Wed... (4 Replies)
Discussion started by: Armoric
4 Replies

7. Shell Programming and Scripting

How to copy or cut specific rows from appended file with some conditions

Hi I have one file which is containing about 5000 rows and 20 columns I will just explain about my requirement here briefly with sample file, I have attached also, please help....me.. 1 28.25 36.42 5 28.26 36.42 10 28.23 36.43 15 28.22 36.43 20 28.2 36.42 25... (6 Replies)
Discussion started by: nex_asp
6 Replies

8. Shell Programming and Scripting

Extract and count number of Duplicate rows

Hi All, I need to extract duplicate rows from a file and write these bad records into another file. And need to have a count of these bad records. i have a command awk ' {s++} END { for(i in s) { if(s>1) { print i } } }' ${TMP_DUPE_RECS}>>${TMP_BAD_DATA_DUPE_RECS}... (5 Replies)
Discussion started by: Arun Mishra
5 Replies

9. Shell Programming and Scripting

Delete rows with conditions

Hi everyone, I will appreciate a lot if anyone can help me about a simple issue. I have a data file, and I need to remove some rows with a given condition. So here is a part of my data file: 5,14,1,3,3,0,0,-0.29977188269E+01 5,16,1,4,4,0,0,0.30394279900E+02... (4 Replies)
Discussion started by: hayreter
4 Replies

10. Shell Programming and Scripting

Extract and exclude rows based on duplicate values

Hello I have a file like this: > cat examplefile ghi|NN603762|eee mno|NN607265|ttt pqr|NN613879|yyy stu|NN615002|uuu jkl|NN607265|rrr vwx|NN615002|iii yzA|NN618555|ooo def|NN190486|www BCD|NN628717|ppp abc|NN190486|qqq EFG|NN628717|aaa HIJ|NN628717|sss > I can sort the file by... (5 Replies)
Discussion started by: CHoggarth
5 Replies
ROBOCUT(1)							   User Commands							ROBOCUT(1)

NAME
Robocut - is used with cutting plotters. DESCRIPTION
The `Robocut' program plots or cuts SVG files on a Craft Robo or Silhouette SD or most likely any other customer grade Graphtec cutting plotter. Usage: robocut [OPTIONS...] [File] Help Options: --help Show summary of options. --version Show version information and copyright details. --show Show all the parameters entered and the defaults. Application Options: -s, --no-sort Stop sort the objects from the SVG before plotting. -t, --bb-sort Sort the objects by bounding box, good for letters. This will cut out the inside first and than the outside. --cut Shows the cutting dialogue after start. --media INT Select the media. See drop down box. -g, --speed INT The speed between 1 and 33. -p, --pressure INT The pressure between 1 and 10. --track-enhancing Move three times back and forward to create a track. --margin-top DOUBLE Define the margin on top in mm. --margin-right DOUBLE Define the margin right in mm. Registration Mark Options: -r, --reg-mark-auto Use registration marks and find the marks automatically. --reg-mark Use registration marks but set the knife manually on top the round mark. -a, --reg-dimension-width DOUBLE Specify the length in mm between the the two horizontal marks. -b, --reg-dimension-height DOUBLE Specify the length in mm between the the two vertical marks. -c, --reg-origin-width DOUBLE Specify the length in mm between the the edge of the paper and the first horizontal mark. -d, --reg-origin-height DOUBLE Specify the length in mm between the the edge of the paper and the first vertical mark. Device Options: --usb-vendor-id INT Try this program with other usb hardware on your own risk. You need to convert hex to dec. --usb-product-id INT May also work with other hardware, try usb-devices program to scan your computer. ENVIRONMENT
QT SVG only supports the SVG 1.2 Tiny standard and this has a limited SVG support. For example multiline text is something that is no sup- ported by Robocut, however you can export your text to a path or just create each line separate. AUTHOR
Written by Tim Hutt and Markus Schulz <schulz@alpharesearch.de> REPORTING BUGS
Report bugs to https://bugs.launchpad.net/robocut/+filebug. COPYRIGHT
Copyright (C) 2010 This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICU- LAR PURPOSE. Robocut V1.0.8 August 2011 ROBOCUT(1)
All times are GMT -4. The time now is 12:51 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy