I have a text file with three columns. I would like a simple script that removes lines in which column 1 has duplicate entries, but use the largest value in column 3 to decide which one to keep. For example:
Can some one provide me a shell script.
I have file with many columns and many rows. need to sort the first column and then remove the duplicates records if exists.. finally print the full data with first coulm as unique.
Sort BASED ON FIRST FIELD and remove the duplicates if exists... (2 Replies)
Hi,
How to output the duplicate record to another file. We say the record is duplicate based on a column whose position is from 2 and its length is 11 characters.
The file is a fixed width file.
ex of Record:
DTYU12333567opert tjhi kkklTRG9012
The data in bold is the key on which... (1 Reply)
Hi All,
I needs to fetch unique records based on a keycolumn(ie., first column1) and also I needs to get the records which are having max value on column2 in sorted manner... and duplicates have to store in another output file.
Input :
Input.txt
1234,0,x
1234,1,y
5678,10,z
9999,10,k... (7 Replies)
Hi,
I am unable to search the duplicates in a file based on the 1st,2nd,4th,5th columns in a file and also remove the duplicates in the same file.
Source filename: Filename.csv
"1","ccc","information","5000","temp","concept","new"
"1","ddd","information","6000","temp","concept","new"... (2 Replies)
Hello,
I am new to shell scripting. I have a huge file with multiple columns for example:
I have 5 columns below.
HWUSI-EAS000_29:1:105 + chr5 76654650 AATTGGAA HHHHG
HWUSI-EAS000_29:1:106 + chr5 76654650 AATTGGAA B@HYL
HWUSI-EAS000_29:1:108 + ... (4 Replies)
Hi Folks -
I'm quite new to awk and didn't come across such issues before. The problem statement is that, I've a file with duplicate records in 3rd and 4th fields. The sample is as below:
aaaaaa|a12|45|56
abbbbaaa|a12|45|56
bbaabb|b1|51|45
bbbbbabbb|b2|51|45
aaabbbaaaa|a11|45|56
... (3 Replies)
Hi
Description of input file I have:
-------------------------
1) CSV with double quotes for string fields.
2) Some string fields have Comma as part of field value.
3) Have Duplicate lines
4) Have 200 columns/fields
5) File size is more than 10GB
Description of output file I need:... (4 Replies)
Hi,
I have a file with fields like below:
A;XYZ;102345;222
B;XYZ;123243;333
C;ABC;234234;444
D;MNO;103345;222
E;DEF;124243;333
desired output:
C;ABC;234234;444
D;MNO;103345;222
E;DEF;124243;333
ie, if the 4rth field is a duplicate.. i need only those records where... (5 Replies)
I am trying to see if I can use awk to remove duplicates from a file. This is the file:
-==> Listvol <==
deleting /vol/eng_rmd_0941
deleting /vol/eng_rmd_0943
deleting /vol/eng_rmd_0943
deleting /vol/eng_rmd_1006
deleting /vol/eng_rmd_1012
rearrange /vol/eng_rmd_0943
... (6 Replies)
I have /tmp dir with filename as:
010020001_S-FOR-Sort-SYEXC_20160229_2212101.marker
010020001_S-FOR-Sort-SYEXC_20160229_2212102.marker
010020001-S-XOR-Sort-SYEXC_20160229_2212104.marker
010020001-S-XOR-Sort-SYEXC_20160229_2212105.marker
010020001_S-ZOR-Sort-SYEXC_20160229_2212106.marker... (4 Replies)
Discussion started by: gnnsprapa
4 Replies
LEARN ABOUT DEBIAN
gipddecode
gipddecode(1) General Commands Manual gipddecode(1)NAME
gipddecode - Decode a GIPD stream into human readable form.
SYNOPSIS
gipddecode [options] <gipd-file
DESCRIPTION
gipddecode decodes a Granite Image Printer Driver (GIPD) stream into human readable form. Granite Systems was acquired by Monotype Imag-
ing.
A GIPD stream is the printer langauge used by the Lexmark X500 and the Dell 1125 MFP printers.
COMMAND LINE OPTIONS
These are the options that can appear on the command line.
-d basename
Basename of .pbm file for saving decompressed planes.
-h Print hex file offsets.
-o Print file offsets.
-D level
Set Debug level [0].
EXAMPLES
Decode an GIPD stream file.
$ gipddecode -h x500-mono.prn
0: OFST 0 len=128
80: OFST 1 len=128
100: OFST 2 len=128
180: OFST 3 len=128
200: OFST 4 len=128
[SNIP]
27d80: OFST 1275 len=128
27e00: 33%-12345X@PJL SET DISPINFOWHILEPRINT=OFF
27e2a: @PJL SET DISPATPAPERCHANG=OFF
27e49: @PJL SET JAMRECOVERY=ON
27e62: @PJL SET OUTPUTBLANKPAPER=OFF
27e81: @PJL SET PRINTSLOWLY=OFF
27e9b: @PJL SET REVERSEPRINT=OFF
27eb6: 33%-12345X
27ebf: GDIJ len=108
unk0=0, unk1=0, unk2=0, unk3=0, unk4=0
unk5=16777221(0x1000005), unk6=0, unk7=0, unk8=0, paper=0
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
27f37: GDIP len=52
nplane = 1, w254 = 4896, h254 = 6110
132018de, 0, 0, 0, 0, 1000000, 0, 0, 0, 0, 0, 0, 0,
27f77: GDIB 0 len=60(0x3c)
27fcb: GDIB 1 len=252(0xfc)
280df: GDIB 2 len=124(0x7c)
28173: GDIB 3 len=956(0x3bc)
28547: GDIB 4 len=1692(0x69c)
28bfb: GDIB 5 len=572(0x23c)
28e4f: GDIB 6 len=17084(0x42bc)
2d123: GDIB 7 len=18108(0x46bc)
317f7: GDIB 8 len=8508(0x213c)
3394b: GDIB 9 len=1756(0x6dc)
3403f: GDIB 10 len=1596(0x63c)
34693: GDIB 11 len=892(0x37c)
34a27: GDIB 12 len=2332(0x91c)
3535b: GDIB 13 len=8380(0x20bc)
3742f: GDIB 14 len=3452(0xd7c)
381c3: GDIB 15 len=60(0x3c)
38217: GDIB 16 len=1468(0x5bc)
387eb: GDIB 17 len=2076(0x81c)
3901f: GDIB 18 len=284(0x11c)
39153: GDIB 19 len=1660(0x67c)
397e7: GDIB 20 len=2908(0xb5c)
3a35b: GDIB 21 len=156(0x9c)
3a40f: GDIB 22 len=188(0xbc)
3a4e3: GDIB 23 len=220(0xdc)
3a5d7: GDIB 24 len=60(0x3c)
3a62b: PIDG
3a637: JIDG
Total Size = 75843(0x12843)FILES
/usr/bin/gipddecode
AUTHOR
Rick Richardson <rick.richardson@comcast.net>