Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Delete duplicate row
Top Forums Shell Programming and Scripting Delete duplicate row Post 302932289 by RudiC on Tuesday 20th of January 2015 12:41:43 PM
Old 01-20-2015
Did you consider searching these fora, or even look at the link at the bottom of this page?
This User Gave Thanks to RudiC For This Post:
aav1307
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deleting all occurences of a duplicate row

Hi, I need to delete all occurences of the repeated lines from a file and retain only the lines that is not repeated elsewhere in the file. As seen below the first two lines are same except that for the string "From BaseLine" and "From SMS".I shouldn't consider the string "From SMS" and "From... (7 Replies)
Discussion started by: ragavhere
7 Replies

2. Shell Programming and Scripting

sort and semi-duplicate row - keep latest only

I have a pipe delimited file. Key is field 2, date is field 5 (as example, my real file is more complicated of course, but the KEY and DATE are accurate) There can be duplicate rows for a key with different dates. I need to keep only rows with latest date in this case. Example data: ... (4 Replies)
Discussion started by: LisaS
4 Replies

3. Shell Programming and Scripting

Delete a row that has a duplicate column

I'm trying to remove lines of data that contain duplicate data in a specific column. For example. apple 12345 apple 54321 apple 14234 orange 55656 orange 88989 orange 99898 I only want to see apple 12345 orange 55656 How would i go about doing this? (5 Replies)
Discussion started by: spartan22
5 Replies

4. Shell Programming and Scripting

how to identify duplicate columns in a row

Hi, How to identify duplicate columns in a row? Input data: may have 30 columns 9211480750 LK 120070417 920091030 9211480893 AZ 120070607 9205323621 O7 120090914 120090914 1420090914 2020090914 2020090914 9211479568 AZ 120070327 320090730 9211479571 MM 120070326 9211480892 MM 120070324... (3 Replies)
Discussion started by: suresh3566
3 Replies

5. Shell Programming and Scripting

Find and replace duplicate column values in a row

I have file which as 12 columns and values like this 1,2,3,4,5 a,b,c,d,e b,c,a,e,f a,b,e,a,h if you see the first column has duplicate values, I need to identify (print it to console) the duplicate value (which is 'a') and also remove duplicate values like below. I could be in two... (5 Replies)
Discussion started by: nuthalapati
5 Replies

6. Shell Programming and Scripting

duplicate row based on single column

I am a newbie to shell scripting .. I have a .csv file. It has 1000 some rows and about 7 columns... but before I insert this data to a table I have to parse it and clean it ..basing on the value of the first column..which a string of phone number type... example below.. column 1 ... (2 Replies)
Discussion started by: mitr
2 Replies

7. Shell Programming and Scripting

REMOVE DUPLICATE IN a ROW AFTER CHECKING THE FIRST SIMILAR NAME

Hi all I have a big file like this in rows and columns from 2 column onwards the next column is desciption of previous column means 3rd columns is description of 2 columns and 5 column is description of 4 column. All cloumns are separated by comma ... (1 Reply)
Discussion started by: manigrover
1 Replies

8. Shell Programming and Scripting

Need to print duplicate row along with highest version of original

There are some duplicate field on description column .I want to print duplicate row along with highest version of number and corresponding description column. file1.txt number Description === ============ 34567 nl21a00is-centerdb001:ncdbareq:Error in loading init 34577 ... (7 Replies)
Discussion started by: vijay_rajni
7 Replies

9. Shell Programming and Scripting

Delete duplicate row based on criteria

Hi, I have an input file as shown below: 20140102;13:30;FR-AUD-LIBOR-1W;2.495 20140103;13:30;FR-AUD-LIBOR-1W;2.475 20140106;13:30;FR-AUD-LIBOR-1W;2.495 20140107;13:30;FR-AUD-LIBOR-1W;2.475 20140108;13:30;FR-AUD-LIBOR-1W;2.475 20140109;13:30;FR-AUD-LIBOR-1W;2.475... (2 Replies)
Discussion started by: shash
2 Replies

10. Shell Programming and Scripting

Find duplicate values in specific column and delete all the duplicate values

Dear folks I have a map file of around 54K lines and some of the values in the second column have the same value and I want to find them and delete all of the same values. I looked over duplicate commands but my case is not to keep one of the duplicate values. I want to remove all of the same... (4 Replies)
Discussion started by: sajmar
4 Replies

LEARN ABOUT SUNOS

iconv_852

iconv_852(5)						Standards, Environments, and Macros					      iconv_852(5)

NAME

       iconv_852 - code set conversion tables for MS 852 (MS-DOS Latin 2)

DESCRIPTION

       The following code set conversions are supported:

       +--------------------------------------------------------------------+
       |		  Code Set Conversions Supported		    |
       +--------------+--------+--------------+--------+--------------------+
       |    Code      |Symbol  |Target Code   |Symbol  |   Target Output    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |ISO 8859-2    |iso2    | ISO Latin 2	    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |MS 1250       |win2    | Windows Latin 2    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |Mazovia       |maz     | Mazovia	    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |DHN	      |dhn     | Dom Handlowy Nauki |
       +--------------+--------+--------------+--------+--------------------+

CONVERSIONS

       The conversions are performed according to the following tables. All values in the tables are given in octal.

   MS 852 to ISO 8859-2
       For the conversion of MS 852 to ISO 8859-2, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |  ISO 8859-2	|    MS 852	 |  ISO 8859-2	 |
       |24-177	       | 40		|271-274	 |40		 |
       |200	       | 307		|275		 |257		 |
       |201	       | 374		|276		 |277		 |
       |202	       | 351		|277-305	 |40		 |
       |203	       | 342		|306		 |303		 |
       |204	       | 344		|307		 |343		 |
       |205	       | 371		|310-316	 |40		 |
       |206	       | 346		|317		 |244		 |
       |207	       | 347		|320		 |360		 |
       |210	       | 263		|321		 |320		 |
       |211	       | 353		|322		 |317		 |
       |212	       | 325		|323		 |313		 |
       |213	       | 365		|324		 |357		 |
       |214	       | 356		|325		 |322		 |
       |215	       | 254		|326		 |315		 |
       |216	       | 304		|327		 |316		 |
       |217	       | 306		|330		 |354		 |
       |220	       | 311		|331-334	 |40		 |
       |221	       | 305		|335		 |336		 |
       |222	       | 345		|336		 |331		 |
       |223	       | 364		|337		 |40		 |
       |224	       | 366		|340		 |323		 |
       |225	       | 245		|341		 |337		 |
       |226	       | 265		|342		 |324		 |
       |227	       | 246		|343		 |321		 |
       |230	       | 266		|344		 |361		 |
       |231	       | 326		|345		 |362		 |
       |232	       | 334		|346		 |251		 |
       |233	       | 253		|347		 |271		 |
       |234	       | 273		|350		 |300		 |
       |235	       | 243		|351		 |332		 |
       |236	       | 327		|352		 |340		 |
       |237	       | 350		|353		 |333		 |
       |240	       | 341		|354		 |375		 |
       |241	       | 355		|355		 |335		 |
       |242	       | 363		|356		 |376		 |
       |243	       | 372		|357		 |264		 |
       |244	       | 241		|360		 |255		 |
       |245	       | 261		|361		 |275		 |
       |246	       | 256		|362		 |262		 |
       |247	       | 276		|363		 |267		 |
       |250	       | 312		|364		 |242		 |
       |251	       | 352		|365		 |247		 |
       |252	       | 40		|366		 |367		 |
       |253	       | 274		|367		 |270		 |
       |254	       | 310		|370		 |260		 |
       |255	       | 272		|371		 |250		 |
       |256-264        | 40		|372		 |377		 |
       |265	       | 301		|374		 |330		 |
       |266	       | 302		|375		 |370		 |
       |267	       | 314		|376		 |40		 |
       |270	       | 252		|		 |		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to MS 1250
       For the conversion of MS 852 to MS 1250, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |    MS 1250	|    MS 852	 |   MS 1250	 |
       |200	       | 307		|270		 |252		 |
       |201	       | 374		|271-274	 |40		 |
       |202	       | 351		|275		 |257		 |
       |203	       | 342		|276		 |277		 |
       |204	       | 344		|277-305	 |40		 |
       |205	       | 371		|306		 |303		 |
       |206	       | 346		|307		 |343		 |
       |207	       | 347		|310-316	 |40		 |
       |210	       | 263		|317		 |244		 |
       |211	       | 353		|320		 |360		 |
       |212	       | 325		|321		 |320		 |
       |213	       | 365		|322		 |317		 |
       |214	       | 356		|323		 |313		 |
       |215	       | 217		|324		 |357		 |
       |216	       | 304		|325		 |322		 |
       |217	       | 306		|326		 |315		 |
       |220	       | 311		|327		 |316		 |
       |221	       | 305		|330		 |354		 |
       |222	       | 345		|331-334	 |40		 |
       |223	       | 364		|335		 |336		 |
       |224	       | 366		|336		 |331		 |
       |225	       | 274		|337		 |40		 |
       |226	       | 276		|340		 |323		 |
       |227	       | 214		|341		 |337		 |
       |230	       | 234		|342		 |324		 |
       |231	       | 326		|343		 |321		 |
       |232	       | 334		|344		 |361		 |
       |233	       | 215		|345		 |362		 |
       |234	       | 235		|346		 |212		 |
       |235	       | 243		|347		 |232		 |
       |236	       | 327		|350		 |300		 |
       |237	       | 350		|351		 |332		 |
       |240	       | 341		|352		 |340		 |
       |241	       | 355		|353		 |333		 |
       |242	       | 363		|354		 |375		 |
       |243	       | 372		|355		 |335		 |
       |244	       | 245		|356		 |376		 |
       |245	       | 271		|357		 |264		 |
       |246	       | 216		|360		 |255		 |
       |247	       | 236		|361		 |275		 |
       |250	       | 312		|362		 |262		 |
       |251	       | 352		|363		 |241		 |
       |252	       | 254		|364		 |242		 |
       |253	       | 237		|365		 |247		 |
       |254	       | 310		|366		 |367		 |
       |255	       | 272		|367		 |270		 |
       |256	       | 253		|370		 |260		 |
       |257	       | 273		|371		 |250		 |
       |260-264        | 40		|372		 |377		 |
       |265	       | 301		|374		 |330		 |
       |266	       | 302		|375		 |370		 |
       |267	       | 314		|376		 |40		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to Mazovia
       For the conversion of MS 852 to Mazovia, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |    Mazovia	|    MS 852	 |   Mazovia	 |
       |205	       | 40		|246-247	 |40		 |
       |206	       | 215		|250		 |220		 |
       |210	       | 222		|251		 |221		 |
       |212-213        | 40		|253		 |246		 |
       |215	       | 240		|254-270	 |40		 |
       |217	       | 225		|275		 |241		 |
       |220-226        | 40		|276		 |247		 |
       |227	       | 230		|306-336	 |40		 |
       |230	       | 236		|340		 |243		 |
       |233-234        | 40		|342		 |40		 |
       |235	       | 234		|343		 |245		 |
       |236-243        | 40		|344		 |244		 |
       |244	       | 217		|345-375	 |40		 |
       |245	       | 206		|		 |		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to DHN
       For the conversion of MS 852 to DHN, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |      DHN	|    MS 852	 |     DHN	 |
       |200-205        | 40		|244		 |200		 |
       |206	       | 212		|245		 |211		 |
       |207	       | 40		|246-247	 |40		 |
       |210	       | 214		|250		 |202		 |
       |211-214        | 40		|251		 |213		 |
       |215	       | 207		|253		 |220		 |
       |216	       | 40		|254-270	 |40		 |
       |217	       | 201		|275		 |210		 |
       |220-226        | 40		|276		 |221		 |
       |227	       | 206		|306-336	 |40		 |
       |230	       | 217		|340		 |205		 |
       |233-234        | 40		|342		 |40		 |
       |235	       | 203		|343		 |204		 |
       |236-237        | 40		|344		 |215		 |
       |242	       | 216		|345-375	 |40		 |
       |252	       | 254		|		 |		 |
       +---------------+----------------+----------------+---------------+

FILES

       /usr/lib/iconv/*.so	       conversion modules

       /usr/lib/iconv/*.t	       conversion tables

       /usr/lib/iconv/iconv_data       list of conversions supported by conversion tables

SEE ALSO

       iconv(1), iconv(3C), iconv(5)

SunOS 5.10							    18 Apr 1997 						      iconv_852(5)
All times are GMT -4. The time now is 04:38 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy