Sponsored Content
Top Forums Shell Programming and Scripting Removing Duplicate Variables : SED? Post 302564984 by Blue Solo on Saturday 15th of October 2011 09:03:56 PM
Old 10-15-2011
Quote:
Originally Posted by binlib
According to your original post, this may be what you wanted:
Code:
Code

By the way, the files you attached were DOS files. You may need to convert them into Unix files.
Oh wow, thanks! The tip about the DOS to Unix was great.
So that deleted all the duplicates, but it did not rename the duplicates in the step2 to their kept duplicate.

Thanks so far!

Last edited by Blue Solo; 10-16-2011 at 12:43 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Removing duplicate lines ignore case

hi, I have the following input in file: abc ab a AB b c a C B When I use uniq -u file,the out put file is: abc ab AB c v B C (17 Replies)
Discussion started by: hellsd
17 Replies

2. UNIX for Dummies Questions & Answers

removing duplicate lines from a file

Hi, I am trying to remove duplicate lines from a file. For example the contents of example.txt is: this is a test 2342 this is a test 34343 this is a test 43434 and i want to remove the "this is a test" lines only and end up with the numbers in the file, that is, end up with: 2342... (4 Replies)
Discussion started by: ocelot
4 Replies

3. Shell Programming and Scripting

removing duplicate blank lines

Hi, how to remove the blank lines from the file only If we have more than one blank line. thanks rameez (8 Replies)
Discussion started by: rameezrajas
8 Replies

4. Shell Programming and Scripting

removing the duplicate lines in a file

Hi, I need to concatenate three files in to one destination file.In this if some duplicate data occurs it should be deleted. eg: file1: ----- data1 value1 data2 value2 data3 value3 file2: ----- data1 value1 data4 value4 data5 value5 file3: ----- data1 value1 data4 value4 (3 Replies)
Discussion started by: Sharmila_P
3 Replies

5. Shell Programming and Scripting

Removing Duplicate Lines per Section

Hello, I am in need of removing duplicate lines from within a file per section. File: ABC1 012345 header ABC2 7890-000 ABC3 012345 Header Table ABC4 ABC5 593.0000 587.4800 ABC5 593.5000 587.6580 <= dup need to remove ABC5 593.5000 ... (5 Replies)
Discussion started by: petersf
5 Replies

6. Shell Programming and Scripting

Removing duplicate records from 2 files

Can anyone help me to removing duplicate records from 2 separate files in UNIX? Please find the sample records for both the files cat Monday.dat 3FAHP0JA1AR319226MOHMED ATEK 966504453742 SAU2010DE 3LNHL2GC6AR636361HEA DEUK CHOI 821057314531 KOR2010LE 3MEHM0JG7AR652083MUTLAB NAL-NAFISAH... (4 Replies)
Discussion started by: zooby
4 Replies

7. Post Here to Contact Site Administrators and Moderators

Removing or Merging some duplicate threads

I have made some threads that were identical and were about the same question :( I've made them in 3 forums , the moderator has moved and merged one of these threads. There is one thread left and it need to be merged or deleted. Is there any way I can delete it or merge it myself ? I have delete... (1 Reply)
Discussion started by: k.a.docpp
1 Replies

8. Shell Programming and Scripting

Removing duplicate terms in a file

Hi everybody I have a .txt file that contains some assembly code for optimizing it i need to remove some replicated parts. for example I have:e_li r0,-1 e_li r25,-1 e_lis r25,0000 add r31, r31 ,r0 e_li r28,-1 e_lis r28,0000 add r31, r31 ,r0 e_li r28,-1 ... (3 Replies)
Discussion started by: Behrouzx77
3 Replies

9. Shell Programming and Scripting

Removing Duplicate Rows in a file

Hello I have a file with contents like this... Part1 Field2 Field3 Field4 (line1) Part2 Field2 Field3 Field4 (line2) Part3 Field2 Field3 Field4 (line3) Part1 Field2 Field3 Field4 (line4) Part4 Field2 Field3 Field4 (line5) Part5 Field2 Field3 Field4 (line6) Part2 Field2 Field3 Field4... (7 Replies)
Discussion started by: ekbaazigar
7 Replies

10. Shell Programming and Scripting

Removing duplicate items from an array

Hello Experts, I am trying to write a shell script to find duplicate items in an array, this is what i have tried : #!/bin/bash echo "This is another sample Progg to remove duplicate items from an array" echo "How many number do you want to insert" read n for (( i=0; i<$n; i++ )) do ... (5 Replies)
Discussion started by: mukulverma2408
5 Replies
mcopy(1)						      General Commands Manual							  mcopy(1)

Name
       mcopy - copy MSDOS files to/from Unix

Note of warning
       This  manpage  has been automatically generated from mtools's texinfo documentation, and may not be entirely accurate or complete.  See the
       end of this man page for details.

Description
       The mcopy command is used to copy MS-DOS files to and from Unix. It uses the following syntax:

	  mcopy [-bspanvmQT] [-D clash_option] sourcefile targetfile
	  mcopy [-bspanvmQT] [-D clash_option] sourcefile [ sourcefiles... ] targetdirectory
	  mcopy [-tnvm] MSDOSsourcefile

       Mcopy copies the specified file to the named file, or copies multiple files to the named directory.  The source and target  can	be  either
       MS-DOS or Unix files.

       The  use  of  a	drive letter designation on the MS-DOS files, 'a:' for example, determines the direction of the transfer.  A missing drive
       designation implies a Unix file whose path starts in the current directory.  If a source drive letter is specified with	no  attached  file
       name (e.g. mcopy a: .), all files are copied from that drive.

       If  only  a  single, MS-DOS source parameter is provided (e.g. "mcopy a:foo.exe"), an implied destination of the current directory (`.') is
       assumed.

       A filename of `-' means standard input or standard output, depending on its position on the command line.

       Mcopy accepts the following command line options:

       t      Text file transfer.  Mcopy translates incoming carriage return/line feeds to line feeds when copying from MS-DOS to Unix, and  vice-
	      versa when copying from Unix to MS-DOS.

       b      Batch mode. Optimized for huge recursive copies, but less secure if a crash happens during the copy.

       s      Recursive copy.  Also copies directories and their contents

       p      Preserves the attributes of the copied files

       Q      When mcopying multiple files, quits as soon as one copy fails (for example due to lacking storage space on the target disk)

       a      Text (ASCII) file transfer.  ASCII translates incoming carriage return/line feeds to line feeds.

       T      Text  (ASCII) file transfer with character set conversion.  Differs from -a in the ASCII also translates incoming PC-8 characters to
	      ISO-8859-1 equivalents as far as possible.  When reading DOS files, untranslatable characters are replaced by '#'; when writing  DOS
	      files, untranslatable characters are replaced by '.'.

       n      No confirmation when overwriting Unix files.  ASCII doesn't warn the user when overwriting an existing Unix file. If the target file
	      already exists, and the -n option is not in effect, mcopy asks whether to overwrite the file  or	to  rename  the  new  file  (`name
	      clashes') for details).  In order to switch off confirmation for DOS files, use -o.

       m      Preserve the file modification time.

       v      Verbose. Displays the name of each file as it is copied.

Bugs
       Unlike MS-DOS, the '+' operator (append) from MS-DOS is not supported. However, you may use mtype to produce the same effect:

	  mtype a:file1 a:file2 a:file3 >unixfile
	  mtype a:file1 a:file2 a:file3 | mcopy - a:msdosfile

See Also
       Mtools' texinfo doc

Viewing the texi doc
       This  manpage  has  been automatically generated from mtools's texinfo documentation. However, this process is only approximative, and some
       items, such as crossreferences, footnotes and indices are lost in this translation process.  Indeed, these items have no appropriate repre-
       sentation  in  the manpage format.  Moreover, not all information has been translated into the manpage version.	Thus I strongly advise you
       to use the original texinfo doc.  See the end of this manpage for instructions how to view the texinfo doc.

       *      To generate a printable copy from the texinfo doc, run the following commands:

		     ./configure; make dvi; dvips mtools.dvi

       *      To generate a html copy,	run:

		     ./configure; make html

       A premade html can be found at `http://www.gnu.org/software/mtools/manual/mtools.html'

       *      To generate an info copy (browsable using emacs' info mode), run:

		     ./configure; make info

       The texinfo doc looks most pretty when printed or as html.  Indeed, in the info version certain examples are difficult to read due  to  the
       quoting conventions used in info.

mtools-4.0.18							      09Jan13								  mcopy(1)
All times are GMT -4. The time now is 01:17 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy