removing duplicate lines while maintaing coherence with second file
So I have two files. The first file, file1.txt, has lines of numbers separated by commas.
file1.txt
The second file, file2.txt, has sentences.
file2.txt
What I would like to do is remove the duplicate lines from file1.txt, the file with the numbers, but at the same time remove the equivalent line from file2.txt.
In other words: If line 5 from file1.txt is removed because it is a duplicate, then line 5 from file2.txt should also be removed.
I know that
will work for removing duplicates, but it does not provide coherence with file2.txt.
thanks for the help in advance
Last edited by Scott; 08-09-2011 at 03:48 PM..
Reason: Added code tags to file[12].txt
Hi,
I am trying to remove duplicate lines from a file. For example the contents of example.txt is:
this is a test
2342
this is a test
34343
this is a test
43434
and i want to remove the "this is a test" lines only and end up with the numbers in the file, that is, end up with:
2342... (4 Replies)
Hi,
I need to concatenate three files in to one destination file.In this if some duplicate data occurs it should be deleted.
eg:
file1:
-----
data1 value1
data2 value2
data3 value3
file2:
-----
data1 value1
data4 value4
data5 value5
file3:
-----
data1 value1
data4 value4 (3 Replies)
Hello,
I am in need of removing duplicate lines from within a file per section.
File:
ABC1 012345 header
ABC2 7890-000
ABC3 012345 Header Table
ABC4
ABC5 593.0000 587.4800
ABC5 593.5000 587.6580 <= dup need to remove
ABC5 593.5000 ... (5 Replies)
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
You will write a script that will remove all HTML tags from an HTML document and remove any consecutive... (3 Replies)
Hi,
I have tried to remove dublicate lines based on first column with pipe delimiter . but i ma not able to get some uniqu lines
Command : sort -t'|' -nuk1 file.txt
Input :
38376KZ|09/25/15|1.057
38376KZ|09/25/15|1.057
02006YB|09/25/15|0.859
12593PS|09/25/15|2.803... (2 Replies)
Discussion started by: parithi06
2 Replies
LEARN ABOUT HPUX
diff3
diff3(1) General Commands Manual diff3(1)NAME
diff3 - 3-way differential file comparison
SYNOPSIS
file1 file2 file3
DESCRIPTION
compares three versions of a file, and prints disagreeing ranges of text flagged with these codes:
all three files differ
file1 is different
file2 is different
file3 is different
The type of change required to convert a given range of a given file to some other is indicated in one of these ways:
Text is to be appended after line number
n1 in file f, where f = or
Text is to be changed in the range line
n1 through line n2. If n1 = n2, the range can be abbreviated to n1.
The original contents of the range follows immediately after a indication. When the contents of two files are identical, the contents of
the lower-numbered file is suppressed.
Produces a script for the
editor that can be used to incorporate into file1 all changes between file2 and file3 (see ed(1)); i.e., the changes that
normally would be flagged and
Produces a script to incorporate only changes flagged
Produces a script to incorporate only changes flagged
Produces a script that will incorporate all
changes between file2 and file3, but treat overlapping changes (that is, changes that would be flagged with in normal
listing) differently. The overlapping lines in both files will be inserted by the edit script bracketed by and lines.
Produces a script that will incorporate only changes flagged
, but treat these changes in the manner of option.
The following command applies the resulting script to file1.
EXTERNAL INFLUENCES
International Code Set Support
Single- and multi-byte character code sets are supported.
WARNINGS
Text lines that consist of a single period defeat
Files longer than 64K bytes do not work.
FILES SEE ALSO diff(1).
diff3(1)