10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
I need some help to remove duplicates from a file before merging.
I have got 2 files:
file1 has data in format
4300 23456
4301 2357
the 4 byte values on the right hand side is uniq, and are not repeated anywhere in the file
file 2 has data in same format but is not in... (10 Replies)
Discussion started by: roy121
10 Replies
2. Shell Programming and Scripting
Hi,
I have a file (sorted by sort) with 8 tab delimited columns. The first column contains duplicated fields and I need to merge all these identical lines.
My input file:
comp100002 aaa bbb ccc ddd eee fff ggg
comp100003 aba aba aba aba aba aba aba
comp100003 fff fff fff fff fff fff fff... (5 Replies)
Discussion started by: falcox
5 Replies
3. Shell Programming and Scripting
Hello,
I have few file such as below:
abc.txt
def.txt
ghi.txt
jkl.txt
n.txt
I would like to merge all these files together into one file. At the same time, any duplicates will be removed. (5 Replies)
Discussion started by: alegnagrp
5 Replies
4. Shell Programming and Scripting
Hi,
My requirement is,there is a directory location like:
:camp/current/
In this location there can be different flat files that are generated in a single day with same header and the data will be different, differentiated by timestamp, so i need to verify how many files are generated... (10 Replies)
Discussion started by: srikanth_sagi
10 Replies
5. UNIX for Dummies Questions & Answers
I have a file called FILE
cat FILE
11/11/2012
11/11/2012
12/11/2012
15/11/2012
need to remove the duplicates dates ( ie 11/11/2012 is present two times i need remove one duplicates date )
Need outputs like this
11/11/2012
12/11/2012
15/11/2012
I have tried using awk... (8 Replies)
Discussion started by: Venkatesh1
8 Replies
6. UNIX for Advanced & Expert Users
Hi Guys ,
we have one directory ...in that directory all files will be set on each day..
files must have header ,contents ,footer..
i wants to compare the header,contents,footer ..if its same means display an error message as 'files contents same' (7 Replies)
Discussion started by: Venkatesh1
7 Replies
7. Shell Programming and Scripting
Hi all ,
am using unix aix ..
how to check the duplicates files contents and moving to someother folders
ex ..
i have files called qqq
cat qqq
1
2
3
i have another file qqq02
cat qqq02
1
2
3
here qqq02 has having same contents as qqq file..
i need to check the duplicates files... (1 Reply)
Discussion started by: Venkatesh1
1 Replies
8. Shell Programming and Scripting
Hi..
File 1:
1 aa rep
1 dd rep
1 kk rep
2 bb sad
2 ss sad
3 ee dam
File 2
1 apple fruit
2 mango tree
3 lilly flower
output:
1 aaple fruit aa,dd,kk rep (7 Replies)
Discussion started by: empyrean
7 Replies
9. Shell Programming and Scripting
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr (2 Replies)
Discussion started by: shashi1982
2 Replies
10. Shell Programming and Scripting
I need to compare 2 diff type of files and find out the duplicate after comparing each types of files:
Type 1 file name is like: file1.abc
(the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations).
The other file is file1.bcd01abc (the extension... (2 Replies)
Discussion started by: ricky007
2 Replies