10-27-2006
delete string in a text file leaving the first occurrence
Hi,
How can i delete the second and subsequent occurrence of a particular string from a file ?
eg) test.txt
cattle
bat
battle
mat
matter
cattle
cattle
my output file should be
cattle
bat
battle
mat
matter
I am new to unix and your advice is greatly appreciated.
Thanks in advance,
gops
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have an input text that looks like this (comes already sorted):
on Caturday 22 at 10:15, some event
on Caturday 22 at 10:15, some other event
on Caturday 22 at 21:30, even more events
on Funday 23 at 11:00, yet another event
I need to delete all the matching words between the lines, from... (2 Replies)
Discussion started by: GrinningArmor
2 Replies
2. UNIX for Dummies Questions & Answers
Hello,
Merry Christmas to all! I wish you the best for these holidays and the best for the next year 2011.
I'd like your help please, I need to delete all the rows in the third column of my file, but without touching nor changing the first and last value position, this is an example of my... (2 Replies)
Discussion started by: Gery
2 Replies
3. UNIX for Dummies Questions & Answers
Hi,
I have a text file and I want to delete all rows that contain a particular string of characters. How do I go about doing that? Thanks! (9 Replies)
Discussion started by: evelibertine
9 Replies
4. UNIX for Advanced & Expert Users
Hi All,
I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space.
I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies
5. Shell Programming and Scripting
Hi All,
I have a small query. I have a file containing the following lines
File 1:
29-Jul-2011 GMT Static data requires update <Extraction should start here>
-----------
-----------
--------------------
-----------------------
----------- <should stop here>
Pattern1 will be time... (2 Replies)
Discussion started by: gangii87
2 Replies
6. Shell Programming and Scripting
Hi
I have requirement to find nth occurrence in a file and capture data from with in lines (between lines)
Data in File.
<QUOTE>
<SESSION>
<ATTRIBUTE NAME='Parameter Filename' VALUE='file1.parm'/>
<ATTRIBUTE NAME='Service Name' VALUE='None'/>
</SESSION>
<SESSION>
<ATTRIBUTE... (6 Replies)
Discussion started by: tmalik79
6 Replies
7. Shell Programming and Scripting
Hi,
I want to add a text to the end of the specific line in a file. Now my file looks like this:
999
111
222
333
111
444
I want to add the string " 555" to the end of the first line contaning 111. Moreover, I want to insert a newline after this line containg the "000" string. The... (8 Replies)
Discussion started by: wenclu
8 Replies
8. Shell Programming and Scripting
if there's a file containing:
money king money queen money cat money also money king
all those strings are on one line in the file.
how can i find out how many times "money king" shows up in the line?
egrep -c "money king" wont work. (7 Replies)
Discussion started by: SkySmart
7 Replies
9. Shell Programming and Scripting
Hi,
I would like to know how, using sed, be able to insert contents of file2 in file1 after say the second occurrence of a given string? e.g.
> cat file1
banana
apple
orange
apple
banana
pear
tangerine
apple
> cat file2
I don't like apples
What would be the sed command to insert... (5 Replies)
Discussion started by: dimocn
5 Replies
10. UNIX for Beginners Questions & Answers
Hi,
I have a file as follows.
file1
Hello
Hi
His
Hi
Hi
Hungry
hi
so I want to delete identical lines while leaving one of them undeleted.
So desired output will be
Hello
Hi (2 Replies)
Discussion started by: beginner_99
2 Replies
METADATA(1) User Commands METADATA(1)
NAME
MAT - Metadata Anonymisation Toolkit
SYNOPSIS
mat [options] files
mat-gui
DESCRIPTION
The Metadata Anonymisation Toolkit is a lib (with a CLI and a GUI) created to anonymise file's metadata. In essence, metadata answer who,
what, when, where, why, and how about every face of the data that are being documented. They can be a risk for privacy.
OPTIONS
-h, --help
show this help message and exit
-a, --add2archive
Add to outputed archive non-supported filetypes
-b, --backup
Keep a backup copy
-c, --check
Check if a file is free of harmful metadatas
-d, --display
List all the harmful meta of a file without removing them
-f, --force
Don't check if files are clean before cleaning
-l, --list
List all supported fileformat
-v, --version
Display version and exit
EXAMPLES
mat --display mydocument.pdf
Display the mydocument.pdf's harmful metadata
mat --check *.jpg
Check all the jpg images from the current folder
NOTES
MAT only process metadata, it does not handle file data. Blame yourself if you are traced back because of the data of your files. MAT is
not perfect : In most of the cases, a forensic expert with a lot of time can trace back your document. If you want absolute privacy, use
plain-text.
AUTHOR
Julien (jvoisin) Voisin <pouicpouicpouic@gmail.com>, during the GSoC 2011
BUGS
MAT does not handle watermaking/tattoo for now.
SEE ALSO
exiftool, hachoir-metadata
Metadata Anonymisation Toolkit August 2011 METADATA(1)