Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Removing Lines From a File

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing Lines From a File
# 1  
Old 05-20-2010
Removing Lines From a File
Hi

Does anybody know of a command that will enable me to remove all entries in a file that have the format (name & time)

Code:
 
more testfile
anthony 2003
anthonyr 2008
amorel 15:00
anthonyp 14:35
anthonyp 14:35
anthonyr 2008
ardean 13:28
arlene 2003
arlenem 08:15
arlenem 08:15
ashley 2006
barbarae 2007
bart 2006

I only want the file to contain name and date

Code:
 
more testfile
anthony 2003
anthonyr 2008
anthonyr 2008
arlene 2003
ashley 2006
barbarae 2007
bart 2006

Also is it possible to remove duplicate entries ie
anthonyr 2008
anthonyr 2008

Thanks in advance
# 2  
Old 05-20-2010
You should show us what have you tried so far.

Is " : " the differentiating character for date and time, then
Code:
grep -v ":" inputfile

# 3  
Old 05-20-2010
Thanks for the prompt reply...
Code:
grep -v ":"

gets me the result I was looking for.
# 4  
Old 05-20-2010
For removing duplicate entry

Code:
grep -v ":" filename | sort | uniq

# 5  
Old 05-20-2010
Quote:
Originally Posted by jamba1
Hi

Does anybody know of a command that will enable me to remove all entries in a file that have the format (name & time)

I only want the file to contain name and date

Code:
 
more testfile
anthony 2003
anthonyr 2008
anthonyr 2008
arlene 2003
ashley 2006
barbarae 2007
bart 2006

Also is it possible to remove duplicate entries ie
anthonyr 2008
anthonyr 2008

Thanks in advance
If you want to remove all duplicate lines

Code:
# grep -v : file | uniq -u
more testfile
anthony 2003
arlene 2003
ashley 2006
barbarae 2007
bart 2006

# 6  
Old 05-20-2010
Quote:
Originally Posted by ygemici
If you want to remove all duplicate lines

Code:
# grep -v : file | uniq -u
more testfile
anthony 2003
arlene 2003
ashley 2006
barbarae 2007
bart 2006

Or:
Code:
awk '/:/{next}!a[$0]++' file

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing lines from a file

I have a file `/tmp/wrk` containing filenames with paths. I want to remove filenames from this file, for example remove all filenames containing alja cagr cavt clta cmdo or corl remove all filenames containing data for days in region `d.2016.001` to `d.2016.207` remove all filenames... (10 Replies)
Discussion started by: kristinu
10 Replies

2. Shell Programming and Scripting

Removing multiple lines from input file, if multiple lines match a pattern.

GM, I have an issue at work, which requires a simple solution. But, after multiple attempts, I have not been able to hit on the code needed. I am assuming that sed, awk or even perl could do what I need. I have an application that adds extra blank page feeds, for multiple reports, when... (7 Replies)
Discussion started by: jxfish2
7 Replies

3. Shell Programming and Scripting

Removing lines from a file

Hi, I have a linux server that was hacked and I have a bunch of files that sporadically contain the following lines through out the file: <?php eval(base64_decode("Xxxxxxxxxxxxxx/xxxxxxxx")); I did't put the exact lines of the file in this post. The "Xxxx" are random letters/numbers.... (8 Replies)
Discussion started by: nck
8 Replies

4. UNIX for Dummies Questions & Answers

removing several lines from a file

Hi folks, I have a long string of DNA sequences, and I need to remove several lines, as well as the line directly following them. For example, here is a sample of my starting material: >548::GY31UMJ02DLYEH rank=0007170 x=1363.5 y=471.0 length=478... (1 Reply)
Discussion started by: kkohl78
1 Replies

5. Shell Programming and Scripting

removing lines from file

Hi I have many files all with 1 field per line as in 12345 abcde john.paul.net 6789101 how do I remove ceratin lines from these files. Have tried sed but sed wrecks my head! Many thanks in advance for any help (9 Replies)
Discussion started by: rob171171
9 Replies

6. Shell Programming and Scripting

Removing the first and last lines in a file

Hi Gurus, I'm a little new to UNIX. How can I do remove the first and last line in a file? Say, supppose I have a file as below: Code: 1DMA 400002BARRIE 401002CALGARY/LETHBRI 402002CARLETON 500001PORTLAND-AUBRN 501001NEW YORK, NY 502001BINGHAMTON, NY ... (2 Replies)
Discussion started by: naveendronavall
2 Replies

7. AIX

Removing the first and last lines in a file

Hi Gurus, I'm a little new to UNIX. How can I do remove the first and last line in a file? Say, supppose I have a file as below: 1DMA 400002BARRIE 401002CALGARY/LETHBRI 402002CARLETON 500001PORTLAND-AUBRN 501001NEW YORK, NY ... (1 Reply)
Discussion started by: naveendronavall
1 Replies

8. UNIX for Dummies Questions & Answers

Removing lines from a file

I'm trying to find a command which will allow me to remove a range of lines (2-4) from a .dat file from the command line without opening the file. Someone mentioned using the ex command? Does anyone have any ideas? thanks (6 Replies)
Discussion started by: computersaysno
6 Replies

9. Shell Programming and Scripting

Removing lines within a file

Hi There, I've written a script that processes a data file on our system. Basically the script reads a post code from a list file, looks in the data file for the first occurrence (using grep) and reads the line number. It then tails the data file, with the line number just read, and outputs to a... (3 Replies)
Discussion started by: tookers
3 Replies

10. Shell Programming and Scripting

Removing lines from a file

Hello i have 2 files file1 and file2 as shown below file1 110010000000206|567810008161509 110010000000207|567810072227627 110010000000208|567811368851555 110010000000209|567811422513652 110010000000210|567812130217683 110010000000211|567813220211182 110010000000212|567813449322589... (4 Replies)
Discussion started by: PradeepRed
4 Replies
Login or Register to Ask a Question