remove specific lines from a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting remove specific lines from a file
# 8  
Old 10-05-2004
Try:
grep '.\{44\}00[23].*' infile > outfile
# 9  
Old 10-07-2004
Thanks perderabo, but what if the strings were completely different ie, didnt have a common 00 at the front. I have another status code of 55 (with a space after to make up the 3rd character ie

xxxxxx,002,xxx
xxxxxx,003,xxx
xxxxxx,55 ,xxx

I cant really use the '00' as a prefix and I presume I cant put [55002003] into the command ??
# 10  
Old 10-07-2004
I have been advised by somebody else to use | inside some () to get multiple values into the condition ie

grep '.\{44\}\(002|55\).*' infile > outfile

although this doesnt seem to work, does anybody know if im on the right track ??

ive tried it with egrep instead of grep and also without escaping the ()'s all to no avail

any help would be greatly appreciated
# 11  
Old 10-07-2004
I'm starting to think that awk would solve these problems easier.

You've got 7 comma seperated fields in the input file.

The "status" is in the 6th field.

Therefore

Code:
awk 'BEGIN { FS="," } { if ( $6 ~ /55|002|003/ ) { print $0 } }' infile > outfile

Would place any record with status 55, 002 or 003 into "outfile".

Modify the ( $6 ~ /55|002|003/ ) part and insert the statuses (or is that statii?!) of the records you want.

Cheers
ZB
# 12  
Old 10-07-2004
works perfectly thankyou, out of interest how would i do a "not" version of this script so that everything other than 002,003,55 get put in a file

cheers
# 13  
Old 10-07-2004
Change the if statement to
... if ( $6 !~ /55|002|003/ ) ...

Note: ~ means "matches"
!~ means "doesn't match"

Cheers
ZB
# 14  
Old 09-07-2006
MySQL

Hi,
I am using the following AWK command to strip some lines from a file based on a pattern. But this is creating an additional blank line at the position where the pattern matched. Please advise how to avoid the blank line. Thanks.

awk 'BEGIN { FS="," } { if ( $6 ~ /55|002|003/ ) { print $0 } }' infile > outfile

Regards,
Tipsy.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

awk with sed to combine lines and remove specific odd # pattern from line

In the awk piped to sed below I am trying to format file by removing the odd xxxx_digits and whitespace after, then move the even xxxx_digit to the line above it and add a space between them. There may be multiple lines in file but they are in the same format. The Filename_ID line is the last line... (4 Replies)
Discussion started by: cmccabe
4 Replies

2. Shell Programming and Scripting

Remove duplicate consecutive lines with specific string

Hello, I'm trying to remove the duplicate consecutive lines with specific string "WARNING". File.txt abc; WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 bcd; abc; 123 123 123 WARNING 1234 WARNING 2345 WARNING 2345 efgh; (6 Replies)
Discussion started by: Mannu2525
6 Replies

3. Shell Programming and Scripting

Remove lines matching a substring in a specific column

Dear group, I have following input text file: Brit 2016 11 18 12 00 10 1.485,00 EUR Brit 2016 11 18 12 00 10 142,64 EUR Brit 2016 11 18 12 00 10 19,80 EUR Brit 2016 11 18 12 00 10 545,00 EUR Brit 2016 11 18 12 00 10 6.450,00 EUR... (3 Replies)
Discussion started by: gfhsd
3 Replies

4. Shell Programming and Scripting

awk to remove lines in file if specific field matches

I am trying to remove lines in the target.txt file if $5 before the - in that file matches sorted_list. I have tried grep and awk. Thank you :). grep grep -v -F -f targets.bed sort_list grep -vFf sort_list targets awk awk -F, ' > FILENAME == ARGV {to_remove=1; next} > ! ($5 in... (2 Replies)
Discussion started by: cmccabe
2 Replies

5. Shell Programming and Scripting

NAWK to remove lines that matches a specific pattern

Hi, I have requirement that I need to split my input file into two files based on a search pattern "abc" For eg. my input file has below content abc defgh zyx I need file 1 with abc and file2 with defgh zyx I can use grep command to acheive this. But with grep I need... (8 Replies)
Discussion started by: sbhuvana20
8 Replies

6. Shell Programming and Scripting

Sed or Awk to remove specific lines

I have searched the forum for this - forgive me if I missed a previous post. I have the following file: blah blah blah blah blah blah blah blah blah blah blah blah blah blah blah alter table "informix".esc_acct add constraint (foreign key (fi_id) references "informix".fi ... (5 Replies)
Discussion started by: Shoeless_Mike
5 Replies

7. Shell Programming and Scripting

how to remove specific lines from a file (reprise)

Hello, I've to change the shell in /etc/passwd for some users . I've the list of users but I'm not able to modify the file with scripting . I'm working on a Sol10 . Can anyone help me ? tnks (7 Replies)
Discussion started by: gogol_bordello
7 Replies

8. Shell Programming and Scripting

How to remove the specific lines from file using perl

Can anyone tell me what could be the solution to following : I have one .txt file which contains some "seed" information. This seed may appear multiple time in the file so what I want do is if this seed appears again in the file then that line should be removed. Please provide the script code... (4 Replies)
Discussion started by: dipakg
4 Replies

9. Shell Programming and Scripting

remove specific lines from flat file using perl

Hi, Here is wat im looking for.. i have a flat file which looks like this.. 00 * * * * .. .. * * text text text COL1 COL2 ----- ----- 1 a (12 Replies)
Discussion started by: meghana
12 Replies

10. Shell Programming and Scripting

how to remove specific lines from a file

When restoring a file in my uninstall program I need to remove the lines I added to a file during the install. In between the file can be modified by the users. Assume file1 is as follow: xxx str2 xxxx ..... ...The Following lines containing str* have to be removed... xxx str1 xxxx xxx ... (17 Replies)
Discussion started by: bluemoon1
17 Replies
Login or Register to Ask a Question