Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

[Solved] delete line from file1 by reading from file2

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting [Solved] delete line from file1 by reading from file2
# 1  
Old 10-28-2011
[Solved] delete line from file1 by reading from file2
Hi All,

I have to arrange one of the text file by deleting specific lines.

Code:
 
cat file1.txt
 
3595 3595 -0.00842773 -0.0085077 0.00368851 
12815 12815 -0.00929239 0.00439785 0.0291697 
3747 3747 -0.00974353 0.00228922 0.0225058 
3574 3574 -0.00711399 -0.00315748 0.0141206 
....
12734 12734 -0.00918432 -0.0163555 -0.00586558
3617 3617 -0.00884411 -0.00911498 0.00567046

Code:
 
cat file2.txt 
 
12815
3747
...
12734


I want to delete the lines in file1.txt which first column has the number defined in file2.txt. So, output file will be.

Code:
 
cat output.txt
3595 3595 -0.00842773 -0.0085077 0.00368851 
3574 3574 -0.00711399 -0.00315748 0.0141206 
....
3617 3617 -0.00884411 -0.00911498 0.00567046

Thanks,
# 2  
Old 10-28-2011
Code:
$ fgrep -vf file2.txt file1.txt
3595 3595 -0.00842773 -0.0085077 0.00368851
3574 3574 -0.00711399 -0.00315748 0.0141206
3617 3617 -0.00884411 -0.00911498 0.00567046

# 3  
Old 10-28-2011
It did not work. This command deleted more lines than i was expecting. Can we check by two columns in file1.txt to be sure it deletes the correct lines? It has to be the exact match not the subset.
# 4  
Old 10-28-2011
Code:
nawk 'FNR==NR {f2[$1];next} !($1 in f2)' file2 file1

This User Gave Thanks to vgersh99 For This Post:
senayasma
# 5  
Old 10-28-2011
Code:
awk 'NR==FNR{a[$0]++;next}{if($1 in a){next}}1' file2.txt file1.txt > output.txt

--ahamed
This User Gave Thanks to ahamed101 For This Post:
senayasma
# 6  
Old 10-28-2011
If it did not you expected then you have to think again "what was it saying in the forum rules on how to post?"
jayan_jay has been kind enough to show you a code THAT WORKS, I tested...
If it does not for you it is because of the lack of information you gave, I tested on a AIX 6.2 using ksh. Is the sample data enough to figure out all possible cases? What do we know of your OS and environment? Till now nothing...
Last edited by vbe; 10-28-2011 at 12:02 PM.. Reason: typos...
# 7  
Old 10-28-2011
These two commands work great.

---------- Post updated at 10:54 AM ---------- Previous update was at 10:52 AM ----------

Sorry for the misunderstanding jayan_jay.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Compare file1 and file2, print matching lines in same order as file1

I want to print only the lines in file2 that match file1, in the same order as they appear in file 1 file1 file2 desired output: I'm getting the lines to match awk 'FNR==NR {a++}; FNR!=NR && a' file1 file2 but they are in sorted order, which is not what I want: Can anyone... (4 Replies)
Discussion started by: pathunkathunk
4 Replies

2. Shell Programming and Scripting

Reading and appending a row from file1 to file2 using awk or sed

Hi, I wanted to add each row of file2.txt to entire length of file1.txt given the sample data below and save it as new file. Any idea how to efficiently do it. Thank you for any help. input file file1.txt file2.txt 140 30 200006 141 32 140 32 200006 142 33 140 35 200006 142... (5 Replies)
Discussion started by: ida1215
5 Replies

3. Shell Programming and Scripting

Match single line in file1 to groups of lines in file2

I have two files. File 1 is a two-column index file, e.g. comp11084_c0_seq6:130-468(-) comp12746_c0_seq3:140-478(+) comp11084_c0_seq3:201-539(-) comp12746_c0_seq2:191-529(+) File 2 is a sequence file with headers named with the same terms that populate file 1. ... (1 Reply)
Discussion started by: pathunkathunk
1 Replies

4. Shell Programming and Scripting

Using regex's from file1, print line and line after matches in file2

Good day, I have a list of regular expressions in file1. For each match in file2, print the containing line and the line after. file1: file2: Output: I can match a regex and print the line and line after awk '{lines = $0} /Macrosiphum_rosae/ {print lines ; print lines } ' ... (1 Reply)
Discussion started by: pathunkathunk
1 Replies

5. Shell Programming and Scripting

look for line from FILE1 at FILE2

Hi guys! I'm trying to write something to find each line of file1 into file2, if line is found return YES, if not found return NO. The result can be written to a new file. Can you please help me out? FILE1 INPUT: WATER CAR SNAKE (in reality this file has about 600 lines each with a... (2 Replies)
Discussion started by: demmel
2 Replies

6. UNIX for Dummies Questions & Answers

if matching strings in file1 and file2, add column from file1 to file2

I have very limited coding skills but I'm wondering if someone could help me with this. There are many threads about matching strings in two files, but I have no idea how to add a column from one file to another based on a matching string. I'm looking to match column1 in file1 to the number... (3 Replies)
Discussion started by: pathunkathunk
3 Replies

7. Shell Programming and Scripting

append text from file1 to the end of each line in file2

hi; my file2.txt:portname=1;list=10.11;l- portname=2;list=10.12;l- portname=3;list=10.13;l- ... my file1.txt:;"{'sector=%27'}"\&> so; i want to see:portname=1;list=10.11;l-;"{'sector=%27'}"\&> portname=2;list=10.12;l-;"{'sector=%27'}"\&> portname=3;list=10.13;l-;"{'sector=%27'}"\&>... (4 Replies)
Discussion started by: gc_sw
4 Replies

8. Shell Programming and Scripting

Compare multiple fields in file1 to file2 and print line and next line

Hello, I have two files that I need to compare and print out the line from file2 that has the first 6 fields matching the first 6 fields in file1. Complicating this are the following restrictions 1. file1 is only a few thousand lines at most and file2 is greater than 2 million 2. I need to... (7 Replies)
Discussion started by: gillesc_mac
7 Replies

9. Shell Programming and Scripting

insert file2 after line containing patternX in file1

file1:- aaaa bbbb cccc dddd eeee file2:- 1111 2222 3333 4444 I want to insert file2 after pattern bbbb to come up with a finished file of :- aaaa bbbb 1111 2222 3333 4444 (5 Replies)
Discussion started by: repudi8or
5 Replies

10. Shell Programming and Scripting

delete lines from file2 beginning w/file1

I've been searching around here and other places, but can't put this together... I've got a unique list of words in file 1 (one word on each line). I need to delete each line in file2 that begins with the word in file1. I started this way, but want to know how to use file1 words instead... (13 Replies)
Discussion started by: michieka
13 Replies
Login or Register to Ask a Question