Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Using shell script to compare files and retrieve connections

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Using shell script to compare files and retrieve connections
# 1  
Old 10-18-2013
Using shell script to compare files and retrieve connections
Hello,
I want to use shell script to generate network files (I tried with python but its taking too long).

I have a list of nodes:
node.txt
Code:

LOC_Os11g37970
LOC_Os01g07760
LOC_Os03g19480
LOC_Os11g45740
LOC_Os06g08290
LOC_Os07g02800

I have an edge-list as well: edge.txt
Code:
Source_node   Destination_node
LOC_Os11g37970   LOC_Os04g47140    
LOC_Os03g19480   LOC_Os02g47060   
LOC_Os07g37454   LOC_Os05g44420   
LOC_Os03g49630   LOC_Os03g19480  
LOC_Os08g02120   LOC_Os01g71220   
LOC_Os04g50860   LOC_Os11g37970  
LOC_Os01g01710   LOC_Os01g07090   
LOC_Os01g56370   LOC_Os02g12080

I want to retrieve all those connections (lines/rows) from the edge-list whose either 'source' or 'destination' matches with those in node.txt

Desired output:
Code:
Source_node   Destination_node
LOC_Os11g37970   LOC_Os04g47140 
LOC_Os04g50860   LOC_Os11g37970 
LOC_Os03g19480   LOC_Os02g47060
LOC_Os03g49630   LOC_Os03g19480

Thanks.
# 2  
Old 10-18-2013
Using awk:
Code:
awk 'NR==FNR{A[$1];next}$1 in A || $2 in A' node.txt edge.txt

This User Gave Thanks to Yoda For This Post:
Sanchari
# 3  
Old 10-18-2013
Code:
$ grep -f nodes.txt edge.txt
LOC_Os11g37970   LOC_Os04g47140
LOC_Os03g19480   LOC_Os02g47060
LOC_Os03g49630   LOC_Os03g19480
LOC_Os04g50860   LOC_Os11g37970

Although you don't get the header...
This User Gave Thanks to CarloM For This Post:
Sanchari
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell Script to Compare Files and Email the differences

Hi, I have 2 files abc.txt and bdc.txt. I am using $diff -y abc.txt bcd.txt -- compared the files side by side I would like to write a Shell Script to cmpare the files side by side and print the results( which are not matched) in a side by side format and save the results in another... (10 Replies)
Discussion started by: vasuvv
10 Replies

2. Shell Programming and Scripting

Shell script to compare two files for duplicate..??

Hi , I had a requirement to compare two files whether the two files are same or different .... like(files contaisn of two columns each) file1.txt 121343432213 1234 64564564646 2345 343423424234 2456 file2.txt 121343432213 1234 64564564646 2345 31231313123 3455 how to... (2 Replies)
Discussion started by: hemanthsaikumar
2 Replies

3. Shell Programming and Scripting

Compare columns of two files and retrieve data

Hi guys, I need your help. I have two files: file1 1 3 5 file2 1,XX 2,AA 3,BB 4,CC 5,DD I would like to compare the first column and where they are equal to write that output in a new file: 1,XX 3,BB (7 Replies)
Discussion started by: apenkov
7 Replies

4. Shell Programming and Scripting

How to use awk shell script to compare and match two files?

Basically, I have two files dupestest.txt 152,153 192,193,194 215,216 290,291 2279,2280 2282,2283haftest.txt 152,ABBOTS ROAD 153,ABBOTS ROAD 154,ABBOTS ROAD 155,ABBOTS ROAD 156,ABBOTS ROAD 157,ABBOTS ROADI want to find the numbers in dupestest.txt in haftest.txt... (4 Replies)
Discussion started by: amyc92
4 Replies

5. Shell Programming and Scripting

Compare two files using shell script

Hi i want to compare two files and i need the o/p of only difference here the files file1 achilles aedxbepo aedxbwdm01 aedxbwdm02 albedo amarice ambrister anakin anton argon artephius asgard avatar aymara (10 Replies)
Discussion started by: venikathir
10 Replies

6. Shell Programming and Scripting

Shell script to compare two files

I have two files; file A and file B. I need all the entries of file A to be compared with file B line by line. If the entry exists on file B, then save those on file C; if no then save it on file D Note :- all the columns of the lines of file A need to be compared, except the last two columns... (8 Replies)
Discussion started by: ajiwww
8 Replies

7. Shell Programming and Scripting

Shell Script to Compare Two Files

I have a directory with about 6 files that we receive regularly. these 6 files contain information for 3 different units, 2 for each unit. files related to a specific unit are named similarly with a change in number at the end of the file. the numbers should be sequential. for each grouping of... (3 Replies)
Discussion started by: scriptman237
3 Replies

8. Shell Programming and Scripting

Compare semicolon seperated data in 2 files using shell script

hello members, I have some data ( seperated by semicolon ) with close to 240 rows in a text file temp1. temp2.txt stores 204 rows of data ( seperated by semicolon ). I want to : Sort the data in both files by field1.i.e first data field in every row. compare the data in both files and print... (6 Replies)
Discussion started by: novice82
6 Replies

9. UNIX and Linux Applications

How to compare two files using shell script

hi experts please help me to compare two files which are in different directory file1<file will be master file> (/home/rev/mas.txt} ex x1 x2 file2 <will be in different folder> (/home/rev/per/.....) ex x3 x4 the filesinside per folder i need to compare with master file... (1 Reply)
Discussion started by: revenna
1 Replies

10. UNIX for Dummies Questions & Answers

dsl connections lost when attempting to retrieve mail from my server.

suse linux 6.4 im running and i have port 110 for pop and smtp open, i have set up some email addresses for my friends, but they recieve errors saying that relaying is denied. i know this is to prevent spamming software from using my domain to send spam, but how do i let my users send their mail?... (6 Replies)
Discussion started by: norsk hedensk
6 Replies
Login or Register to Ask a Question