|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
select a record from one file matching from second file using awk
Post 302202818 by synmag on Thursday 5th of June 2008 08:16:13 PM
06-05-2008
select a record from one file matching from second file using awk
I need help 
I have two input files and I'd like to generate a report based on the two.
filea:
hostname,account1,password
,account2,password
hostname,account1,password
hostname,account1,password
,account1,password
,account2,password
repeating hostnames are blank
fileb:
hosta
hostb
hostc
I need to generate a record of "hostname account password" for all hosts in fileb that occur in filea for a specific account. I.e. I want a list of root passwords for all hosts in fileb. I know the logic I want to use but don't have the scripting skills to implement it. I think the easiest way would be to use awk to fill in the blanks with the hostname of filea and then simply use a shell script to grep for each host in fileb of the new filea.
The other way is to run down filea for each hostname in fileb until either the account is matched or the hostname is different and print the result. If the account does not exist for the given hostname do nothing.
I'm trying to save manually doing this by scripting it thinking it would be faster but maybe I was wrong
Here is the framework I came up with so far for the harder way because it would be more elegant
#!/bin/sh
#
hosts=`cat hosts.txt`
hostname="x"
last="x"
for name in ${hosts}
do
#the awk logic would come here
done
I have two input files and I'd like to generate a report based on the two.
filea:
hostname,account1,password
,account2,password
hostname,account1,password
hostname,account1,password
,account1,password
,account2,password
repeating hostnames are blank
fileb:
hosta
hostb
hostc
I need to generate a record of "hostname account password" for all hosts in fileb that occur in filea for a specific account. I.e. I want a list of root passwords for all hosts in fileb. I know the logic I want to use but don't have the scripting skills to implement it. I think the easiest way would be to use awk to fill in the blanks with the hostname of filea and then simply use a shell script to grep for each host in fileb of the new filea.
The other way is to run down filea for each hostname in fileb until either the account is matched or the hostname is different and print the result. If the account does not exist for the given hostname do nothing.
I'm trying to save manually doing this by scripting it thinking it would be faster but maybe I was wrong
Here is the framework I came up with so far for the harder way because it would be more elegant
#!/bin/sh
#
hosts=`cat hosts.txt`
hostname="x"
last="x"
for name in ${hosts}
do
#the awk logic would come here
done
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi there, I have a text file with several colums separated by "|;#" I need to search the file extracting all columns starting with the value of "1" or "2" saving in a separate file just the first 7 columns of each row maching the criteria, with replacement of the saparators in the nearly created... (4 Replies)
Discussion started by: capnino
4 Replies
2. Shell Programming and Scripting
I have file1
3049
3138
4672
22631
45324
112382
121240
125470
130289
186128
193996
194002
202776
228002
253221
273523
284601
284605
641858 (8 Replies)
Discussion started by: biomed
8 Replies
3. Shell Programming and Scripting
Hello ,
I have comma delimited file with over 20 fileds that i need to do some validations on. I have to check if certain fields are null and then write the line containing the null field into a new file and then delete the line from the current file.
Can someone tell me how i could go... (2 Replies)
Discussion started by: goddevil
2 Replies
4. Shell Programming and Scripting
Hi all,
I am new to AWK and I am trying to solve a problem that is probably easy for an expert. Suppose I have the following data file input.txt:
20 35 43
20 23 54
20 62 21
20.5 43 12
20.5 33 11
20.5 89 87
21 33 20
21 22 21
21 56 87
I want to select from all lines having the... (4 Replies)
Discussion started by: naska
4 Replies
5. Shell Programming and Scripting
Hi all , I have two files : dblp.xml with dblp records and itu1.txt with faculty members records. I need to find out how many dblp records are related to the faculty members. More specific: I need to find out which names from itu1.txt are a match in dblp. xml file , print them and show how many... (4 Replies)
Discussion started by: iori
4 Replies
6. Shell Programming and Scripting
I have 2 input files (tab separated):
file1:
make_A 1990 foo bar
make_B 2010 this that
make_C 2004 these those
file2:
make_X 1970 1995 ref_1:43 ref_2:65
make_A 1970 1995 ref_1:4 ref_2:21 ref_3:18
make_A 1980 2002 ref_1:7 ref_2:7 ref_3:0 ... (2 Replies)
Discussion started by: beca123456
2 Replies
7. Shell Programming and Scripting
Hello,
I want to get the maximum value of each record separated by empty line based on the 3rd column of each row within each record?
Input:
A1 chr5D 634 7 82 707
A2 chr5D 637 6 82 713
A3 chr5D 637 5 82 713
A4 chr5D 626 1 82 704... (4 Replies)
Discussion started by: yifangt
4 Replies
8. Shell Programming and Scripting
ok. so i have a list of country names which have been abbreviated. we'll call this list A
i have another list that which contains the what country each abbreviated name means. we'll call this list B.
so example of the content of list B:
#delimited by tabs
#ABBR COUNTRY COUNTRY... (2 Replies)
Discussion started by: SkySmart
2 Replies
9. Shell Programming and Scripting
In the awk below I am trying to add a penalty to a score to each matching $1 in file2 based on the sum of $3+$4 (variable TL) from file1. Then the $4 value in file1 is divided by TL and multiplied by 100 (this valvue is variable S). Finally, $2 in file2 - S gives the updated $2 result in file2.... (2 Replies)
Discussion started by: cmccabe
2 Replies
10. UNIX for Beginners Questions & Answers
In the awk below I am trying to cp and paste each matching line in f2 to $3 in f1 if $2 of f1 is in the line in f2 somewhere. There will always be a match (usually more then 1) and my actual data is much larger (several hundreds of lines) in both f1 and f2. When the line in f2 is pasted to $3 in... (4 Replies)
Discussion started by: cmccabe
4 Replies
LEARN ABOUT OSX
notificationconf
notificationconf(1) BSD General Commands Manual notificationconf(1) NAME
notificationconf -- configures how aosnotifyd responds to the NSServerNotificationCenter api SYNOPSIS
notificationconf command [command_args] DESCRIPTION
notificationconf is a utility to configure the push notification client functionality. The functionality is accessed by programs using the NSServerNotification api, and this utility configures options for aosnotifyd that are outside the scope of the api. USAGE
You must specify a command to select a specific function to perform. Each command accepts its own arguments. COMMAND SUMMARY
Here are brief descriptions of all the notificationconf commands: setpass hostname username Configures a password and user name in the keychain that aosnotifyd can use to access a notification server. It prompts for the password. removepass hostname Removes the keychain entry for the specified server usessl hostname Forces the client to use an SSL connection to the specified server. The server must have a certificate the client will validate. nossl hostname Sets the client back to the default state of not using an SSL connection for the specified server. createnode hostname nodename username Creates a node on the server to send notifications using. Before a client can subscribe to notifications with a given name, the server must be configured with a node with a matching name. A user name is specified and the tool prompts for a password. This user must have permissions to create notification nodes on the server. FILES
/usr/bin/notificationconf SEE ALSO
aosnotifyd(8) Mac OS X 12 March 2009 Mac OS X