Combine/omit data from 2 files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Combine/omit data from 2 files
# 1  
Old 09-19-2014
Combine/omit data from 2 files

i made a script on my own. this is for the inventory to all of my AWS servers, and i run it to all of my servers to get the hostname, please look at file2. Then i need some data in file3 as well,. i need to combine them

Code:
#cat file1
192.10.1.41
server.age.com
######

192.10.0.40
ssh cant connect
######

192.1.1.49 
server2.age.com
##########


#cat file 2
data3 ip.192.10.1.41.us stop 
data2 ip.192.10.0.40.internal running
data1 ip.192.1.1.49.internal idle      max




Output:
192.10.1.41  server.age.com  data3 stop
192.10.0.40  		     data2 running
192.1.1.49   server2.age.com data1 idle


Last edited by kenshinhimura; 09-19-2014 at 05:29 PM..
# 2  
Old 09-19-2014
What have you tried so far, and what/where is file2?

Last edited by RudiC; 09-19-2014 at 05:33 PM..
# 3  
Old 09-19-2014
This what i tried. for file 2

Code:
cat file2|egrep -v '(Name|Desc)'|awk '{print $2,$1,$3}'

but you know its two files.

Last edited by Corona688; 09-19-2014 at 06:01 PM..
# 4  
Old 09-19-2014
Hello,

Following may help you. Lets say input files are test13 and test12.
File test13:
Code:
cat test13
data3 192.10.1.41 stop 
data2 192.10.0.40 running
data1 192.1.1.49 idle      max

File test12:
Code:
cat test12
192.10.1.41
server.age.com
######

192.10.0.40
ssh cant connect
######

192.1.1.49 
server2.age.com
##########

Code is as follows.
Code:
awk 'FNR==NR{A[$2]=$1 OFS $3;next} ($1 in A){D=A[$1];C=$1;getline; {if($0 !~ /ssh cant/) {C=C OFS $0} else {C=C "\t"}};$0=C OFS D;print $0}' test13 test12

Output will be as follows.

Code:
awk 'FNR==NR{A[$2]=$1 OFS $3;next} ($1 in A){D=A[$1];C=$1;getline; {if($0 !~ /ssh cant/) {C=C OFS $0} else {C=C "\t"}};$0=C OFS D;print $0}' test13 test12
192.10.1.41 server.age.com data3 stop
192.10.0.40     data2 running
192.1.1.49 server2.age.com data1 idle

Thanks,
R. Singh
# 5  
Old 09-19-2014
Above was jsut example..
Code:
cat g|egrep -v '(Name|Desc)'|awk '{print $1,$3,$4}'|sed s/.us.east.2.compute.internal//|sed s/ip.//


us.east.2c i.1111111 192.26.97.70    (IM HOPING TO PUT THE HOSTNAME HERE)
us.east.2b i.222222 192.26.93.41      (HOSTNAME HERE)


Last edited by Corona688; 09-19-2014 at 06:00 PM..
# 6  
Old 09-19-2014
Please don't modify posts that have been referred to by others! And. please apply sufficient painstakingness when writing your spec. Now it is referring to file3 which is not present anymore.
# 7  
Old 09-19-2014
Sing lets make it dynamic
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Combine data out of 3 files into one new file

Hi, How can I combine the data of of three files into one new file? I try to give as much informations as possible. The three existing files are called file1 file2 and file3 the new file should named output_combined. The size of the files will be around 900 words/lines each .. but always... (5 Replies)
Discussion started by: MyMemberName
5 Replies

2. Shell Programming and Scripting

Combine data from two files base on uniq data

File 1 ID Name Po1 Po2 DD134 DD134_4A_1 NN-1 L_0_1 DD134 DD134_4B_1 NN-2 L_1_1 DD134 DD134_4C_1 NN-3 L_2_1 DD142 DD142_4A_1 NN-1 L_0_1 DD142 DD142_4B_1 NN-2 L_1_1 DD142 DD142_4C_1 NN-3 L_2_1 DD142 DD142_3A_1 NN-41 L_3_1 DD142 DD142_3A_1 NN-42 L_3_2 File 2 ( Combination of... (1 Reply)
Discussion started by: pareshkp
1 Replies

3. Shell Programming and Scripting

How to combine the data of files?

I have a main file as follows aaa 3/2 = 1.5 aba 55+6 = 61 aca 67+8 = 75 hjk 3+3 = 67 ghd 66+30 = 96 ghj 99-3 = 96 ffg 67+3 = 70 I have 4 sub files named sub1, sub2, sub3, sub4 content of sub1 aaa 23+5 = 28 hjk 45+6 = 51 ghd 40-20 = 20 ... (2 Replies)
Discussion started by: jackevan
2 Replies

4. Shell Programming and Scripting

get data from files combine them to a file

hi people; this is my file1.txt:192.168.1.1 192.168.1.2 192.168.1.3 192.168.1.4 ... this is my file2.txt:portnames usernames maxusercap ... i want to write to file3.txt:l ./getports 192.168.1.1 'get all;l+;get . portnames;l-' l ./getports 192.168.1.1 'get all;l+;get . usernames;l-'... (4 Replies)
Discussion started by: gc_sw
4 Replies

5. Shell Programming and Scripting

Omit Blank Lines while comparing two files.

Hello All, I am writting file comparison Utility and I have encountered such a senario where there are 2 files such as follows- 1#!/usr/local/bin/python 2 import gsd.scripts.admin.control.gsdPageEscalate 3.gsd.scripts.admin.control.gsdPageEscalate.main() 1 #!/usr/local/bin/python... (10 Replies)
Discussion started by: Veenak15
10 Replies

6. Shell Programming and Scripting

how to omit data from a file created in a script

I am using the fallowing script. this script seems to work fine except the file has data I do not wish to have. Is there away to omit that data. I will first provide the scrip and then a sample of the data the way it looks and then a sample of how I would like the data to look. Thanks for any... (3 Replies)
Discussion started by: krisarmstrong
3 Replies

7. Shell Programming and Scripting

Command to list only files omit directories.

Hi All I am writting a script that does a comparison between files in 2 diffectent directories. To do this I need a command that will list out only the files in a give directory and omit any sub dorectories with that directory. But I am unable to find it. Please Help. I tried ls... (5 Replies)
Discussion started by: Veenak15
5 Replies

8. Shell Programming and Scripting

combine data of 2 files by variable

my first post ... please be gentle. I have been working on a script to get info out of mysql. Its a support ticket system database OTRS. I can write the subject of open tickets to a text file with a unique user id. I also have a text file with the unique user id, username and email adres. I... (11 Replies)
Discussion started by: dicenl
11 Replies

9. Shell Programming and Scripting

How to combine data files using for loop

Hi, I have 5 files basically;namely file1.txt situated each at folder A to E respectively. I would like to extract out third column from each of these file1.txt from folder A to folder E. Also, I wanted to extract the first and second column which are common. In other words, e.g ... (6 Replies)
Discussion started by: ahjiefreak
6 Replies

10. UNIX for Dummies Questions & Answers

Recover data from 2 files then combine

Using dd or similar tools to recover data from 2 damaged cdroms, I need a way to then combine the 2 files, 1 from each cd, and make a good file: this all result from finding that certain cd's tops scratch easily even when using the "proper" cd markers, hence making the file useless, however the... (1 Reply)
Discussion started by: saint65
1 Replies
Login or Register to Ask a Question