Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Combine contents of files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Combine contents of files
# 1  
Old 04-14-2011
Combine contents of files
hi Gurus,

I have these users data from different servers ( more than 2 servers ):

Server A

/opt/home/oracle/.k5login
akrapivi@SYSTEMS.NYFIX.COM
jimf@SYSTEMS.NYFIX.COM
casehan@SYSTEMS.NYFIX.COM
cyang@SYSTEMS.NYFIX.COM
ecampbel@SYSTEMS.NYFIX.COM

Server B

/opt/home/oracle/.k5login

jimf@SYSTEMS.NYFIX.COM
gviray@SYSTEMS.NYFIX.COM
jsantos@SYSTEMS.NYFIX.COM
mvonbeeden@SYSTEMS.NYFIX.COM

I want to combine the contents of the two server's k5login files provided that there would be no duplicate records in the result.

Output would be:

/opt/home/oracle/.k5login/

akrapivi@SYSTEMS.NYFIX.COM
jimf@SYSTEMS.NYFIX.COM
casehan@SYSTEMS.NYFIX.COM
cyang@SYSTEMS.NYFIX.COM
ecampbel@SYSTEMS.NYFIX.COM
gviray@SYSTEMS.NYFIX.COM
jsantos@SYSTEMS.NYFIX.COM
mvonbeeden@SYSTEMS.NYFIX.COM

would appreciate much your help on this.
Last edited by linuxgeek; 04-14-2011 at 12:29 AM..
# 2  
Old 04-14-2011
Cat it to one temporary file and then use "sort -u" to eliminate duplicates and write it to the final file.
This User Gave Thanks to aster007 For This Post:
linuxgeek
# 3  
Old 04-14-2011
first, set passwordless ssh on all remote servers

Code:
while read server
do
  ssh $server cat /opt/home/oracle/.k5login >> temp
done < server.list

sort -u temp > output

This User Gave Thanks to rdcwayx For This Post:
linuxgeek
# 4  
Old 04-14-2011
Thank you guys! Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

2. Shell Programming and Scripting

Combine 2 files

How to cilnd desided output from file1 and file2 with awk. file1 1 2 7 8 9 14 15 16 21 22 23 28 29 30 file2 aa bb cc dd ee ff gg hh ii jj kk ll (3 Replies)
Discussion started by: theshashi
3 Replies

3. Shell Programming and Scripting

combine multiple files by column into one files already sorted!

I have multiple files; each file contains a certain data in a column view simply i want to combine all those files into one file in columns example file1: a b c d file 2: 1 2 3 4 file 3: G (4 Replies)
Discussion started by: ahmedamro
4 Replies

4. Shell Programming and Scripting

3 files combine into one help please

Ok here is what I have file a {{BEGIN}} {{FAX File b 5555464584 5555465292 5555465828 5555485930 5555474939 File C }} ON ORDERS LESS THAN 70 LBS AND THE PACKAGE IS A COMBINED LENGTH AND GIRTH EQUAL TO OR LESS THAN 108" PLEASE UTILIZE UPS. ... (4 Replies)
Discussion started by: sctxms
4 Replies

5. HP-UX

How to combine 2 different files

Hi : I have a file containing the print queues with their IP address. I wanted to combine the 'lpstat' output with their respective IP address. For example : zebhtrmb-6078 lgonzale priority 0 Mar 17 11:50 on zebhtrmb with zebhtrmb-6078 lgonzale priority 0 ... (1 Reply)
Discussion started by: rdasari
1 Replies

6. Shell Programming and Scripting

Combine files with same name

I need a script that combines files with the same name. These files are on a windows directory but the PC has Cygwin so i have a limited unix command set. What I've got; WebData_9_2007-09-20.txt WebData_9_2007-09-20.txt WebData_9_2007-09-21.txt WebData_9_2007-09-20.txt... (4 Replies)
Discussion started by: jmwhitford
4 Replies

7. Shell Programming and Scripting

Need To Combine 2 Files

I have 2 files that I need to combine. One file is looks like this: 71664107;1;1;05-FEB-07;12-FEB-07; The other file looks like this: U;71664107;dummy;Pirovano;M;04-SEP-75;Georgia;MI;1;1;31;S;S;;;Y;05-02-2007;0;12-FEB-07; I need to combine both files together. I need the shorter... (4 Replies)
Discussion started by: goodmis
4 Replies

8. Shell Programming and Scripting

combine two files

I have two files: file1 and file2 the content of files1 is: 13 22 333 42 56 55 ... the content of file2 is: aa dd cc ee ff gg ... (1 Reply)
Discussion started by: fredao1
1 Replies

9. UNIX for Dummies Questions & Answers

Combine 2 files

Some one plz give me the answer we have 3 files 1 and 2 are given and we need to get 3 file by using some trick file_one.dat AMITH ARUN ARVIND file_two.dat (these are Variables) X Y Z and we need to write scirpt in file_two.data and get the answer in file_three.dat as fallows... (2 Replies)
Discussion started by: Nekki
2 Replies

10. UNIX for Dummies Questions & Answers

how to combine two files

i need to combine two file. These two files have the same line number, and i need to combine each corresponding line. I tried the paste, but i need coma as the delimeter. are there anyway to do it? thanks. (4 Replies)
Discussion started by: tao
4 Replies
Login or Register to Ask a Question