The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > UNIX for Dummies Questions & Answers
Google UNIX.COM


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Realtime Application Interface 3.6 (Default branch) iBot Software Releases - RSS News 0 01-19-2008 05:30 AM
Realtime Application Interface 3.6-test3 (Default branch) iBot Software Releases - RSS News 0 01-03-2008 02:20 PM
Data Storage Systems support 750 Gb SATA II disk drives. - ThomasNet Industrial News iBot UNIX and Linux RSS News 0 07-30-2007 06:30 AM
compare realtime wannalearn Shell Programming and Scripting 7 02-27-2007 06:42 AM
How to loop thru and change multiple files in realtime system? merliech Shell Programming and Scripting 2 04-24-2006 09:25 PM

Reply
 
Submit Tools LinkBack Thread Tools Display Modes
  #1  
Old 07-06-2008
Registered User
 

Join Date: Jul 2008
Posts: 1
Realtime data handling between 2 or more systems

Hi

I am in need to find a solution the following problem

I have more 3 unix based servers. Each handling many different services.
Then I have 1 windows based application that needs to collect the .log files in /tmp on the servers.

The plan I initially thought of will be to open ftp connection from windows to the servers on a fixed time interval and collect .log this way.

But now I need a more up-to-date data, so I need to find a solution whereby the servers will PUSH the data to the windows system, upon modification on the log files.

Please kindly recommend any middle-application or ideas on how to make this possible?
Reply With Quote
Forum Sponsor
  #2  
Old 07-06-2008
Smiling Dragon's Avatar
Disorganised User
 
Join Date: Nov 2007
Location: New Zealand
Posts: 734
Post

You've got quite a few options to select from here, the main thing to think about is your security requirements and data integrity (ie, is it ok to have a partial file etc?).

Once you know what you need from that, it should be easy to pick what you want to use.

As for mechanisms to transfer your files, here's a few ideas that might work for you:
  • samba: Run smbd on your three unix servers then map drives on the windows server to these shares. This will mean you don't actually need to store the files over on the windows server, you can read them over the network. Hard to get more up-to-date than that
  • ftp push: Run an ftpd on the windows server and have the unix servers push files over via ftp. Use send/expect to interact with ftp or use curl to do the transfer on the commandline.
  • ssh/scp: Run an sshd (eg cygwin) on your windows server so that you can automate file pushes from the unix servers. This will give you encrypted transfers and allow you to use ssh keys - that way you don't need to store a password on each of the servers.
  • email: Run an smtpd on the windows server and have it trigger your log application (or just a copy) on incomming emails for a certain address. Then on each unix server, uuencode/mpack/embed the logs to your email and fire them off.
  • Third party file transfer tools like connect direct or xcom: Most of these give you protection from trying to use partial files etc and have clients and servers for many different platforms. These generally cost money to use though :/

If you need encryption, then it's ssh, sftp, email combined with pgp, or the thrid party tools for you.
If you need passwordless connection, you can script pretty much anything but will have to store the password in the script (generally a bad thing) unless you go with samba, ssh, email, or the right thrid party tool.
If it's important that your windows app doesn't try to use a file that's only half copied, the only (fairly) sure solution is to script the use of a temp file that gets renamed after it's fully sent, use email, or a thirld party tool.

Hope that helps, sing out if you want further elaboration on a particular solution.
Reply With Quote
Google The UNIX and Linux Forums
Reply

Thread Tools
Display Modes




All times are GMT -7. The time now is 05:11 PM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
The UNIX and Linux Forums Content Copyright ©1993-2008. All Rights Reserved.Ad Management by RedTyger Visit The Complex Event Processing Blog

Content Relevant URLs by vBSEO 3.2.0