07-15-2008
Polling an FTP site for a file
Hi,
I'm after a bit of advice for the best way to collect files from an ftp server via a unix process. The main issue here is the frequency, the job needs to check for files every minute or so between 8am and 8pm and pull them down to the box if there is anything there.
Originally the transfer was going to be done via a VPN tunnel direct to a directory on my machine which my batch job would poll, but life is never simple. Unfortunately, that has now fallen through and the files are now being placed on an ftp site instead and I have to pull the files from there as security will not allow a push from there when a file is deposited on it, which also would have made life easier.
My question is, is there a way of opening a connection to the ftp site and keeping it open to poll for a file for that long, or am I just going to have to open and close connections repeatedly throughout the day?
Is there a better way?
Cheers
Paul.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
i do have a problem with the transaction of pdf-files from a server to another. there was a guy who told me about this command wich i should build in my ftp.put()-method in java. the command called: about quote site chmod 0 filename..
i think its something about filerights but does someone know... (1 Reply)
Discussion started by: calmacroi
1 Replies
2. Windows & DOS: Issues & Discussions
I have a small problem, there is one Win98 PC on our network, and I would like to map the FTP server that we have as one of the Win98's machine's local drives. I am by no means a Windows expert, instead my area is *NIX. The webserver is just a regualar webserver, within the LAN. I tried... (18 Replies)
Discussion started by: cerberusofhate
18 Replies
3. UNIX for Dummies Questions & Answers
Hi everyone,
can someone please tell me what can be wrong here?
Script:
ftp -v -n $FTPSERVER<< EOP >$LOGFILE 2>&1
user $USERID $PASSWD
ascii
site lrecl=500
site cyl
site PRI=600
site SEC=300
lcd $FTPLOCALDIR
cd $FTPTARGETDIR
put $SOURCEFILE $TARGETFILE
quit
EOP
Output:... (11 Replies)
Discussion started by: swoldering
11 Replies
4. Solaris
Using FTP on Solaris 5.8, I am not able to use the SITE command. It says Invalid command. I am trying to change the permission of the transmitted files to -rw-rw-rw on the destination machine. Any help would be greatly appreciated. (2 Replies)
Discussion started by: gauravsachan
2 Replies
5. UNIX for Dummies Questions & Answers
Hi all,
My problem is simple. I would like to download the contents of a directory on an ftp site. I can access the site through windows, but there are many files and it would be too tedious to click and download each file. Thus, I am trying to use
scp -r... (5 Replies)
Discussion started by: cpabrego
5 Replies
6. Shell Programming and Scripting
Hi,
My os is sun solaris 5.10 and Korn shell scripting.
I have a file name like CCNA_EARLY_SWP.w062309
where 062309 is date in mmddyy .This is the value date of the file.(will
I need to check continously from 5.00 - 7.00 am daily for this file .
If the file has not come at 5 am or 7am... (4 Replies)
Discussion started by: manoj39
4 Replies
7. Shell Programming and Scripting
I am polling a file on remote host. I have this code that works, but can't explain why it works.
while user@remote.no-exist.com 'ls /user/app1/.done'` ]
do
echo Sleeping for 5 secs
sleep 5;
done
This code works in the way that when the .done file exists on the remote host, the script... (1 Reply)
Discussion started by: starlatch
1 Replies
8. SCO
Hello dear Users,
I am for the first time in this forum. I come from Germany. Please excuse my bad englisch. My OS is SCO open Server Release 5.
I have a problem whith FTP and the command "site exec"
if I use the command "ftp> site chmod 777 /tmp/startkpf.sc
200 CHMOD command successful. ... (8 Replies)
Discussion started by: fla5do
8 Replies
9. Shell Programming and Scripting
HI
I need some help on this below one
Have summuary file coming on daily basis with list of file names and count ,if the summuary file not exist ,pool it for every 5 mins till it arrives .Once arrived remove first and last line from the file and check all the files in respective director all... (12 Replies)
Discussion started by: mohan705
12 Replies
10. Shell Programming and Scripting
I have a job that connects to FTP site, rename, get, delete a file and then process it. The renaming is done in consideration of this is one file name into which data is being accumulated many times within 24 hour cycle.
This is what happens now:
ftp -i $FTPHOST <<-EOF
ren... (3 Replies)
Discussion started by: migurus
3 Replies
LEARN ABOUT XFREE86
ftpconfig
ftpconfig(1M) System Administration Commands ftpconfig(1M)
NAME
ftpconfig - set up anonymous FTP
SYNOPSIS
ftpconfig [ftpdir]
ftpconfig -d ftpdir
DESCRIPTION
The ftpconfig script is executed by the super user to set up anonymous FTP. Anonymous FTP allows users to remotely log on to the FTP server
by specifying the user name ftp or anonymous and the user's email address as password. The anonymous users are logged on to the FTP
Server and given access to a restricted file area with its own file system root. See chroot(2). The FTP area has its own minimal system
files.
This command will copy and set up all the components needed to operate an anonymous FTP server, including creating the ftp user account,
creating device nodes, copying /usr/lib files, and copying timezone data. The passwd and group files set up have been stripped down to
prevent malicious users from finding login names on the server. The anonymous file area will be placed under ftpdir. If the ftp user
account already exists, then the current FTP area is used, and the system files in it are updated. All other files are left untouched. This
command should be run to update the anonymous FTP area's configuration whenever a system patch is installed, or the system is upgraded.
OPTIONS
-d Create a new or update an existing ftpdir without creating or updating the ftp user account. Use this option when creating guest
FTP user accounts.
OPERANDS
The following operands are supported:
ftpdir The absolute pathname of the directory under which the anonymous FTP area is set up.
EXIT STATUS
The following exit values are returned:
0 Successful completion
1 Improper usage of the command
2 Command failed
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWftpu |
+-----------------------------+-----------------------------+
|Interface Stability |Evolving |
+-----------------------------+-----------------------------+
SEE ALSO
ftpaddhost(1M), in.ftpd(1M), useradd(1M), chroot(2), attributes(5)
SunOS 5.10 1 May 2003 ftpconfig(1M)