Sponsored Content
Top Forums Shell Programming and Scripting Problem in Downloading one day old files from FTP site Post 302275126 by JerryHone on Friday 9th of January 2009 10:32:13 AM
Old 01-09-2009
Hmmm! Smilie
The OS on the local server where you're running your script won't affect anything. As I said previously, the 'ls' is actually being run by the remote server FTP daemon, so it all depends how that machine is setup. For the Sun servers that I connect to, both 'ls' and 'ls -l' are viable commands.
Can you rsh (remote shell) to the FTP server and pull back any file information that way,or even use rcp to fetch them?
Can you get the remote file system mounted on your local server so you don't need to use FTP at all?
Or get whatever process generates the files that you're retrieving to date/timestamp them ie <filename>.20090109_152500?

If none of those, I think I'm all out of ideas!

Jerry
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Pulling a list of files from FTP site in a shell script

Hi, I am writting a shell script which will pull a list files (mentioned in one file 1.txt) from external FTP site (for ex: ftp://abcd.efghijk.com/). The 1.txt is in my local unix directory. I have username and password to connect the external FTP site. Also before I pull the files, I need... (0 Replies)
Discussion started by: spatra
0 Replies

2. Shell Programming and Scripting

script for download files from ftp site

I'm new to scripting. I'm trying to write a script to download files from ftp site, the following is the script and the message i get after running the script. no files were downloaded :( Thanks advance! script: #!/usr/bin/ksh DAY=`date --date="-1 days" +%y%m%d` ftp -v -n "ftp.address" <<... (5 Replies)
Discussion started by: tiff-matt
5 Replies

3. Shell Programming and Scripting

Download previous day files through FTP

Hi All, I have a scenario where I need to download the previous day modified files from other server to my server through FTP . Could any one please send me the shell script for the same. I used the following but I dont know how to proceed after this. ftp -n -i -v $IP <<ENDOFinPUT >>... (3 Replies)
Discussion started by: sarathchandrach
3 Replies

4. Shell Programming and Scripting

shell script - ftp downloading serveral files without mget

Hello guys, i'm searching for a solution how to download all files from root-directory of an ftp-server through an ftp proxy getting through the ftp proxy and download one file with get ist no problem, but mget * does nothing! ftp -n -i -v <<EOF open proxyHost proxyPort user... (19 Replies)
Discussion started by: macProgger23
19 Replies

5. Shell Programming and Scripting

Expect - get, then move files within FTP site?

Trying to do the following, and it looks like Expect is probably my best bet. Any help greatly appreciated 1) Log onto ftp site 2) Go to folder 3) GET all files matching basename*.txt 4) MOVE those files to a subfolder on the ftp site. I don't need to move it on MY computer, I want to move... (2 Replies)
Discussion started by: mbourgon
2 Replies

6. Shell Programming and Scripting

Downloading FTP Files

Hi every one, I have the requirement to download the files from FTP and move those files to unix box. Once after coping the files, i need to remove the files in FTP. I'm a newbie in Unix script. Can you please suggest a script for this.. Thanks in advance.. (2 Replies)
Discussion started by: Murali4u
2 Replies

7. Shell Programming and Scripting

Batch downloading images from a site.

So there is a forum thread (with 100+ pages)where people have posted images, which on a 3rd party site like imgur or imageshack. I'm trying to download all those images. I tried wget -r -l1 --no-parent -nH -nd -P/tmp -A".gif,.jpg" LINK but this doesn't download it. Does anything know a... (1 Reply)
Discussion started by: Howkisl
1 Replies

8. UNIX for Dummies Questions & Answers

current day remote files from FTP

Hi All, I have to work on a korn shell script to pick up only the current day files dropped on the remote server (using ftp). The file do not have daytimestamp on it. It has to be based on server time (AIX) The file naming convention is "test_file.txt" When I log in into the ftp account... (15 Replies)
Discussion started by: pavan_test
15 Replies

9. SCO

FTP problem with site exec command

Hello dear Users, I am for the first time in this forum. I come from Germany. Please excuse my bad englisch. My OS is SCO open Server Release 5. I have a problem whith FTP and the command "site exec" if I use the command "ftp> site chmod 777 /tmp/startkpf.sc 200 CHMOD command successful. ... (8 Replies)
Discussion started by: fla5do
8 Replies

10. Shell Programming and Scripting

To merge files on FTP site before getting them

I have a job that connects to FTP site, rename, get, delete a file and then process it. The renaming is done in consideration of this is one file name into which data is being accumulated many times within 24 hour cycle. This is what happens now: ftp -i $FTPHOST <<-EOF ren... (3 Replies)
Discussion started by: migurus
3 Replies
ncftpput(1)						      General Commands Manual						       ncftpput(1)

NAME
ncftpput - Internet file transfer program for scripts SYNOPSIS
ncftpput [options] remote-host remote-directory local-files... ncftpput -f login.cfg [options] remote-directory local-files... ncftpput -c remote-host remote-path-name < stdin OPTIONS
Command line flags: -u XX Use username XX instead of anonymous. -p XX Use password XX with the username. -P XX Use port number XX instead of the default FTP service port (21). -j XX Use account XX in supplement to the username and password (deprecated). -d XX Use the file XX for debug logging. -a Use ASCII transfer type instead of binary. -m Attempt to make the remote destination directory before copying. -t XX Timeout after XX seconds. -U XX Use value XX for the umask. -v/-V Do (do not) use progress meters. The default is to use progress meters if the output stream is a TTY. -f XX Read the file XX for host, user, and password information. -A Append to remote files, instead of overwriting them. -T XX Upload into temporary files prefixed by XX. -S XX Upload into temporary files suffixed by XX. -R Recursive mode; copy whole directory trees. -r XX Redial a maximum of XX times until connected to the remote FTP server. -z/-Z Do (do not) try to resume transfers. The default is to not try to resume (-Z). -E Use regular (PORT) data connections. -F Use passive (PASV) data connections. The default is to use passive, but to fallback to regular if the passive connection fails or times out. -DD Delete local file after successfully uploading it. -y Try using "SITE UTIME" to preserve timestamps on remote host. Not many remote FTP servers support this, so it may not work. -b Run in background (by submitting a batch job and then spawning ncftpbatch). -bb Similar to -b option, but only submits the batch job. You will need to run ncftpbatch for the batch job to be processed. This is useful if you already have a ncftpbatch process running, or wish to have better control of when batch jobs are processed. For example, if you wanted to do background processing of three files all on the same remote server, it is more polite to use just one ncftpbatch process to process the three jobs sequentially, rather than having three ncftpbatch processes open three simultane- ous FTP sessions to the same server. -B XX Try setting the TCP/IP socket buffer size to XX bytes. -W XX Send raw FTP command XX after logging in. -X XX Send raw FTP command XX after each file transferred. -Y XX Send raw FTP command XX before logging out. The -W, -X, and -Y options are useful for advanced users who need to tweak behavior on some servers. For example, users accessing mainframes might need to send some special SITE commands to set blocksize and record format information. For these options, you can use them multiple times each if you need to send multiple commands. For the -X option, you can use the cookie %s to expand into the name of the file that was transferred. DESCRIPTION
The purpose of ncftpput is to do file transfers from the command-line without entering an interactive shell. This lets you write shell scripts or other unattended processes that can do FTP. It is also useful for advanced users who want to send files from the shell command line without entering an interactive FTP program such as ncftp. By default the program tries to open the remote host and login anonymously, but you can specify a username and password information. The -u option is used to specify the username to login as, and the -p option is used to specify the password. If you are running the program from the shell, you may omit the -p option and the program will prompt you for the password. Using the -u and -p options are not recommended, because your account information is exposed to anyone who can see your shell script or your process information. For example, someone using the ps program could see your password while the program runs. You may use the -f option instead to specify a file with the account information. However, this is still not secure because anyone who has read access to the information file can see the account information. Nevertheless, if you choose to use the -f option the file should look something like this: host sphygmomanometer.ncftp.com user gleason pass mypassword Don't forget to change the permissions on this file so no one else can read them. The -d option is very useful when you are trying to diagnose why a file transfer is failing. It prints out the entire FTP conversation to the file you specify, so you can get an idea of what went wrong. If you specify the special name stdout as the name of the debugging out- put file, the output will instead print to the screen. Using ASCII mode is helpful when the text format of your host differs from that of the remote host. For example, if you are sending a text file from a UNIX system to a Windows-based host, you could use the -a flag which would use ASCII transfer mode so that the file created on the Windows machine would be in its native text format instead of the UNIX text format. You can upload an entire directory tree of files by using the -R flag. Example: $ ncftpput -R pikachu.nintendo.co.jp /incoming /tmp/stuff This would create a /incoming/stuff hierarchy on the remote host. The -T and -S options are useful when you want to upload file to the remote host, but you don't want to use the destination pathname until the file is complete. Using these options, you will not destroy a remote file by the same name until your file is finished. These options are also useful when a remote process on the remote host polls a specific filename, and you don't want that process to see that file until you know the file is finished sending. Here is an example that uploads to the file /pub/incoming/README, using the filename /pub/incom- ing/README.tmp as a temporary filename: $ ncftpput -S .tmp bowser.nintendo.co.jp /pub/incoming /a/README A neat way to pipe the output from any local command into a remote file is to use the -c option, which denotes that you're using stdin as input. The following example shows how to make a backup and store it on a remote machine: $ tar cf - / | ncftpput -c sonic.sega.co.jp /usr/local/backup.tar DIAGNOSTICS
ncftpput returns the following exit values: 0 Success. 1 Could not connect to remote host. 2 Could not connect to remote host - timed out. 3 Transfer failed. 4 Transfer failed - timed out. 5 Directory change failed. 6 Directory change failed - timed out. 7 Malformed URL. 8 Usage error. 9 Error in login configuration file. 10 Library initialization failed. 11 Session initialization failed. AUTHOR
Mike Gleason, NcFTP Software (mgleason@ncftp.com). SEE ALSO
ncftpget(1), ncftp(1), ftp(1), rcp(1), tftp(1). LibNcFTP (http://www.ncftp.com/libncftp/). ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +--------------------+-----------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +--------------------+-----------------+ |Availability | SUNWncftp | +--------------------+-----------------+ |Interface Stability | Volatile | +--------------------+-----------------+ NOTES
Source for ncftp is available on http://opensolaris.org. Software NcFTP ncftpput(1)
All times are GMT -4. The time now is 09:55 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy