Visit Our UNIX and Linux User Community

Top Forums Shell Programming and Scripting Get Files from ftp which are uploaded recent week Post 302137775 by narramadan on Thursday 27th of September 2007 02:07:20 AM
Old 09-27-2007
Get Files from ftp which are uploaded recent week

Hi All,

Here is a brief scenario for my requirement ..

There is a directory in FTP Server, where would files be uploaded on weekly basic.

I need to get those files which are uploaded during this week and not the files which are uploaded the previous week and download them to locale directory

Can anyone of you guide me how to go with this case..

If you have any script to do this, please post here...

am totally new to shell script commands and special variables like $, $1 etc..

Thanks in Advance

Regards,
Madan N
 
Test Your Knowledge in Computers #90
Difficulty: Easy
If you open vi specify a path to a file that does not exist, vi will create a new, blank file at that location in the filesystem and open it.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To keep only the most recent files

Hi all, I'm running on a Sun Solaris machine. I would only want to keep the last 2 most recent files on 1 of my directory. Below shows my script, but it is incomplete. For the ?? part I do not know how to continue. please help:confused: DIR=/tmp/abc OUTPUT=/tmp/output.out... (1 Reply)
Discussion started by: *Jess*
1 Replies

2. UNIX for Advanced & Expert Users

automate backing up uploaded files

Hi, We are running FTP Server on UNIX (Solaris 9). Users login and upload (also download) files whenever required. Now, we have to automate the process which makes a copy of every file immediately after it gets uploaded to the FTP server (by any user). I've ruled out rsync,mirror,filesync... (2 Replies)
Discussion started by: prvnrk
2 Replies

3. AIX

script to ftp recent changed files

I am trying to write a script to ftp all files/directories changed in a 24hour period to another AIX server. I have wrote a script to generate a list of all files changed within a 24 hour period but dont know how to then ftp these to another server. How do incorporate ftp into this script? ... (2 Replies)
Discussion started by: RApds
2 Replies

4. UNIX and Linux Applications

PAssword protect uploaded files

Hi, Is it possible to make sure/test that all uploaded files to my FTP will be of .RAR format (that's easy) but also password protected? Thanks (0 Replies)
Discussion started by: saariko
0 Replies

5. Shell Programming and Scripting

i dont want to move files which are being uploaded 5 to 10 min ago

in /abc/jrd/ users are continuously uploading files memo*.txt i have created a memo.sh file in that i have written cd /abc/jrd/ mv memo*.txt /scripts/memo while files are being moved to this /scripts/memo users who are uploading new file are not getting fully copied i this path i want that... (0 Replies)
Discussion started by: rakesh_mumbai
0 Replies

6. UNIX for Advanced & Expert Users

i dont want to move files which are being uploaded 5 to 10 min ago

in /abc/jrd/ users are continuously uploading files memo*.txt i have created a memo.sh file in that i have written cd /abc/jrd/ mv memo*.txt /scripts/memo while files are being moved to this /scripts/memo users who are uploading new file are not getting fully copied i this path i want that... (1 Reply)
Discussion started by: rakesh_mumbai
1 Replies

7. UNIX for Advanced & Expert Users

i dont want files which are being uploaded 5 to 10 min ago.

i want to move files from A dir to B dir, say eg: mv *memo*.txt /scripts/memo/ but while doing this new files are being uploaded by users, i dont want files which are being uploaded 5 to 10 min ago. other wise even files which are being currently uploaded will get moved to /scripts/memo. (8 Replies)
Discussion started by: rakesh_mumbai
8 Replies

8. UNIX for Dummies Questions & Answers

File uploaded via FTP not visible from Command Line

I am using VSFTPD on amazon web services and have a remote service that uploads files to server via FTP. The files comes through fine and when I log in via FTP client I see them. The problem is the files are supposed to be moved once uploaded but the files are not visible via command line thus the... (2 Replies)
Discussion started by: theman0684
2 Replies

9. Shell Programming and Scripting

FTP command to get most recent file

Hello Experts... dir of FTP will list all the files in the directory. Is there any command or option of dir that will give me the most recent file only? Since I couldn't find any such thing, I thought of creating a log file (of FTP results) and work on this log file to determine the most recent... (2 Replies)
Discussion started by: juzz4fun
2 Replies

10. Linux

Get all the files from a FTP location with previous week's dates in the file names using Linux

I have a weird requirement where I have to get the files from a FTP(Lets say FTP1) location and place it on my current FTP(Lets say FTP2) location. The issue is, these are daily files (in a pattern Sales_YYYYMMDD_report.csv) and are placed every day on FTP1 and my process usually runs on Monday(eg.... (2 Replies)
Discussion started by: dhruuv369
2 Replies
DUPLOAD.CONF(5)                                                   Debian Project                                                   DUPLOAD.CONF(5)

NAME
dupload.conf - configuration file for dupload DESCRIPTION
The configuration file is rather straight forward Perl code as it's included by the dupload script via "do $config". The config file is read as Perl code! Any dupload.conf must begin with "package config;" because "config" is the namespace expected by dupload. For examples of the configuration please refer to the global configuration file /etc/dupload.conf. It contains associative arrays, each indexed by the nickname (see --to option of dupload), for the following items: fqdn [required] The fully qualified domain name (FQDN) of the nickname. method [optional] The transfer method. The available methods are: "ftp" (which is the default), "scp", "scpb" and "rsync" (over SSH). If you are using an upload queue, use FTP because it's fast. If you are using an authenticated host, always use scp or rsync via SSH, because FTP transmits the password in clear text. For scp and rsync to work properly, you have to setup the remote and local host to establish a ssh/slogin connection using .shosts/.rhosts or the files in ~/.ssh/. If you don't want or can't do that, you may find the scpb more convenient since it uploads in batch, reducing the number of password prompts. The only major caveat of the rsync and scpb options is that the files are processed in a batch mode, i.e. not separately, so in case of an error dupload won't be able to detect which part of the transfer failed, and just delete the .upload file completely. login [optional] The account name used to log into the FTP server. The default is "anonymous", should work with firewall logins too. incoming [required] Incoming directory, the directory we try to upload to. queuedir [optional] The directory we move the uploaded files to (after successful upload to incoming. Usually necessary only with some special upload queues. mailto [optional] Email address where the announcement about stable packages is sent. mailtx [optional] Email address where the announcement about unstable and experimental packages is sent. cc [optional] Email address where to send a copy address of the announcement. fullname [optional] Your full name, one that should appear in the announcement; If you leave this setting empty, the default will depend on your mail system. Usually the full name will be copied from the GCOS field in /etc/passwd. visibleuser [optional] Your username that should appear in the announcement. Defaults to "getlogin()". visiblename [optional] The host/domain name that appears as the part to the right of the @ character in the from-part of the announcement. Defaults to the value your local MTA likes. passive [optional] Set the passive mode for FTP transfers. Since dupload uses Net::FTP, you can also use the environment variable FTP_PASSIVE. options [optional] String that will be added verbatim to the command line of any scp or rsync calls done. dinstall_runs [optional] Tells dupload that the remote host runs dinstall (or equivalent) so that dupload won't send a duplicate announcement mail. The default is 0 (false), set it to 1 to enable it. nonus [optional] Tells dupload that the remote host is a valid destination for packages with non-US in their Section field, so that dupload doesn't warn about it. The default is 0 (false), set it to 1 to enable it. archive [optional] If set to 0 (false), adds a "X-No-Archive: yes" header in the announcement. The default is 1 (true). The configuration files also contain the following global variables: default_host [optional] The default host to upload to. The default value of this variable is unset. no_parentheses_to_fullname [optional] Prevents dupload to add parentheses around the full name when making mail announcements. Default is 0 (false), set it to 1 to enable it. HOOKS
Hooks are a powerful way to add actions which will be run before or after a dupload (like the preinst and postinst script of dpkg). You have two sort of hooks: pre-upload and post-upload. Both are simple shell commands (executed by "sh -c" so you can use any shell tricks). Pre-uploads are always run (even in dry mode) and stop dupload if they fail (failure being mesured by the hook's exit status). Post-uploads are only run when you are not in dry mode and only if the uploading succeeded. Both sorts of hooks are run for a given category: changes, sourcepackage, package, file or deb. changes This hook is run once per "changes" file (given as an argument to dupload) with the filename as its parameter. sourcepackage This hook is run once per "changes" file with the source package name and its version as its two parameters. package This hook is run once per binary package (a "deb" file) with the package name and its version as its two parameters. file This hook is run once per uploaded file, with the file name as its parameter. deb This hook is run once per binary package (a "deb" file) with the filename as its parameter. Syntax Hooks are defined in two Perl hashes, %preupload and %postupload, each indexed by category. In addition to the global hashes, each host entry has two fields with the same names, for the host-specific hooks. The shell command will be substituted first: %1 will be replace by the first argument, etc. Per-host or global hooks A hook can be global (for all the hosts) or it can be for a specific host. If there is no specific hook, for a given category, the global one is used. Examples This one runs lintian before uploading. It is global and guarantee that you will always upload lintian-free packages (thanks to lintian return status). $preupload{'deb'} = 'lintian -v -i %1'; This one just display the name and versions of successfully uploaded packages. $postupload{'package'} = 'echo PACKAGE %1 %2 uploaded'; Unlike the two others, this one is specific to one host, master. $cfg{master}{preupload}{'changes'} = "echo Uploading %1"; LOCATION
The configuration is searched as following: /etc/dupload.conf ~/.dupload.conf The latest entries override the former. ENVIRONMENT VARIABLES
Those of Net::FTP for the FTP method: FTP_FIREWALL FTP_PASSIVE AUTHOR
Heiko Schlittermann <heiko@lotte.sax.de> Stephane Bortzmeyer <bortzmeyer@debian.org> dupload 2.7.0 February 2011 DUPLOAD.CONF(5)

Featured Tech Videos

All times are GMT -4. The time now is 01:27 AM.
Unix & Linux Forums Content Copyright 1993-2020. All Rights Reserved.
Privacy Policy