02-14-2008
For solving your problem, 3 solutions come to my mind:
1) If you are ABSOLUTELY sure that all the transferred files are greater than, for example, 1000000 bytes, you can easily filter out only the files you're interested in with a simple ls/awk script which checks the file size.
2) You can check if the files are in the middle of the transferring by issuing the "fuser" command over every file and check if there is one or more process accessing it. If so, the examined file is incomplete.
3) You have to transfer an empty "flag" file after the real data file has been transferred to the destination. In this manner you can pick up only the files which will have a corresponding flag file and ignore all the others. I think this is the best and reliable solution ( or at least, the one I prefer and regularly adopt in doing things like this
)
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi all,
Is there any way I can check a file for the linefeed character at the end of the file, and append one only if it is missing (ie. Incomplete last line)?
Need to do this because I need to write a script to process files FTP-ed over from various machines, which may or may not be... (1 Reply)
Discussion started by: ziyi
1 Replies
2. Shell Programming and Scripting
Hi folks,
I am using the join command to join two files on a common field as follows:
File1.txt
Adsorption|H01.181.529.047
Adult|M01.060.116
Children|M01.055
File2.txt
5|Adsorption|C0001674
7|Adult|C000001
6|Children|C00002
join -i -t "|" -a 2 -1 1 -2 2 File1.txt File2.txt
This... (7 Replies)
Discussion started by: s0460205
7 Replies
3. Shell Programming and Scripting
I'm running Fedora Core 6 as an FTP server on a powerMac G4...
I'm trying to create a script to remove files older than 3 days...
I'm able to find all data older than 3 days but it finds hidden files such as
/home/ftp/goossens/.canna
/home/ftp/goossens/.kde... (4 Replies)
Discussion started by: James_UK
4 Replies
4. Solaris
On Solaris, suppose there is a directory 'dir'.
Log files of size approx 1MB are continuously being
deposited here by scp command. I have a script that scans
this dir every 5 mins and moves away the log files that
have been deposited so far.
How do I design my script so that I pick up *only*... (6 Replies)
Discussion started by: sentak
6 Replies
5. Shell Programming and Scripting
Is there a way to customize ls to ignore files ending with ~ and #? (those are Emacs backup and auto-save files). I found -B option, which only ignores ~ files (2 Replies)
Discussion started by: yaroslavvb
2 Replies
6. UNIX for Dummies Questions & Answers
Sorry for the odd title, but I couldn't think of an easy way to describe my issue.
Background
I have a home security system that continually sends (via FTP) 4 different still images to a directory on my personal website - cam0.jpg, cam1.jpg, etc. I've written an extremely basic html script to... (4 Replies)
Discussion started by: CinciJeff
4 Replies
7. Shell Programming and Scripting
Hi All,
I am bit puzzled with this requirement where I need to list the files in a directory. However, files are being continuously written to this folder through FTP. Hence I need to exclude the file which is being written at the time of listing the directory. I thought of using file time... (5 Replies)
Discussion started by: angshuman
5 Replies
8. Shell Programming and Scripting
i am trying to recursively save a remote FTP server but exclude the files immediately under a directory directory1
wget -r -N ftp://user:pass@hostname/directory1
I want to keep these which may have more files under them
directory1/dir1/file.jpg
directory1/dir2/file.jpg... (16 Replies)
Discussion started by: vanessafan99
16 Replies
9. Red Hat
Hi,
Need help for the below scenario..
Its a linux os snapshot which has been taken based on taking snapshot using lvcreate..while taking rootvg it taking an dump file of 2GB unnecessarily..
So any tricks to avoid the dump file while creating snapshot using lvcreate (0 Replies)
Discussion started by: ksgnathan
0 Replies
10. UNIX for Beginners Questions & Answers
Hello All,
May i please know how do i ensure my split command would NOT generate incomplete output files like below, the last lines in each file is missing some columns or last line is complete.
split -b 50GB File File_
File_aa
|551|70210203|xxxxxxx|12/22/2010 20:44:58|11/01/2010... (1 Reply)
Discussion started by: Ariean
1 Replies
LEARN ABOUT CENTOS
licensecheck
LICENSECHECK(1) LICENSECHECK(1)
NAME
licensecheck - simple license checker for source files
SYNOPSIS
licensecheck --help|--version
licensecheck [--no-conf] [--verbose] [--copyright] [-l|--lines=N] [-i|--ignore=regex] [-c|--check=regex] [-m|--machine] [-r|--recursive]
list of files and directories to check
DESCRIPTION
licensecheck attempts to determine the license that applies to each file passed to it, by searching the start of the file for text
belonging to various licenses.
If any of the arguments passed are directories, licensecheck will add the files contained within to the list of files to process.
OPTIONS
--verbose, --no-verbose
Specify whether to output the text being processed from each file before the corresponding license information.
Default is to be quiet.
-l=N, --lines=N
Specify the number of lines of each file's header which should be parsed for license information. (Default is 60).
-i=regex, --ignore=regex
When processing the list of files and directories, the regular expression specified by this option will be used to indicate those which
should not be considered (e.g. backup files, VCS metadata).
-r, --recursive
Specify that the contents of directories should be added recursively.
-c=regex, --check=regex
Specify a pattern against which filenames will be matched in order to decide which files to check the license of.
The default includes common source files.
--copyright
Also display copyright text found within the file
-m, --machine
Display the information in a machine readable way, i.e. in the form <file><tab><license>[<tab><copyright>] so that it can be easily
sorted and/or filtered, e.g. with the awk and sort commands. Note that using the --verbose option will kill the readability.
--no-conf, --noconf
Do not read any configuration files. This can only be used as the first option given on the command-line.
CONFIGURATION VARIABLES
The two configuration files /etc/rpmdevtools/devscripts.conf and ~/.devscripts are sourced by a shell in that order to set configuration
variables. Command line options can be used to override configuration file settings. Environment variable settings are ignored for this
purpose. The currently recognised variables are:
LICENSECHECK_VERBOSE
If this is set to yes, then it is the same as the --verbose command line parameter being used. The default is no.
LICENSECHECK_PARSELINES
If this is set to a positive number then the specified number of lines at the start of each file will be read whilst attempting to
determine the license(s) in use. This is equivalent to the --lines command line option.
LICENSE
This code is copyright by Adam D. Barratt <adam@adam-barratt.org.uk>, all rights reserved; based on a script of the same name from the KDE
SDK, which is copyright by <dfaure@kde.org>. This program comes with ABSOLUTELY NO WARRANTY. You are free to redistribute this code under
the terms of the GNU General Public License, version 2 or later.
AUTHOR
Adam D. Barratt <adam@adam-barratt.org.uk>
Debian Utilities 2014-06-09 LICENSECHECK(1)