Check the file processed Completion


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Check the file processed Completion
# 1  
Old 09-11-2013
Check the file processed Completion

Hi,

I have a wierd requirement where i need to check for a file transfered to my Server and once it is completed i need to start processing my jobs.

My server is AIX 6.0 and i want to know is there some way in unix i can keep on checking the file and once it is completed successfully i can trigger my ETL jobs.

Thanks
Prasoon
# 2  
Old 09-11-2013
How do you transfer the file to the location? Can't you use return value of the download script as executing trigger for processing of your jobs?
# 3  
Old 09-11-2013
My source system is ftping the file to my server.
# 4  
Old 09-11-2013
Do you have access to that source system? Can you modify that ftp script?
# 5  
Old 09-11-2013
If that script is sending a file via ftp it should open an ftp connection. What about checking on state of that connection?
# 6  
Old 09-11-2013
We get asked this question very, very frequently.

Bottom line, it's the sending thing's job to tell you when it's done, because the receiver can't tell the difference between a finished upload, a stalled upload, or an aborted upload -- all three will have a file sitting there unchanged for long periods of time.

One of the best ways for the uploader to inform you of a completed upload is:
  • Upload the file to /path/to/temporary/file
  • In the same FTP session, rename /path/to/temporary/file /path/to/destination/file

As long as /path/to/temporary/ and /path/to/destination/ are on the same partition, this guarantees that files always appear in /path/to/destination/ whole, never partial files or in-progress uploads.

Last edited by Corona688; 09-11-2013 at 06:51 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Check whether file is processed in a control file list

I've a list of files which got processed in Target table A and stored in a control file(list of control files). I've want to trigger another process (later) based on this list of files and load into Target table B and continue running this process until this file list is exhuasted. How do I come... (1 Reply)
Discussion started by: manojg9
1 Replies

2. Shell Programming and Scripting

Identifying the file completion

Hi, A script is running for multiple databases so data is also being populated for multiple DBs in a.txt file. I need to rename this file once all the data is populated. Kindly suggest me How can I check once file is populated completely before renaming? Thanks in advance. (3 Replies)
Discussion started by: ravigupta2u
3 Replies

3. UNIX for Dummies Questions & Answers

File processed in Unix had issue open using notepad

Dear all, I had a columned based file after processed from my script. In unix platform, my file is ok, with all columns sorted out nicely. But when i open in windows notepad, the columns are running out of order. Can some one help?? Thanks alot in advance (4 Replies)
Discussion started by: ymeyaw
4 Replies

4. Shell Programming and Scripting

Auto completion of file name in KSH.

Hi All, I am using SunOS 5.8 verison with KSH shell. My problem is I am not getting auto completion of file name on pressing of TAB or ESC key. While pressing ESC key , '^[' is getting printed . TAB is printing doin nothin but jus printing tab. What should I do to get auto completion of... (2 Replies)
Discussion started by: Sooraj_Linux
2 Replies

5. Shell Programming and Scripting

File name auto completion not working in KSH.Please help

Hi All, I am using SunOS 5.8 verison with KSH shell. My problem is I am not getting auto completion of file name on pressing of TAB or ESC key. While pressing ESC key , '^[' is getting printed . TAB is printing doin nothin but jus printing tab. What should I do to get auto completion of... (3 Replies)
Discussion started by: Sooraj_Linux
3 Replies

6. UNIX for Advanced & Expert Users

Check latest time where theres the word 'processed' in logfile

Hi, Im doing a project to check the latest time with the word 'processed' in a logfile. the time range is within 2 hours before the curent datetime to present. For example: Current datetime is 'October 6 2009 8:00AM' --- HKT So the time range that need to check is from 'October 6... (1 Reply)
Discussion started by: romanne
1 Replies

7. UNIX for Dummies Questions & Answers

Script to check process completion

Hi, OS - Unix Iam doing the following: after login to the unix box 1. change directory 2. run a shell script "preinstall.sh" 3. This takes apprx 5 mins 4. after which i use to change permission of a file "installhub.sh" (this file is generated from the previous step). Is there anyway... (2 Replies)
Discussion started by: kenkanya
2 Replies

8. Shell Programming and Scripting

Check for FTP completion

Hello, I am sure a lot of you have come across this situation, and I want to know how you have or would handle this situation: - A file gets ftp'ed (import) regularly to a directory into our environment. Is there a way to check whether this file has completed ftp'ing. * I don't want my... (1 Reply)
Discussion started by: ChicagoBlues
1 Replies

9. Shell Programming and Scripting

Ensure the file completion ?

Hi, I would like to copy a file from one location to another. But that particular file is not fully loaded. I like to copy a file once it's fully loaded or complete file. How to ensure whether file is fully loaded or complete file?. -Thambi (5 Replies)
Discussion started by: thambi
5 Replies

10. Shell Programming and Scripting

file name completion

I'ld like to enable file name completion in ksh88 on AIX 5.2. My terminal is set to xterm. I've set the shell editor to emacs and ampped the arrow keys. Is there a way to map the tab key to a command like ESC= or any other file name completion command in emacvs that I may be not aware of since I'm... (1 Reply)
Discussion started by: rein
1 Replies
Login or Register to Ask a Question