Sponsored Content
Full Discussion: ETL Complex FTP
Top Forums Shell Programming and Scripting ETL Complex FTP Post 302107777 by ganesh123 on Tuesday 20th of February 2007 04:09:27 PM
Old 02-20-2007
ETL Complex FTP

Hi Gurus,

I want to perform following task :

I am getting new text file every month in CD format.
Now by using 3rd party ETL tool which is installed in UNIX I want to run the job whose input file will be this file from CD. So I need to FTP text file from my client machine CD drive to UNIX. For this I want to write the script and use this script as before job subroutine in ETL job.

Any ideas gurus plz share?
 

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Complex Script

hey... i had a big problem with my professor i have 3 simple archives in.txt -> had all timestamps of users logon (100lines) ex. 111111 222222 333333 out.txt -> had all timestamps of users logof (100lines) ex. 111113 222225 333332 commands.txt... (9 Replies)
Discussion started by: beandj
9 Replies

2. Shell Programming and Scripting

Unix Script via ETL

while ;do sleep 5; done Hi, We do run the ETL jobs via DataStage. We do have 30 sequences which calls 1 update query. Most of the time when the update query is run by many countries, the ETL job gets hang. Becuase of this we have written a above script. We do in the script i.,e if... (1 Reply)
Discussion started by: dsnaveen
1 Replies

3. UNIX for Dummies Questions & Answers

Unix Shell Script on Tidal schedular for ETL

Hello I am very new to Unix scripting, I am using informatica etl,which is schedule by tidal enterprise. I have a scenario where assume that Tidal only knows how to run jobs at a given time and does not know how to retry. So i want to know weather can i write a shell script such that... (1 Reply)
Discussion started by: bluestarmoon
1 Replies

4. Shell Programming and Scripting

Script to check ETL standards in an Informatica mapping

Hi, Script to check the ETL standards in an informatica mapping ( xml file ). Example: To check the naming standard of mapping . To check the transformation naming convention. To check the datatypes. To the session name , it should start with s. To check the workflow name , it should... (0 Replies)
Discussion started by: srimadhuri
0 Replies

5. Shell Programming and Scripting

Shell script executed from Informatica ETL tool is spawning 2 processes for one script

Hi, I am having a shell script which has a while loop as shown below. while do sleep 60 done I am executing this script from Informatica ETL tool command task from where we can execute UNIX commands/scripts. When i do that, i am seeing 2 processes getting started for one script... (2 Replies)
Discussion started by: chekusi
2 Replies

6. Shell Programming and Scripting

Complex if then else

for i in $(condition ONE);do for e in $(CONDITION TWO);do if ; then command 1 command 2 command 3 else if ; then command 1 command 2 command 3 else if ; then ... (6 Replies)
Discussion started by: elilmal
6 Replies
SGE_SHEPHERD(8) 				      Sun Grid Engine Administrative Commands					   SGE_SHEPHERD(8)

NAME
sge_shepherd - Sun Grid Engine single job controlling agent SYNOPSIS
sge_shepherd DESCRIPTION
sge_shepherd provides the parent process functionality for a single Sun Grid Engine job. The parent functionality is necessary on UNIX systems to retrieve resource usage information (see getrusage(2)) after a job has finished. In addition, the sge_shepherd forwards signals to the job, such as the signals for suspension, enabling, termination and the Sun Grid Engine checkpointing signal (see sge_ckpt(1) for details). The sge_shepherd receives information about the job to be started from the sge_execd(8). During the execution of the job it actually starts up to 5 child processes. First a prolog script is run if this feature is enabled by the prolog parameter in the cluster configura- tion. (See sge_conf(5).) Next a parallel environment startup procedure is run if the job is a parallel job. (See sge_pe(5) for more infor- mation.) After that, the job itself is run, followed by a parallel environment shutdown procedure for parallel jobs, and finally an epilog script if requested by the epilog parameter in the cluster configuration. The prolog and epilog scripts as well as the parallel environment startup and shutdown procedures are to be provided by the Sun Grid Engine administrator and are intended for site-specific actions to be taken before and after execution of the actual user job. After the job has finished and the epilog script is processed, sge_shepherd retrieves resource usage statistics about the job, places them in a job specific subdirectory of the sge_execd(8) spool directory for reporting through sge_execd(8) and finishes. sge_shepherd also places an exit status file in the spool directory. This exit status can be viewed with qacct -j JobId (see qacct(1)); it is not the exit status of sge_shepherd itself but of one of the methods executed by sge_shepherd. This exit status can have several mean- ings, depending on in which method an error occurred (if any). The possible methods are: prolog, parallel start, job, parallel stop, epi- log, suspend, restart, terminate, clean, migrate, and checkpoint. The following exit values are returned: 0 All methods: Operation was executed successfully. 99 Job script, prolog and epilog: When FORBID_RESCHEDULE is not set in the configuration (see sge_conf(5)), the job gets re-queued. Otherwise see "Other". 100 Job script, prolog and epilog: When FORBID_APPERROR is not set in the configuration (see sge_conf(5)), the job gets re-queued. Oth- erwise see "Other". Other Job script: This is the exit status of the job itself. No action is taken upon this exit status because the meaning of this exit status is not known. Prolog, epilog and parallel start: The queue is set to error state and the job is re-queued. Parallel stop: The queue is set to error state, but the job is not re-queued. It is assumed that the job itself ran successfully and only the clean up script failed. Suspend, restart, terminate, clean, and migrate: Always successful. Checkpoint: Success, except for kernel checkpointing: checkpoint was not successful, did not happen (but migration will happen by Sun Grid Engine). RESTRICTIONS
sge_shepherd should not be invoked manually, but only by sge_execd(8). FILES
sgepasswd contains a list of user names and their corresponding encrypted passwords. If available, the password file will be used by sge_shepherd. To change the contents of this file please use the sgepasswd command. It is not advised to change that file manu- ally. <execd_spool>/job_dir/<job_id> job specific directory SEE ALSO
sge_intro(1), sge_conf(5), sge_execd(8). COPYRIGHT
See sge_intro(1) for a full statement of rights and permissions. SGE 6.2u5 $Date$ SGE_SHEPHERD(8)
All times are GMT -4. The time now is 09:00 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy