copy prod data to QA


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers copy prod data to QA
# 1  
Old 10-05-2004
copy prod data to QA

We keep getting production files into an input directory.

These files will be processed three times a day.



8:00AM
1:30PM
5:30PM


file1.20041005_05303423.dat
File2.200041005_14232313.dat

Once the files are processed, they are archived immediately to prod/archive directory

Apart from these there is a script that runs early morning at 5.30am that copies all the files which are one day old or less that reside in prod/archive directory to QA input directory.

Eg

The first file above get processed by 8:00AM job and it archived to prod/archive directory.
Similarly the second file,gets processed by 1.30PM job

Now since the file that comes in production input directory after 5.30pm , don't get processed until 8am job in the next morning.The QA night job would not pick up this file because it is still in input directory of prod at that time(5.30am qa copy ).

This file copy from prod archive directory will only take place the following morning ie 1007 and since it is already two days old by then, QA doesn't pickup this file from prod/archive directory.

How do i solve this problem.What logic should I implement to inorder for QA job to pick post 5.30 PM files in prod directory.
If I increase the time from 1 day to 2 days then , the QA job will pickup the same files again.
I am not sure if I was clear in explaining , if you have
any specific doubts please mention and I shall respond to immediatley.

Your help is greatly appreciated.

z
# 2  
Old 10-06-2004
files to QA

why are you using age of the file to determine whether it's already copied or not?

Use the creation time of the archive-files to identify them as files-yet-to-be-copied to QA.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Best way to point/update a file during PROD and BCP failover.

Hi All, In UNIX servers we are switching from DR to PROD. After switching to DR we need to update some configuration files which contains the server names. Ex - If we switch to BCP we need to update BCP server name. If we switch back to PROD we need to update PROD server name. I... (1 Reply)
Discussion started by: Girish19
1 Replies

2. Red Hat

Prod runs RHEL6 but pprod uses RHEL5??

Hi, I am currently building out a new production environment. Our current prod env uses RHEL5.8 but I am thinking of building out a RHEL6 environment since a complete end-to-end testing will need to take place prior to go-live anyway. Plus it is an ideal time to upgrade the OS across the... (4 Replies)
Discussion started by: Duffs22
4 Replies

3. Shell Programming and Scripting

Copy and paste data

I need to copy from specified lines and paste the data into several other lines. XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x ...... XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x... (13 Replies)
Discussion started by: ncwxpanther
13 Replies

4. Solaris

Copy data over a TB

Hi All, We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs. Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs. Please recommend the most reliable... (2 Replies)
Discussion started by: vishalaswani
2 Replies

5. Shell Programming and Scripting

Awk sub command - Prod - Urgent

Hi I have this check in file for replacing text in unix .This code use to work in linux but stopped working when we moved to unix. cat xyz.dat | awk '/\x07/{sub(/\"/,"")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk... (5 Replies)
Discussion started by: er_zeeshan05
5 Replies

6. AIX

-805 error in AIX UNIX accessing TEST DB from PROD

Hi, I am getting -805 error when i tried accessing TEST DB from PROD environment in AIX UNIX. Could anyone help me in this regard. Thx, Satish (1 Reply)
Discussion started by: satishstar2
1 Replies

7. AIX

db2 - copy data from one db to another

I need to take data from one database to another on the same machine. My first attempt has been using restore, but I am getting an error. Here is the command I am trying: db2 restore database prod into test I get the following error: The container is already in use. What would... (2 Replies)
Discussion started by: jyoung
2 Replies

8. Programming

Migrating C Executable in UNIX from DEV to PROD

Hi Is there any specific way to FTP a C executable from DEV to PROD. We recently changed a C program compiled in DEV, created EXE and tested fine. But when we moved the EXE to PROD. It did not work. We have tried restarting the sever too. Once we put back the old Exe it starts to work again. The... (1 Reply)
Discussion started by: rainbow29
1 Replies

9. UNIX for Dummies Questions & Answers

copy, clear and keep to new data only

I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want... (1 Reply)
Discussion started by: sarge
1 Replies

10. Shell Programming and Scripting

What is $PROD ? Does it represent some Unix directory?

Hi , Could u tell me What is $PROD ? Does it represent some Unix directory? Regards Ashish Malviya (2 Replies)
Discussion started by: Ashishm
2 Replies
Login or Register to Ask a Question