copy prod data to QA Post: 56571

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers copy prod data to QA Post 56571 by zomboo on Tuesday 5th of October 2004 06:54:34 PM

10-05-2004

Registered User

copy prod data to QA

We keep getting production files into an input directory.

These files will be processed three times a day.

8:00AM
1:30PM
5:30PM

file1.20041005_05303423.dat
File2.200041005_14232313.dat

Once the files are processed, they are archived immediately to prod/archive directory

Apart from these there is a script that runs early morning at 5.30am that copies all the files which are one day old or less that reside in prod/archive directory to QA input directory.

Eg

The first file above get processed by 8:00AM job and it archived to prod/archive directory.
Similarly the second file,gets processed by 1.30PM job

Now since the file that comes in production input directory after 5.30pm , don't get processed until 8am job in the next morning.The QA night job would not pick up this file because it is still in input directory of prod at that time(5.30am qa copy ).

This file copy from prod archive directory will only take place the following morning ie 1007 and since it is already two days old by then, QA doesn't pickup this file from prod/archive directory.

How do i solve this problem.What logic should I implement to inorder for QA job to pick post 5.30 PM files in prod directory.
If I increase the time from 1 day to 2 days then , the QA job will pickup the same files again.
I am not sure if I was clear in explaining , if you have
any specific doubts please mention and I shall respond to immediatley.

Your help is greatly appreciated.

z

zomboo

View Public Profile for zomboo

Find all posts by zomboo

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

What is $PROD ? Does it represent some Unix directory?

Hi , Could u tell me What is $PROD ? Does it represent some Unix directory? Regards Ashish Malviya

2. UNIX for Dummies Questions & Answers

copy, clear and keep to new data only

I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want...

3. Programming

Migrating C Executable in UNIX from DEV to PROD

Hi Is there any specific way to FTP a C executable from DEV to PROD. We recently changed a C program compiled in DEV, created EXE and tested fine. But when we moved the EXE to PROD. It did not work. We have tried restarting the sever too. Once we put back the old Exe it starts to work again. The...

4. AIX

db2 - copy data from one db to another

I need to take data from one database to another on the same machine. My first attempt has been using restore, but I am getting an error. Here is the command I am trying: db2 restore database prod into test I get the following error: The container is already in use. What would...

5. AIX

-805 error in AIX UNIX accessing TEST DB from PROD

Hi, I am getting -805 error when i tried accessing TEST DB from PROD environment in AIX UNIX. Could anyone help me in this regard. Thx, Satish

6. Shell Programming and Scripting

Awk sub command - Prod - Urgent

Hi I have this check in file for replacing text in unix .This code use to work in linux but stopped working when we moved to unix. cat xyz.dat | awk '/\x07/{sub(/\"/,"")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk...

7. Solaris

Copy data over a TB

Hi All, We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs. Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs. Please recommend the most reliable...

8. Shell Programming and Scripting

Copy and paste data

I need to copy from specified lines and paste the data into several other lines. XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x ...... XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x...

9. Red Hat

Prod runs RHEL6 but pprod uses RHEL5??

Hi, I am currently building out a new production environment. Our current prod env uses RHEL5.8 but I am thinking of building out a RHEL6 environment since a complete end-to-end testing will need to take place prior to go-live anyway. Plus it is an ideal time to upgrade the OS across the...

10. Shell Programming and Scripting

Best way to point/update a file during PROD and BCP failover.

Hi All, In UNIX servers we are switching from DR to PROD. After switching to DR we need to update some configuration files which contains the server names. Ex - If we switch to BCP we need to update BCP server name. If we switch back to PROD we need to update PROD server name. I...

LEARN ABOUT DEBIAN

dwww-refresh-cache

DWWW-REFRESH-CACHE(8)						      Debian						     DWWW-REFRESH-CACHE(8)

NAME

       dwww-refresh-cache - rebuilds dwww cache directory

SYNOPSIS

       dwww-refresh-cache

DESCRIPTION

       dwww-refresh-cache  is  a  simple  shell  script,  which  deletes  outdated  cache  files and rebuilds contents of the dwww cache directory
       /var/cache/dwww.  In default installation, the script is called from /etc/cron.daily/dwww, so the cache is refreshed every day.

CONFIGURATION VARIABLES

       DWWW_KEEPDAYS
	      Specifies, how many days documents that have not been accessed should be kept in the cache.  Default is 10 days.

       DWWW_QUICKFIND_DB
	      Location	of  the  installed  packages  and  programs  cache  file,  generated  with  help   of	dwww-quickfind(8).    Default	is
	      /var/cache/dwww/quickfind.dat.

       DWWW_DOCBASE2PKG_DB
	      Location	of  the  cache	file,  which  maps installed doc-base files to packages names, used by the dwww-build-menu(8).	Default is
	      /var/cache/dwww/docbase2pkg.dat.

FILES

       /etc/dwww/dwww.conf
	      Configuration file for dwww(7).

       /var/cache/dwww
	      dwww cache directory.

       /etc/cron.daily/dwww.
	      dwww daily cron job

SEE ALSO

       dwww(7), dwww-build-menu(8), dwww-cache(8), dwww-find(8).

AUTHOR

       Robert Luberda.
       See dwww(7), for copyrights and stuff.

dwww 1.11.1							February 15th, 2009					     DWWW-REFRESH-CACHE(8)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

What is $PROD ? Does it represent some Unix directory?

Discussion started by: Ashishm

2. UNIX for Dummies Questions & Answers

copy, clear and keep to new data only

Discussion started by: sarge

3. Programming

Migrating C Executable in UNIX from DEV to PROD

Discussion started by: rainbow29

4. AIX

db2 - copy data from one db to another

Discussion started by: jyoung