Sponsored Content
Full Discussion: copy prod data to QA
Top Forums UNIX for Dummies Questions & Answers copy prod data to QA Post 56571 by zomboo on Tuesday 5th of October 2004 06:54:34 PM
Old 10-05-2004
copy prod data to QA

We keep getting production files into an input directory.

These files will be processed three times a day.



8:00AM
1:30PM
5:30PM


file1.20041005_05303423.dat
File2.200041005_14232313.dat

Once the files are processed, they are archived immediately to prod/archive directory

Apart from these there is a script that runs early morning at 5.30am that copies all the files which are one day old or less that reside in prod/archive directory to QA input directory.

Eg

The first file above get processed by 8:00AM job and it archived to prod/archive directory.
Similarly the second file,gets processed by 1.30PM job

Now since the file that comes in production input directory after 5.30pm , don't get processed until 8am job in the next morning.The QA night job would not pick up this file because it is still in input directory of prod at that time(5.30am qa copy ).

This file copy from prod archive directory will only take place the following morning ie 1007 and since it is already two days old by then, QA doesn't pickup this file from prod/archive directory.

How do i solve this problem.What logic should I implement to inorder for QA job to pick post 5.30 PM files in prod directory.
If I increase the time from 1 day to 2 days then , the QA job will pickup the same files again.
I am not sure if I was clear in explaining , if you have
any specific doubts please mention and I shall respond to immediatley.

Your help is greatly appreciated.

z
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

What is $PROD ? Does it represent some Unix directory?

Hi , Could u tell me What is $PROD ? Does it represent some Unix directory? Regards Ashish Malviya (2 Replies)
Discussion started by: Ashishm
2 Replies

2. UNIX for Dummies Questions & Answers

copy, clear and keep to new data only

I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want... (1 Reply)
Discussion started by: sarge
1 Replies

3. Programming

Migrating C Executable in UNIX from DEV to PROD

Hi Is there any specific way to FTP a C executable from DEV to PROD. We recently changed a C program compiled in DEV, created EXE and tested fine. But when we moved the EXE to PROD. It did not work. We have tried restarting the sever too. Once we put back the old Exe it starts to work again. The... (1 Reply)
Discussion started by: rainbow29
1 Replies

4. AIX

db2 - copy data from one db to another

I need to take data from one database to another on the same machine. My first attempt has been using restore, but I am getting an error. Here is the command I am trying: db2 restore database prod into test I get the following error: The container is already in use. What would... (2 Replies)
Discussion started by: jyoung
2 Replies

5. AIX

-805 error in AIX UNIX accessing TEST DB from PROD

Hi, I am getting -805 error when i tried accessing TEST DB from PROD environment in AIX UNIX. Could anyone help me in this regard. Thx, Satish (1 Reply)
Discussion started by: satishstar2
1 Replies

6. Shell Programming and Scripting

Awk sub command - Prod - Urgent

Hi I have this check in file for replacing text in unix .This code use to work in linux but stopped working when we moved to unix. cat xyz.dat | awk '/\x07/{sub(/\"/,"")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk '/\x07/{sub(/\"\,\"/,"\x07")};{print}'|awk... (5 Replies)
Discussion started by: er_zeeshan05
5 Replies

7. Solaris

Copy data over a TB

Hi All, We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs. Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs. Please recommend the most reliable... (2 Replies)
Discussion started by: vishalaswani
2 Replies

8. Shell Programming and Scripting

Copy and paste data

I need to copy from specified lines and paste the data into several other lines. XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x ...... XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x... (13 Replies)
Discussion started by: ncwxpanther
13 Replies

9. Red Hat

Prod runs RHEL6 but pprod uses RHEL5??

Hi, I am currently building out a new production environment. Our current prod env uses RHEL5.8 but I am thinking of building out a RHEL6 environment since a complete end-to-end testing will need to take place prior to go-live anyway. Plus it is an ideal time to upgrade the OS across the... (4 Replies)
Discussion started by: Duffs22
4 Replies

10. Shell Programming and Scripting

Best way to point/update a file during PROD and BCP failover.

Hi All, In UNIX servers we are switching from DR to PROD. After switching to DR we need to update some configuration files which contains the server names. Ex - If we switch to BCP we need to update BCP server name. If we switch back to PROD we need to update PROD server name. I... (1 Reply)
Discussion started by: Girish19
1 Replies
TAR(1)							      General Commands Manual							    TAR(1)

NAME
tar - archiver SYNOPSIS
tar key [ file ... ] DESCRIPTION
Tar saves and restores file trees. It is most often used to transport a tree of files from one system to another. The key is a string that contains at most one function letter plus optional modifiers. Other arguments to the command are names of files or directories to be dumped or restored. A directory name implies all the contained files and subdirectories (recursively). The function is one of the following letters: c Create a new archive with the given files as contents. x Extract the named files from the archive. If a file is a directory, the directory is extracted recursively. Modes are restored if possible. If no file argument is given, extract the entire archive. If the archive contains multiple entries for a file, the lat- est one wins. t List all occurrences of each file in the archive, or of all files if there are no file arguments. r The named files are appended to the archive. The modifiers are: v (verbose) Print the name of each file treated preceded by the function letter. With t, give more details about the archive entries. f Use the next argument as the name of the archive instead of the default standard input (for keys x and t) or standard output (for keys c and r). u Use the next (numeric) argument as the user id for files in the output archive. This is only useful when moving files to a non-Plan 9 system. g Use the next (numeric) argument as the group id for files in the output archive. EXAMPLES
Tar can be used to copy hierarchies thus: {cd fromdir; tar c .} | {cd todir; tar x} SOURCE
/sys/src/cmd/tar.c SEE ALSO
ar(1), bundle(1), tapefs(1) BUGS
There is no way to ask for any but the last occurrence of a file. File path names are limited to 100 characters. The tar format allows specification of links and symbolic links, concepts foreign to Plan 9: they are ignored. TAR(1)
All times are GMT -4. The time now is 06:57 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy