Sponsored Content
Top Forums Shell Programming and Scripting Archive large debug files without cp Post 302183065 by firdousamir on Tuesday 8th of April 2008 07:24:29 AM
Old 04-08-2008
Archive large debug files without cp

Need some fine tuning advice:

I have a KSH programs croned to execute once a day. Which basically does the following simple operation:

for i in `ls`
do
cp $i $i.backup
>$i
gzip $i.backup
done


Basically cleanup the file after taking a backup.

Now the issue here is this directory will contain more than 12 files with >1GB each file and gets very nasty all time.

I considered an approach like

1. tar -cvf debug.tar ~/debug
2. > [All the files]

This approach also creates problem because there will be a big time gap between step 1 and 2. so all the info written between 1 and 2 will be lost.

Any advice on this?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Archive files

Hi All, I wrote this script: #!/bin/ksh while read DAYS ARCH_PATH do cd $ARCH_PATH find . \( -type d ! -name . -prune \) -o -type f -mtime +$DAYS -exec tar -cv f kay_`date +%d%m%y%H%M`.tar {} \; cd - done < filestoarchive.txt The problem is, in a folder of 7files, I would... (13 Replies)
Discussion started by: kayarsenal
13 Replies

2. Shell Programming and Scripting

Archive script old files

Hi All, Im trying to write a script to archive files based on the date the files were created. For example, if a group of files were created on 23rd August,I would have 230806.tar. I have a problem,I want the script to read a separately created file(readarchive.txt) to look for the path to... (1 Reply)
Discussion started by: kayarsenal
1 Replies

3. Shell Programming and Scripting

compare two files using while and sed .. debug my script please

Hi, I'm a newbie to Linux. I have not done programming before, but I accidentally stumble upon Linux scripts at work about 2 weeks ago. I got interested and write scripts to automate my job duties. I need to write a script to compare 2 files (very long list) side by side so it's easier to... (10 Replies)
Discussion started by: shamushamu
10 Replies

4. Solaris

Tar too large to archive. Use E function modifier.

hey all, i am trying to tar up a folder with sub folders the over all size will be about 70gb but when i use the normal command tar -cvf tar -cvf CLPSI_PRU_Escrow_31994.tar CLPSI_PRU_Escrow_31994 i get an error tar: CLPSI_PRU_Escrow_31994/dump1/PROD_SAE_jria3_dump.5 too large to archive. ... (9 Replies)
Discussion started by: dshakey
9 Replies

5. Shell Programming and Scripting

Archive Files

I have 15-20 files in a unix folder on daily basis, so i need to archive those 20 files as dated today and place that archived files in a new folder and has to remove those 20 files from that folder. so that i place 20 new files that comes for tomorrow. i need write a unix script to do this. ... (1 Reply)
Discussion started by: gaddamshashank
1 Replies

6. Shell Programming and Scripting

Divide large data files into smaller files

Hello everyone! I have 2 types of files in the following format: 1) *.fa >1234 ...some text... >2345 ...some text... >3456 ...some text... . . . . 2) *.info >1234 (7 Replies)
Discussion started by: ad23
7 Replies

7. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

8. Shell Programming and Scripting

Archive files which has more than one row

Hello Guys Please treat this as urgent . Can you please kindly help me to know how to archive files in a directory which has more than one row Thanks for your time and help!! (3 Replies)
Discussion started by: Pratik4891
3 Replies

9. UNIX for Dummies Questions & Answers

How to archive old files from the recently added 10 files?

Hi there, I am very new to unix and having trouble with a fairly simple statement: cd /user ls -t -c1 | sed -ne '11,$p' | mv xargs archive/ What I want the code to do is sort all files in a directory by timestamp, select all of the files after the 10th file, and then move those files... (3 Replies)
Discussion started by: DSIReady
3 Replies

10. Shell Programming and Scripting

Check files and archive the files using sftp

Hi, I have to check the files in another server using sftp to do that, below is the code i am going with #!/bin/bash export SRC_FOLDER=$1 export ARC_FOLDER=$2 HOST=as07u3456 USER=relfag sftp ${USER}@${HOST} <<EOF cd $SRC_FOLDER/DSCOR ls bye EOF echo "done" whatever the files i... (8 Replies)
Discussion started by: ursrami
8 Replies
VGCFGRESTORE(8) 					      System Manager's Manual						   VGCFGRESTORE(8)

NAME
vgcfgrestore - restore volume group descriptor area SYNOPSIS
vgcfgrestore [-d|--debug] [-f|--file filename] [-l[l]|--list] [-h|--help] [-M|--Metadatatype1|2] [-t|--test] [-v|--verbose] VolumeGroupName DESCRIPTION
vgcfgrestore allows you to restore the metadata of VolumeGroupName from a text backup file produced by vgcfgbackup. You can specify a backup file with --file. If no backup file is specified, the most recent one is used. Use --list for a list of the available backup and archive files of VolumeGroupName. OPTIONS
-l | --list -- List files pertaining to VolumeGroupName List metadata backup and archive files pertaining to VolumeGroupName. May be used with the -f option. Does not restore Vol- umeGroupName. -f | --file filename -- Name of LVM metadata backup file Specifies a metadata backup or archive file to be used for restoring VolumeGroupName. Often this file has been created with vgcfg- backup. See lvm for common options. REPLACING PHYSICAL VOLUMES
vgdisplay --partial --verbose will show you the UUIDs and sizes of any PVs that are no longer present. If a PV in the VG is lost and you wish to substitute another of the same size, use pvcreate --restorefile filename --uuid uuid (plus additional arguments as appropriate) to initialise it with the same UUID as the missing PV. Repeat for all other missing PVs in the VG. Then use vgcfgrestore --file filename to restore the volume group's metadata. SEE ALSO
lvm(8), vgcreate(8) Sistina Software UK LVM TOOLS 2.02.95(2) (2012-03-06) VGCFGRESTORE(8)
All times are GMT -4. The time now is 09:47 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy