04-08-2008
Archive large debug files without cp
Need some fine tuning advice:
I have a KSH programs croned to execute once a day. Which basically does the following simple operation:
for i in `ls`do
cp $i $i.backup
>$i
gzip $i.backup
done
Basically cleanup the file after taking a backup.
Now the issue here is this directory will contain more than 12 files with >1GB each file and gets very nasty all time.
I considered an approach like
1. tar -cvf debug.tar ~/debug
2. > [All the files]
This approach also creates problem because there will be a big time gap between step 1 and 2. so all the info written between 1 and 2 will be lost.
Any advice on this?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
I wrote this script:
#!/bin/ksh
while read DAYS ARCH_PATH
do
cd $ARCH_PATH
find . \( -type d ! -name . -prune \) -o -type f -mtime +$DAYS -exec tar -cv
f kay_`date +%d%m%y%H%M`.tar {} \;
cd -
done < filestoarchive.txt
The problem is, in a folder of 7files, I would... (13 Replies)
Discussion started by: kayarsenal
13 Replies
2. Shell Programming and Scripting
Hi All,
Im trying to write a script to archive files based on the date the files were created.
For example, if a group of files were created on 23rd August,I would have 230806.tar. I have a problem,I want the script to read a separately created file(readarchive.txt) to look for the path to... (1 Reply)
Discussion started by: kayarsenal
1 Replies
3. Shell Programming and Scripting
Hi, I'm a newbie to Linux. I have not done programming before, but I accidentally stumble upon Linux scripts at work about 2 weeks ago. I got interested and write scripts to automate my job duties.
I need to write a script to compare 2 files (very long list) side by side so it's easier to... (10 Replies)
Discussion started by: shamushamu
10 Replies
4. Solaris
hey all,
i am trying to tar up a folder with sub folders the over all size will be about 70gb
but when i use the normal command
tar -cvf tar -cvf CLPSI_PRU_Escrow_31994.tar CLPSI_PRU_Escrow_31994
i get an error tar: CLPSI_PRU_Escrow_31994/dump1/PROD_SAE_jria3_dump.5 too large to archive. ... (9 Replies)
Discussion started by: dshakey
9 Replies
5. Shell Programming and Scripting
I have 15-20 files in a unix folder on daily basis, so i need to archive those 20 files as dated today and place that archived files in a new folder and has to remove those 20 files from that folder. so that i place 20 new files that comes for tomorrow.
i need write a unix script to do this.
... (1 Reply)
Discussion started by: gaddamshashank
1 Replies
6. Shell Programming and Scripting
Hello everyone!
I have 2 types of files in the following format:
1) *.fa
>1234
...some text...
>2345
...some text...
>3456
...some text...
.
.
.
.
2) *.info
>1234 (7 Replies)
Discussion started by: ad23
7 Replies
7. Solaris
Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS.
I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies
8. Shell Programming and Scripting
Hello Guys
Please treat this as urgent .
Can you please kindly help me to know how to archive files in a directory which has more than one row
Thanks for your time and help!! (3 Replies)
Discussion started by: Pratik4891
3 Replies
9. UNIX for Dummies Questions & Answers
Hi there, I am very new to unix and having trouble with a fairly simple statement:
cd /user
ls -t -c1 | sed -ne '11,$p' | mv xargs archive/
What I want the code to do is sort all files in a directory by timestamp, select all of the files after the 10th file, and then move those files... (3 Replies)
Discussion started by: DSIReady
3 Replies
10. Shell Programming and Scripting
Hi,
I have to check the files in another server using sftp to do that, below is the code i am going with
#!/bin/bash
export SRC_FOLDER=$1
export ARC_FOLDER=$2
HOST=as07u3456
USER=relfag
sftp ${USER}@${HOST} <<EOF
cd $SRC_FOLDER/DSCOR
ls
bye
EOF
echo "done"
whatever the files i... (8 Replies)
Discussion started by: ursrami
8 Replies
LEARN ABOUT OSX
vgcfgrestore
VGCFGRESTORE(8) System Manager's Manual VGCFGRESTORE(8)
NAME
vgcfgrestore - restore volume group descriptor area
SYNOPSIS
vgcfgrestore [-d|--debug] [-f|--file filename] [-l[l]|--list] [-h|--help] [-M|--Metadatatype1|2] [-t|--test] [-v|--verbose] VolumeGroupName
DESCRIPTION
vgcfgrestore allows you to restore the metadata of VolumeGroupName from a text backup file produced by vgcfgbackup. You can specify a
backup file with --file. If no backup file is specified, the most recent one is used. Use --list for a list of the available backup and
archive files of VolumeGroupName.
OPTIONS
-l | --list -- List files pertaining to VolumeGroupName
List metadata backup and archive files pertaining to VolumeGroupName. May be used with the -f option. Does not restore Vol-
umeGroupName.
-f | --file filename -- Name of LVM metadata backup file
Specifies a metadata backup or archive file to be used for restoring VolumeGroupName. Often this file has been created with vgcfg-
backup.
See lvm for common options.
REPLACING PHYSICAL VOLUMES
vgdisplay --partial --verbose will show you the UUIDs and sizes of any PVs that are no longer present. If a PV in the VG is lost and you
wish to substitute another of the same size, use pvcreate --restorefile filename --uuid uuid (plus additional arguments as appropriate) to
initialise it with the same UUID as the missing PV. Repeat for all other missing PVs in the VG. Then use vgcfgrestore --file filename to
restore the volume group's metadata.
SEE ALSO
lvm(8), vgcreate(8)
Sistina Software UK LVM TOOLS 2.02.95(2) (2012-03-06) VGCFGRESTORE(8)