Sponsored Content
Top Forums Shell Programming and Scripting Archive large debug files without cp Post 302183079 by helper on Tuesday 8th of April 2008 08:40:02 AM
Old 04-08-2008
CPU & Memory Use Find command and tar for this.

Hey, use the "FIND" command along with tar command to zip the files greater than the specified size.
Go to the specified directory and execute the following command.....

Here is an eg :
find . -type f -size +1000 2>/dev/null | xargs tar -cvf testingtar.tar


What this basically does it
1> It finds all the files that are greater than 1000 blocks.
2> We collect all those through xargs (which is the faster than others)
3> We tar all those files.

2>/dev/null is used so that the error messages are not displayed.....


It works quickly and i believe this is the better way to use it.


Let me know if you need any.......
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Archive files

Hi All, I wrote this script: #!/bin/ksh while read DAYS ARCH_PATH do cd $ARCH_PATH find . \( -type d ! -name . -prune \) -o -type f -mtime +$DAYS -exec tar -cv f kay_`date +%d%m%y%H%M`.tar {} \; cd - done < filestoarchive.txt The problem is, in a folder of 7files, I would... (13 Replies)
Discussion started by: kayarsenal
13 Replies

2. Shell Programming and Scripting

Archive script old files

Hi All, Im trying to write a script to archive files based on the date the files were created. For example, if a group of files were created on 23rd August,I would have 230806.tar. I have a problem,I want the script to read a separately created file(readarchive.txt) to look for the path to... (1 Reply)
Discussion started by: kayarsenal
1 Replies

3. Shell Programming and Scripting

compare two files using while and sed .. debug my script please

Hi, I'm a newbie to Linux. I have not done programming before, but I accidentally stumble upon Linux scripts at work about 2 weeks ago. I got interested and write scripts to automate my job duties. I need to write a script to compare 2 files (very long list) side by side so it's easier to... (10 Replies)
Discussion started by: shamushamu
10 Replies

4. Solaris

Tar too large to archive. Use E function modifier.

hey all, i am trying to tar up a folder with sub folders the over all size will be about 70gb but when i use the normal command tar -cvf tar -cvf CLPSI_PRU_Escrow_31994.tar CLPSI_PRU_Escrow_31994 i get an error tar: CLPSI_PRU_Escrow_31994/dump1/PROD_SAE_jria3_dump.5 too large to archive. ... (9 Replies)
Discussion started by: dshakey
9 Replies

5. Shell Programming and Scripting

Archive Files

I have 15-20 files in a unix folder on daily basis, so i need to archive those 20 files as dated today and place that archived files in a new folder and has to remove those 20 files from that folder. so that i place 20 new files that comes for tomorrow. i need write a unix script to do this. ... (1 Reply)
Discussion started by: gaddamshashank
1 Replies

6. Shell Programming and Scripting

Divide large data files into smaller files

Hello everyone! I have 2 types of files in the following format: 1) *.fa >1234 ...some text... >2345 ...some text... >3456 ...some text... . . . . 2) *.info >1234 (7 Replies)
Discussion started by: ad23
7 Replies

7. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

8. Shell Programming and Scripting

Archive files which has more than one row

Hello Guys Please treat this as urgent . Can you please kindly help me to know how to archive files in a directory which has more than one row Thanks for your time and help!! (3 Replies)
Discussion started by: Pratik4891
3 Replies

9. UNIX for Dummies Questions & Answers

How to archive old files from the recently added 10 files?

Hi there, I am very new to unix and having trouble with a fairly simple statement: cd /user ls -t -c1 | sed -ne '11,$p' | mv xargs archive/ What I want the code to do is sort all files in a directory by timestamp, select all of the files after the 10th file, and then move those files... (3 Replies)
Discussion started by: DSIReady
3 Replies

10. Shell Programming and Scripting

Check files and archive the files using sftp

Hi, I have to check the files in another server using sftp to do that, below is the code i am going with #!/bin/bash export SRC_FOLDER=$1 export ARC_FOLDER=$2 HOST=as07u3456 USER=relfag sftp ${USER}@${HOST} <<EOF cd $SRC_FOLDER/DSCOR ls bye EOF echo "done" whatever the files i... (8 Replies)
Discussion started by: ursrami
8 Replies
tar(4)							     Kernel Interfaces Manual							    tar(4)

NAME
tar - format of tar tape archive DESCRIPTION
The header structure produced by (see tar(1)) is as follows (the array size defined by the constants is shown on the right): All characters are represented in ASCII. There is no padding used in the header block; all fields are contiguous. The fields magic, uname, and gname are null-terminated character strings. The fields name, linkname, and prefix are null-terminated char- acter strings except when all characters in the array contain non-null characters, including the last character. The version field is two bytes containing the characters (zero-zero). The typeflag contains a single character. All other fields are leading-zero-filled octal numbers in ASCII. Each numeric field is terminated by one or more space or null characters. The name and the prefix fields produce the pathname of the file. The hierarchical relationship of the file is retained by specifying the pathname as a path prefix, with a slash character and filename as the suffix. If the prefix contains non-null characters, prefix, a slash character, and name are concatenated without modification or addition of new characters to produce a new pathname. In this manner, path- names of at most 256 characters can be supported. If a pathname does not fit in the space provided, the format-creating utility notifies the user of the error, and no attempt is made to store any part of the file, header, or data on the medium. SEE ALSO
tar(1) STANDARDS CONFORMANCE
tar(4)
All times are GMT -4. The time now is 08:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy