Calculate % done when using tar


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Calculate % done when using tar
# 1  
Old 12-02-2016
Calculate % done when using tar

Hi

is there a way to calculate the progress when using the tar -cvf a folder say of 300Gb
# 2  
Old 12-02-2016
Hi.

I use pv. Here's a snippet of its use in a script that I use to capture my home structure:
Code:
    $TAR cvf - -C $directory . 2>>$LOG |
    pv -cN $TAR -s "$size" |
    gzip |
    pv -cN gzip > ${destination}

Some details:
Code:
pv      monitor the progress of data through a pipe (man)
Path    : /usr/bin/pv
Version : 1.5.7 - Copyright(C) 2014 Andrew Wood <andrew.wood@ivarch.com>
Type    : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Help    : probably available with --help

For a system like:
Code:
OS, ker|rel, machine: Linux, 3.16.0-4-amd64, x86_64
Distribution        : Debian 8.6 (jessie)

See man pv for usage, etc.

Best wishes ... cheers, drl
# 3  
Old 12-02-2016
I am using solaris 10, and there is no pv command
# 4  
Old 12-02-2016
A percentage would mean knowing everything's total size in advance, how about a running total instead?

Code:
#!/usr/bin/perl

my ($line, $total, $suf)=("",0," KMGT");

my $dir=shift;
if(defined($dir)) { chdir($dir); }

sub gformat {
        my $s=shift;    my $p=0;
        while(($s > 1000) && (($p+1) < length($suf))) { $s /= 1000; $p++; }
        return(sprintf("%3d%s", $s, substr($suf,$p,1)));
}

while($line = <STDIN>) {
        chomp($line);

        ($dev,$ino,$mode,$nlink,$uid,$gid,$rdev,$size,
          $atime,$mtime,$ctime,$blksize,$blocks)
                       = stat($line);

        if(defined($size)) {
                $total += $size;
                printf STDERR "\r%5s %70s", gformat($total), substr($line,-70);
        }
}

printf STDERR "\r%5s %70s", gformat($total), "TOTAL";
printf STDERR "\n";

Code:
tar -cvf filename.tar /path/to/basefolder 2>&1 | ~/runtotal.pl /path/to/basefolder

runtotal needs to start from the same base folder tar's processing from, hence passing the folder into it too.
# 5  
Old 12-02-2016
Hi.

See:
ivarch.com: Pipe Viewer

pv - Solaris package

How to Monitor Progress of (Copy/Backup/Compress) Data using 'pv' Command

Also can be downloaded as gzipped tar, and compiled on a system like:
Code:
OS, ker|rel, machine: SunOS, 5.11, i86pc
Distribution        : Solaris 11.3 X86
pv 1.2.0 - Copyright(C) 2010 Andrew Wood <andrew.wood@ivarch.com>

Good luck ... cheers, drl
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. AIX

Tar - pre-checking before making the Tar file

Coming from this thread, just wondering if there is an option to check if the Tar of the files/directory will be without any file-errors without actually making the tar. Scenario: Let's say you have a directory of 20GB, but you don't have the space to make Tar file at the moment, and you want... (14 Replies)
Discussion started by: filosophizer
14 Replies

2. UNIX for Dummies Questions & Answers

Do I need to extract the entire tar file to confirm the tar folder is fine?

I would like to confirm my file.tar is been tar-ed correctly before I remove them. But I have very limited disc space to untar it. Can I just do the listing instead of actual extract it? Can I say confirm folder integrity if the listing is sucessful without problem? tar tvf file1.tar ... (1 Reply)
Discussion started by: vivien_chu
1 Replies

3. Shell Programming and Scripting

tar command to explore multiple layers of tar and tar.gz files

Hi all, I have a tar file and inside that tar file is a folder with additional tar.gz files. What I want to do is look inside the first tar file and then find the second tar file I'm looking for, look inside that tar.gz file to find a certain directory. I'm encountering issues by trying to... (1 Reply)
Discussion started by: bashnewbee
1 Replies

4. Shell Programming and Scripting

Calculate age of a file | calculate time difference

Hello, I'm trying to create a shell script (#!/bin/sh) which should tell me the age of a file in minutes... I have a process, which delivers me all 15 minutes a new file and I want to have a monitoring script, which sends me an email, if the present file is older than 20 minutes. To do... (10 Replies)
Discussion started by: worm
10 Replies

5. Shell Programming and Scripting

tar command dont tar to original directory

HI, if I have a tarfile called pmapdata.tar that contains tar -tvf pmapdata.tar -rw-r--r-- 0/0 21 Oct 15 11:00 2009 /var/tmp/pmapdata/pmap4628.txt -rw-r--r-- 0/0 21 Oct 14 20:00 2009 /var/tmp/pmapdata/pmap23752.txt -rw-r--r-- 0/0 1625 Oct 13 20:00 2009... (1 Reply)
Discussion started by: borderblaster
1 Replies

6. UNIX for Dummies Questions & Answers

tar -cvf test.tar `find . -mtime -1 -type f` only tar 1 file

Hi all, 4 files are returned when i issue 'find . -mtime -1 -type f -ls'. ./ora_475244.aud ./ora_671958.aud ./ora_934052.aud ./ora_934050.aud However, when I issued the below command: tar -cvf test.tar `find . -mtime -1 -type f`, the tar file only contains the 1st file -... (2 Replies)
Discussion started by: ahSher
2 Replies

7. UNIX for Advanced & Expert Users

How to create a Tar of multiple Files in Unix and FTP the tar to Windows.

Hi, On my Unix Server in my directory, I have 70 files distributed in the following directories (which have several other files too). These files include C Source Files, Shell Script Source Files, Binary Files, Object Files. a) /usr/users/oracle/bin b) /usr/users/oracle... (1 Reply)
Discussion started by: marconi
1 Replies

8. UNIX for Advanced & Expert Users

Tar utility (untar a .tar file) on VxWorks

Hi All Can someone pls guide me if there any utility to compress file on windows & uncompress on vxworks I tried as - - compressed some folders on windows ... i created .tar ( to maintain directory structure ) and compressed to .gz format. - on VxWorks i have uncompressed it to .tar... (1 Reply)
Discussion started by: uday_01
1 Replies

9. UNIX for Advanced & Expert Users

Does tar do crc checking on a tape or tar file?

Trying to answer a question about whether tar table-of-contents is a good tool for verifying tape data. (1 Reply)
Discussion started by: tjlst15
1 Replies
Login or Register to Ask a Question