Speed problems with tar'ing a 500Gb directory on an eSATA drive Post: 302623271

10 More Discussions You Might Find Interesting

1. Solaris

Error tar'ing files to tape

I'm trying to tar a bunch of files off to a tape, but for one specific file (it is fairly large, roughly 10Gb) I get the error: too large to archive Does tar have a limit of the size of file it can write off to tape? I'm using SunOS 5.8. Thanks! -Fred

2. UNIX for Dummies Questions & Answers

tar'ing and zipping files

If I have a directory /directory1 and want to tar and zip everything in it into a file new_tar.tar.gz on disk (not tape) How can I do it? I tried tar -cv /new_tar.tar /directory1/* But I got an error: tar: /dev/rmt/0: No such device or address

3. UNIX for Advanced & Expert Users

tar problems using Sony AIT drive

Recently we brought up a Spectralogic 2K Tape Library that had been out of service for about 3 years to replace a DDS-4 tape drive unit as our main backup device. Everything seemed to go fine but now I have run into a little problem. System details: FBSD 6.1 SpectraLogic 2K library with a...

4. UNIX for Dummies Questions & Answers

tar'ing and regular expressions

Hi, How do I tar all but a specific set of files in a directory? Is it possible to use regular expressions in the tar command? I want to tar all files except those beginning with D. I tried this tar -cvf files.tar ^ but this didn't work. Anyone any ideas. Thanks

5. UNIX for Dummies Questions & Answers

Tar-ing the correct directories

Hi all, my directory structure is as follows /a/b/c. I would like to tar the /a directory including the subdirectories b and c. i intend to use the command tar -cvfz a.tgz a/ My question is where do i execute the command? do i execute it at the '/' prompt or at '/a' prompt ? My concern at...

6. UNIX for Advanced & Expert Users

iSCSI speed problems

Hi all. I was able to set up an IBM Ultrium LTO 4 tape drive to use iSCSI (using open-iscsi drivers) to communicate with Red Hat, but it's going really slow, maxing out in tar and dd tests at like 16 MB/s (using a block size of 128k). The thing is rated for 30MB/s. I feel like even though I have...

7. Shell Programming and Scripting

grep'ing and sed'ing chunks in bash... need help on speeding up a log parser.

I have a file that is 20 - 80+ MB in size that is a certain type of log file. It logs one of our processes and this process is multi-threaded. Therefore the log file is kind of a mess. Here's an example: The logfile looks like: "DATE TIME - THREAD ID - Details", and a new file is created...

8. Shell Programming and Scripting

tar command dont tar to original directory

HI, if I have a tarfile called pmapdata.tar that contains tar -tvf pmapdata.tar -rw-r--r-- 0/0 21 Oct 15 11:00 2009 /var/tmp/pmapdata/pmap4628.txt -rw-r--r-- 0/0 21 Oct 14 20:00 2009 /var/tmp/pmapdata/pmap23752.txt -rw-r--r-- 0/0 1625 Oct 13 20:00 2009...

9. UNIX for Dummies Questions & Answers

Tar-ing folders in a folder

How do I create individual tars of a all the directories in a directory? I have a directory called 'patients', each patient has a directory in the patients directory. I want to create tars such that each patient has their own tar file. Thanks!

10. Shell Programming and Scripting

Speed up extraction od tar.bz2 files using bash

The below bash will untar each tar.bz2 folder in the directory, then remove the tar.bz2. Each of the tar.bz2 folders ranges from 40-75GB and currently takes ~2 hours to extract. Is there a way to speed up the extraction process? I am using a xeon processor with 12 cores. Thank you :). ...

LEARN ABOUT DEBIAN

fst-train

fst-train(1)							     fst-train							      fst-train(1)

NAME

       fst-train - learning transducer weights

SYNOPSIS

       fst-train [ options ] file [ input-file ]

OPTIONS

       -t file
	      use multiple transducers in the same way as fst-infl2.

       -b     This option is used for supervised training with disambiguated data.

       -d     Disambiguate the analyses symbolically as described in the man pages of fst-infl2.

       -q     quiet mode

DESCRIPTION

       fst-train  is  used  to	learn  statistical weights for the transducers transitions based on training data. Training is either unsupervised
       (default) or supervised (option -b).
       In supervised mode, the input contains fully disambiguated data with the surface and the analysis form. The format restrictions are identi-
       cal to those applying for lexicon entries, i.e. all operators other than the colon operator (:) are interpreted literally.
       In unsupervised mode, the input data consists of surface strings. The format is identical to the input format of fst-infl and fst-infl2.
       The transducer weights are stored in files whose names are obtained by appending .prob to the names of the transducer files.

BUGS

       No bugs are known so far.

SEE ALSO

       fst-infl2, fst-compiler

AUTHOR

       Helmut  Schmid,	Institute  for	Computational  Linguistics,  University of Stuttgart, Email: schmid@ims.uni-stuttgart.de, This software is
       available under the GNU Public License.

								   October 2005 						      fst-train(1)