At 10 megabytes per second it sounds like there's some room for improvement. But you can't go too crazy or you'll just slow your disk down to uselessness.
This requires the BASH shell, mostly for the ability to do wait "$ONEPARTICULARTHREAD" instead of wait #for everything
Can I just check that this files are local and not NFS mounted. If they are remote, then you are dependant on the network too, along with a dollop of memory to work on the file. You will also lose any caching that could help you.
The command drl suggested was not pbzip but in fact parallel. Instead of extracting multiple partial files from one tar, you can get several tars extracting at once.
Which is what my code is for, actually.
I neglected one line at the end. It shouldn't have mattered, but if the code did manage to quit while the children were running, its possible it killed them instead of waiting. So:
In the bash below each .tar.bz2 (usually 2) are extracted and then the original .tar.bz2 is removed. However, only one (presumably the first extracted) is being removed, however both are extracted. I am not sure why this is? Thank you :).
tar.bz2 folders in /home/cmccabe/Desktop/NGS/API
... (3 Replies)
I am using aria2c to download a .tar.bz2 and trying to extract it in the same command. I can download the file but not extract it. I can also manually extract the tar.bz2., but not in the same command. Thank you :).
aria2c -x8 -l log.txt -c -d /xx/xx/xxx --use-head=true --http-user "<user>" ... (8 Replies)
while extracting a tar.bz2 file using the command
tar xjf git.tar.bz2
I received error messages that shows Cannot hard link to and Cannot create symlink to error messages
what will be the reason for those error messages. (4 Replies)
Does anyone know a reliable source to download firefox-19.0.2.tar.bz2 from? I would think you be able to download from firefox or mozilla somewhere. I haven't gotten anything useful from my google searches. (2 Replies)
Hi experts,
I have two tar.bz2 file,:
a.tar.bz2 and b.tar.bz2
I want to put a.tar.bz2 in to b.tar.bz2
eg: b.tar.bz2 only have one file named "b.c" contained
I want it contain "b.c and a.tar.bz2"
I don't want to decompress the b.tar.bz2 to achieve this, I try with "cat a.tar.bz2 >>... (1 Reply)
Hi,
I am trying to unpack and install .tar.bz2 library.
I was told to cd /
and than tar -jxvf /source-of-library-file?...tar.bz2
to get files unpacked and installed into /
Darius
$ pwd
/
$
$ tar -jxvf /tmp/local/root/ncurses-dev-addon.tar.bz2
ncurses-dev-addon/... (3 Replies)
Hi,
Is there a way I can extract my data faster. You know my data is 1.2 GB text file with 8Million rows with 38 columns/fields. Imagine how huge this is.
How I can optimized the data extraction using perl. That is why I'm creating a script to filter only those informations that I need. Is... (3 Replies)
Hello,
I am using a bash script to archive directories of text files located in ${root}:
tar cf ${root}.tar ${root}*
bzip2 ${root}.tar
I'd like to compare the newly produced archive two.tar.bz2 with the second latest one.tar.bz2.
cmp one.tar.bz2 two.tar.bz2
returns
one.tar.bz2 two.tar.bz2... (2 Replies)
hi
could any body tell me how to extract .tar.bz2 files
i tried using tar but in vain.
i found bzip2 in googling but i could not find it on machine unix tru64
please suggest. (1 Reply)