multi part compressed files


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers multi part compressed files
# 1  
Old 02-06-2008
multi part compressed files

Hi there,
not sure if I am in the right place but here is my question.

I have a file that is over 100mb and my host does not allow FTP of files above 100mb so I thought I would use a compression utility to compress it into smaller parts say 10mb each, upload them and then re-assemble them on the server back in to the 1 large file.

So first off what is the best or easiest software to create multi part compressed files, and what format should I use.

Second is how do I re-assemble the files once they are on my server, I do have SSH access if this helps.

My host says it is UNIX based.
# 2  
Old 02-06-2008
Lightbulb

1.- You can use the split command
split -b Number [ k | m ] [ -a SuffixLength ] [ File [ Prefix ] ]

split -b 1000 k Filename-to-be-cut

then you get "N" Files with name xa[a-z] with 1MB
2.- You send all files it using FTP.

3.- Then you can use the cat command
cat xaa xab xac ... ... ... > Filename-to-be-joined
# 3  
Old 02-06-2008
check and see if you have unzip or unrar on the unix machine, if you have either then you can use the windows counterparts (sounds like your using windows) to create multipart archives of your files or file.

So in Winrar this is 'create new archive + split to volume bytes [25mb]' and it will make as many 25mb pieces has needed and then you can 'unrar x filename.rar' and it will deal with the files just fine.

Most files have a similar split/combine method. Though using this method will give you the assurance with checksums and what not that everyone is as it should be.
# 4  
Old 02-06-2008
I have unzip on the server so used winzip to create multi part files, uploaded to server, logged in and used command.....

unzip filename.zip

the following was received....


[****.net@*****]$ unzip robbie.zip
Archive: robbie.zip
warning [robbie.zip]: zipfile claims to be last disk of a multi-part archive;
attempting to process anyway, assuming all parts have been concatenated
together in order. Expect "errors" and warnings...true multi-part support
doesn't exist yet (coming soon).
file #1: bad zipfile offset (local header sig): 4
[***.net@****]$

I made this archive on my windows xp machine and then uploaded to my host which I am sure in unix/linux, will it be easier or better using another format rather than zip/rar as I dont seem to be having any luck with this?

Last edited by gffb; 02-06-2008 at 06:31 PM.. Reason: spelling
# 5  
Old 02-08-2008
Any help on this?
# 6  
Old 02-11-2008
# 7  
Old 02-22-2008
Quote:
Originally Posted by denn
Thanks for that but I could not find anything that really helped me.

I will try and explain it a little better. I have a file on my home Windows XP machine that is larger than 100Mb, my host provider runs on linux and only allows me to upload files of 100Mb or smaller, so I would like to be able to split this large file into parts upload it from my home Windoex XP machine to my Linus server and then de-compress it, put all the parts together and have the one large files on my server. How would I go about doing this.

I dont seem to have unrar available and unzip multisupport does not seem to exist yet.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Validate compressed files

Hi All, I have zip file that needs to be validated and checked for 5 times with sleep of 60 seconds. Some thing like below #!/bin/bash counter=1 while do curl -i -k -X GET `strings tmp.txt |grep Location| cut -f2 -d" "` -H "Authorization: Token $TOKEN" -o $zip_file ## this is... (6 Replies)
Discussion started by: Master_Mind
6 Replies

2. Shell Programming and Scripting

How to zip or rm the multi part named files?

Hello There, There are more than 1000 files in my log folder and i want to zip it to relase the space. But my method throwing syntax error due to the multi part file name, how to overcome in this ? ls -lart | grep "MDB_Kernel11.1_gwlog_SUN 22_09_2013" | awk '{print $9,$10,$11,$12}' | head... (8 Replies)
Discussion started by: gowthamakanthan
8 Replies

3. Shell Programming and Scripting

Search compressed files with awk and get FILENAME

I have many compressed files I want to search using awk and want to print some file contents along with the filename it came from on each output record (I simplified awk command). Here are the results with the files uncompressed: awk '{print FILENAME, $0}' test*.txt test1.txt from test1... (3 Replies)
Discussion started by: mjf
3 Replies

4. UNIX for Dummies Questions & Answers

Reading compressed files during a grep search

All, The bottom line is that im reading a file, storing it as variables, recursively grep searching it, and then piping it to allow word counts as well. I am unsure on how to open any .zip .tar and .gzip, search for keywords and return results. Any help would be much appreciated! Thanks (6 Replies)
Discussion started by: ryan.lee
6 Replies

5. UNIX for Dummies Questions & Answers

Extracting data from many compressed files

I have a large number (50,000) of pretty large compressed files and I need only certain lines of data from them (each relevant line contains a certain key word). Each file contains 300 such lines. The individual file names are indexed by file number (file_name.1, file_name.2, ... ,... (1 Reply)
Discussion started by: Boltzmann
1 Replies

6. UNIX for Dummies Questions & Answers

How to distribute compressed files as text?

Hello everybody, I've seen some text documents where they publish blocks of text and tell you to save it as "file.tgz" for example, and when you decompress the file, it actually works. How is that done? is there a program? Because i tried cat and doesn't work, tried less, more, hexedit and... (2 Replies)
Discussion started by: semash!
2 Replies

7. UNIX for Dummies Questions & Answers

To view compressed files

Hello All I compressed a file hello by using compress command compress hello ( enter ) i got the file as hello.z 1. My question is how can i see the file hello.z 2. How can i uncompress it back to change it to filename hello thanks (4 Replies)
Discussion started by: supercops
4 Replies

8. UNIX for Dummies Questions & Answers

delete compressed files from year 2005

I'm trying to delete files that were created/modified in the year 2005 that we compressed and have the .Z extension on them. I tried using the awk utility but the syntax is incorrect. I don't know how to use a wildcard to capture all the compressed files. Here's the code I used ( ls -lR |... (5 Replies)
Discussion started by: igidttam
5 Replies

9. UNIX for Dummies Questions & Answers

Best practice for bulk multi-part mail

Hi, I am currently building a PHP/MySQL database that handles our offices newsletters. Now everything works great in the alpha with only a few names in the list, but I anticipate that once we fill it up (around 10,000) that this will not work from the PHP. I already have the script echo the... (0 Replies)
Discussion started by: begin23
0 Replies

10. UNIX for Dummies Questions & Answers

import compressed files using pipe

I am trying to import compressed files using a pipe on a server, IBM AIX UNIX 3.4, with very little disk space The command is: nohup cat xaa xab xac xad xae xaf xag | uncompress - > imp_pip & Then the imp_pip file is used in the import statement, files=imp_pip Does this statement... (0 Replies)
Discussion started by: pengwyn
0 Replies
Login or Register to Ask a Question