Transfer files wih directory structure.


 
Thread Tools Search this Thread
Operating Systems SCO Transfer files wih directory structure.
# 8  
Old 04-27-2008
If you find that the reason you can't tar a big file is that the file system sets a limit, it would seem reasonable to conclude that you ought to be able to tar it in smaller pieces. tar | split will allow you to break up the tar file in fragments which you can cat together at the other end.

Last edited by era; 04-27-2008 at 09:25 PM.. Reason: Yes: for a change, a useful cat! (Sorry, couldn't resist)
# 9  
Old 04-27-2008
Well, then I wonder why you do bother with creating that tarball locally. Stream it using ssh and you're done.
# 10  
Old 04-28-2008
The server has OpenServer 5.0.5 which does not have ssh natively and it was never installed. It is on its way out from my server "park."
# 11  
Old 04-28-2008
Quote:
Originally Posted by era
If you find that the reason you can't tar a big file is that the file system sets a limit, it would seem reasonable to conclude that you ought to be able to tar it in smaller pieces. tar | split will allow you to break up the tar file in fragments which you can cat together at the other end.
Can you provide an example?
# 12  
Old 04-28-2008
I have GNU tar and GNU split and GNU tail. I don't know if those are available for SCO (lawsuit time? <ducks>) but you might be less lucky with the built-in variants, for example in whether split accepts human-readable big numbers (I calculated 1024*1024*512 and put that in here, but GNU split would allow simply "512m") and, more crucially, whether it can read standard input when you say "-"

Split demonstrated:

Code:
vnix$ echo fnord | split -d -b 3 - fnord.
vnix$ ls fnord.*
fnord.00  fnord.01
vnix$ tail fnord.*
==> fnord.00 <==
fno
==> fnord.01 <==
rd

Archiving:

Code:
tar whatever | split -a 4 -d -b 536870912 - whatever.tar.

-d means use numeric suffixes, -a 4 means create suffixes of length 4, -b bignum is how big each file can be.

Dearchiving:

Code:
cat whatever.tar.* | tar xvf -

Make sure you have enough digits in the suffix so that cat will not put them in the wrong order! I believe the wildcard should expand to an alphabetic list on all platforms.

I've done this when I had to make backups to an USB drive which was FAT formatted so it only accepted (IIRC) max 2 gigs in one file, but this is untested, from memory.

I suggest you try to create a big file with dd like fabtagon proposed, just to check that your coordinates are not completely off.

Last edited by era; 04-28-2008 at 04:30 PM.. Reason: Test with dd first
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to move the files older than x days with similar directory structure?

Hello, I need to move all the files inside /XYZ (has multi-depth sub directories) that are older than 14 days to/ABC directory but with retaining the SAME directory structure. for example: /XYZ/1/2/3/A/b.txt should be moved as /ABC/1/2/3/A/b.txt I know about find /XYZ -type f -mtime +14... (3 Replies)
Discussion started by: prvnrk
3 Replies

2. Shell Programming and Scripting

Archiving files keeping the same structure directory

Hello Team, We would like to backup a lot of files inside of a structure of directories, four, five or more levels in some Ubuntu, Mac and Solaris systems. For instance: /home/chuck/sales/virgin/rent-quote.pdf /home/chuck/sales/marriott/vacation-quote.pdf... (2 Replies)
Discussion started by: csierra
2 Replies

3. Shell Programming and Scripting

Extract files from tar ball without directory structure

Hi, I have tar filw which has multiple directories which contain files. When i extract using tar -xf the directory structure also get extracted. I require only files and not directory structures as there will be overhead of moving the files again. So i searched here and got a solution but... (4 Replies)
Discussion started by: chetan.c
4 Replies

4. Shell Programming and Scripting

How to traverse directory structure and sum size of files?

How do I write a bash or ruby or perl or groovy script to print all the files in my directory tree that are one-to-two years old, the size of each file, and the sum of file sizes and then delete them? I was using find . -atime +365 -exec rm '{}' \; but the problem was that I could not... (5 Replies)
Discussion started by: siegfried
5 Replies

5. Shell Programming and Scripting

Copying a directory structure with the latest versions of files

Hello I have three directory structures for code releases. Each directory structure looks like this: bash-3.00$ ls -R | more .: Test_Release_1 Test_Release_2 Test_Release_3 ./Test_Release_1/dbcode: rp_online_import_srdp.pkb-1 srdp_ar_validation.pkb-1... (1 Reply)
Discussion started by: Glyn_Mo
1 Replies

6. Shell Programming and Scripting

Script to remove all empty files within the directory structure?

Hi I need to write a shell script which basically searches for all the empty files within the directory structure, lists them before asking the user to confirm if they would like to delete them. If the user deletes the file then a notice would appear confirming the file is deleted. I've be... (5 Replies)
Discussion started by: cat123
5 Replies

7. UNIX for Dummies Questions & Answers

copy files with directory structure

i have a text file as. /database/sp/NTR_Update_Imsi_List.sql /database/sp/NTR_Update_Imsi_Range_List.sql /database/sp/NTR_Vlr_Upload.sql /database/tables/StatsTables.sql /mib/ntr.mib /mib/ntr.v2.mib /scripts/operations/ntr/IMSITracer.ph /scripts/operations/ntr/IMSITracer.pl ... (3 Replies)
Discussion started by: adddy
3 Replies

8. UNIX for Advanced & Expert Users

MV files from one directory structure(multiple level) to other directory structure

Hi, I am trying to write a script that will move all the files from source directory structure(multiple levels might exist) to destination directory structure. If a sub folder is source doesnot exist in destination then I have to skip and goto next level. I also need to delete the files in... (4 Replies)
Discussion started by: srmadab
4 Replies

9. Shell Programming and Scripting

disk space used for files with in a directory structure.

Hello, I am new to shell scripting and would really appreciate if someone could help me with this question. I have a directory structure as follows.. main directory is DATA under which i have different directories names fileserver01, fileserver02 ... till fileserver 15. under each... (8 Replies)
Discussion started by: kasala
8 Replies
Login or Register to Ask a Question