Copy everything from remote Linux to external hard drive in windows

Thread Tools Search this Thread
# 8  
Simpler is pull from Cygwin with scp:
scp -rpC remote_user@remote_host:remote_head_dir/* /cygdrive/drive_letter/target_dir

This User Gave Thanks to DGPickett For This Post:
# 9  
i`m using scp now, its copying slowly but surely...thanks all..
# 10  
Sometimes you can speed it up by breaking the tree up into parallel processes, so you use more CPU and saturate the network speed. The second has the most gain, but if encryption, compression and disk IO throttles it down so there is bandwidth left, more is better. I once did it with 32 parallel processes on a 16 cpu SMP, using a dumb rotator to distribute file names in rotation. It was push, though:
find *| xdemux 32 'cpio ... | bzip2 -9 | ssh 'cd there ; bunzip2 | cpio ...'

I think I got occasional warnings that a directory being created was already there. I might have put a 'nice -19' in there somewhere, too. The guys at gnu parallel do this sort of thing, too.

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Science: Mathematics
Difficulty: Easy
An isosceles triangle has two sides of equal length as opposed to three.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

External hard drive

I have connected an external hard drive. I can't find it. Both ls /media, fdisk -l and ls /dev show nothing. TIA (3 Replies)
Discussion started by: Meow613
3 Replies

2. Shell Programming and Scripting

I want to copy all files of a said type on my external hard drive

My code is this, what I'm trying to accomplish is to make a list of all pdf documents in my computer and then copy all of those documents to my external hard drive in a directory mkdir /Volumes/Hardrive-1/allpdf echo "File Locations" > /Volumes/Hardrive-1/allpdf/FileLocations.txt mdfind pdf... (2 Replies)
Discussion started by: darpness
2 Replies

3. Ubuntu

How to install Ubuntu11 in external Hard drive

Hi Guys.. I want to install Linux on my portable hard drive. I created a 20GB partition in my hard drive for linux, Now I want to make it bootable mean when I connect it to system n start the system it will start the LINUX and when start without usb-hard drive it should start the windows. ... (3 Replies)
Discussion started by: atul9806
3 Replies

4. UNIX for Dummies Questions & Answers

Installing UNIX and booting from External Hard Drive

Hello I have a new project being kicked off next month and i should learn UNIX fast. I have never used UNIX before so i have the following questions: 1) Is any UNIX free to install? 2) Can i install and boot UNIX from an External Hard Drive (The system board on my laptop crashed so i took the... (2 Replies)
Discussion started by: pipsonian
2 Replies

5. Solaris

Boot Solaris off of an old external hard drive

Hi Folks, First a little background, I am working on a ship that operates in the Indian Ocean and Persian/Arabian gulf area. We had a Sunblade 2000 that finally died. The Video board burned up and I guess damaged the mother board. So we ordered 2 rebuilt 2000s one as a spare. Due to mounting... (1 Reply)
Discussion started by: Sean.kelly
1 Replies

6. HP-UX

Mounting an external parallel hard drive

Can anyone please walk me through how to mount an external parallel (or scsi) hard drive in visualize C3000 machine? I also would like to mount "/var/sallie" directory in that external drive. My "/var/sallie" directory is running out of space so I would like to mount an external hard drive so that... (0 Replies)
Discussion started by: sallysallie
0 Replies

7. Ubuntu

External Hard drive won't mount

i have a Simple Tech hard drive that i use between two computers. it is formatted to ntfs. i have a dell desktop with Ubuntu 7.10 and Ubuntu 8.04 and Windows XP Home. and i have a laptop with Ubuntu 7.10 and Ubuntu 8.04. the laptop recognizes the hard drive on both 8.04 and 7.10 but my desktop... (9 Replies)
Discussion started by: Texasone
9 Replies

8. UNIX for Advanced & Expert Users

How to install Linux on an external 320 gigabyte hard drive

Hi all, I would to know if I can install Linux on an external 320 gigabyte hard drive..I have Windows XP on my internal hard drive which is 80 GB , but this installation on 320 external HDD is for testing purpose If it is possible to install Linux on the external drive, will it cause any... (5 Replies)
Discussion started by: bsandeep_80
5 Replies

9. UNIX for Dummies Questions & Answers

External SCSI hard drive

Someone gave me a small external SCSI hard drive for my SunOS 5.8 test system. How do I make Unix see the hard drive? (2 Replies)
Discussion started by: FredSmith
2 Replies

10. UNIX for Dummies Questions & Answers

listing directories of an external hard drive

How do I do it? I have a mac and a pc and am having a time cd-ing to the external drive. (2 Replies)
Discussion started by: theGooch
2 Replies

Featured Tech Videos