Shell Programming and Scripting

Dear Experts,

how to run multiple scp commands from single scripts.

In a directory oracle redo files accumulate. i would like to copy those redo logs to my standby server. For same i am using scp to copy the files. where i am monitoring that as it is sending the files sequentially most of bandwidth unused. I am thinking to do multiple scp session to copy the files. how can i achieve it. I am listing the files to one file and i am splitting that file in to multiple files each file will contains 10 entries.
i.e. if file contains 100 entries then it will split that file to 10 files. and Each spitted file will have the entries like below.

Code:

test1_0001_rf.dbf
test1_0002_rf.dbf
test1_0003_rf.dbf
test1_0004_rf.dbf
test1_0005_rf.dbf
test1_0006_rf.dbf
test1_0007_rf.dbf
test1_0008_rf.dbf
test1_0009_rf.dbf

how can i achieve to run 10 scp session parallely and use that 10 sub-files created as input for transferring the files to my standby server with successfully and using proper utilizing the bandwidth available.

Am working on AIX machine.

Kindly Help me on this.

Thanks Dears, Waiting for all your suggestion.

Thanks in advance...
nmadhuhb

Moderator's Comments:

Use code tags please.

In your script, just scp the files with nohup and "&" in the end.

Something like:

Code:

# cat redoLogFiles.txt
test1_0001_rf.dbf
test1_0002_rf.dbf
test1_0003_rf.dbf
test1_0004_rf.dbf
test1_0005_rf.dbf
test1_0006_rf.dbf
test1_0007_rf.dbf
test1_0008_rf.dbf
test1_0009_rf.dbf

# cat scpRedoLogFiles.sh
while read redoFile
do
     nohup scp -C -p -c blowfish ${redoFile} <RemoteUser>@<Host>:</path/to/copy/to> 1>scpOutput.log 2>scpOutput.err &
done < redoLogFiles.txt

I hope it helps!