Shell Programming and Scripting

Dear All,
Can any one help me for this request?

There is a case. I have 20 files which I need to FTP to 5 servers. I want to know if there is any possibility to make a load balancer which transfers files in round robin manner to 5 servers.

As per theoretical algorithm, what I think, flow can be like:
There are 20 files from aaa to ttt and servers are from 1.1.1.1 till 5.5.5.5.
I will write a code which will check number of files presence in a folder. Then will start picking files and transferring these to servers one by one.
Will start from file1 to server1 till file5 to server5 and
file6 to server1 again and so on.

I am using Solaris. Can anyone help how to achieve it?

GNU Parallel
- GNU Project - Free Software Foundation

Download parallel. It does exactly what you want. We had it on Solaris 10, worked fine. Note that there is a version for Solaris on the website.

Thanks. I will check by keeping it aside. However, on live servers, we can't install any utility or patch for this.
So, I am trying to get idea to develop a script for this.

---------- Post updated 02-23-17 at 04:55 PM ---------- Previous update was 02-22-17 at 11:15 PM ----------

Any help on this please?

Might I suggest an approach like this then:-


Does that structure help? If it does, have a go and let us know how far you get. Please share a working solution if you can so others finding this thread may learn from it.

If you get stuck, show us what you have so far and we will try to suggest options.



Kind regards,
Robin

Thanks rbatte1.
I got your idea.
I have placed file in one directory, listed and got output in a file.
Splitting done and now I have 3 files.

Unable to find a suitable way to create separate jobs.
one possibility is to create a sub-script for each file and then start it in background by using ampersand sign.
Is it a good approach?

Do you want to transfer each file once i.e. to one random server, or many times i.e. to each server?

My idea is to transfer multiple files to multiple servers. Let's say 20 files to 5 servers.
I want to start transfer in parallel to multiple hosts and once first 5 files are uploaded to all 5 servers then next chunk onwards. Hope you are getting my point.