Search Results

25 TB seems quite a lot.

Are those like billions of small files perhaps ?
Is content is constantly adding and to what extent ?

I have no experience lsyncd with but from Lsyncd github page :
...

FWIW (many very little):

I tried lsyncd (for a short time) before but it seemed a bit overly complex to me, so I just run my own rsync scripts via crontab and have had no problems.

If your command takes 25 parameters then you can do
xargs -L25 echo "do something with" < ws-userlist.txt(The echo command is there for demonstration.)
Or introduce a counter in your loop:
cnt=0;...

This split --version
split (GNU coreutils) 8.30 seems to have the filter receive the split input lines on its stdin.
Try
split -l25 --filter="command-to-create-workspaces params" ws-userlist.txt