Search Results

perl -nle '/(\d+)$/ and print "$_ -o $1.html -a $1.log"' url.list | xargs -I {} -P 10 curl -r 0-50000 -L "{}"

How about something like this:

#!/bin/bash
fetch_url () {
URL=$@
filename=${URL##*=}

curl -r 0-50000 -L "$URL" -o ${filename}.html -a ${filename}.log
}

export -f fetch_url
...

Did you try reading that file:while IFS="?&=" read URL X X X X X FN REST; do echo $FN, $URL; done <url.list
1, http://domain.com/teste.php
2, http://domain.com/teste.php
, ...
30000,...