10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I use curl to fetch a website, then, I want to extract the URLs from this curls output.
I tried both sed and grep, but couldnt figure it out.
Ive tried : sed -n 's/href="\(*\).*/\1/p' results.txt
and grep -o
grep -o '<a href="http://*.*.*/*">' results.txt.
What pattern... (6 Replies)
Discussion started by: jozo95
2. Shell Programming and Scripting
I'm writing a little script which sends me sms with my shell script via api of a sms provider.
problem is I can't filter my curl output for this site:
site url:... (1 Reply)
Discussion started by: genius90
3. Shell Programming and Scripting
Issue: I am able to split source file in multiple files of 10 rows each but unable to get the required outputfile name. please advise.
input = A.txt having 44 rows
required output = A_001.txt , A_002.txt and so on. Can below awk be modified to give required result
current... (19 Replies)
Discussion started by: santosh2k2
4. Shell Programming and Scripting
i use curl and wget quite often.
i set up alarms on their output. for instance, i would run a "wget" on a url and then search for certain strings within the output given by the "wget".
the problem is, i cant get the entire output or response of my wget/curl command to show up correctly in... (3 Replies)
Discussion started by: SkySmart
5. Shell Programming and Scripting
I'm trying to write a script to download RedHat's errata digest.
It comes in a txt.gz format, and i can get it easily with firefox.
HOWEVER: output is VERY strange when donwloading it in a script. It seems I'm getting a file of the same size - but partially text and partly binary! It... (5 Replies)
Discussion started by: jstilby
6. Shell Programming and Scripting
I need to invoke a web service and extract what I need from the response using a combination of curl and xsltproc. However, any file-based parameters that must be supplied to both these programs must be from stdin and not actual files.
At least with curl, it seems to think that I am supplying a... (3 Replies)
Discussion started by: webuser
7. Shell Programming and Scripting
This is about to drive me crazy. What I want to do is simple:
output ALL the verbose information from curl to a file
I have read the manual, tried several options and searched this forum but no salvation...
curl -k -Q "command" --user user:passwd --ftp-pasv --ftp-ssl -v... (1 Reply)
Discussion started by: caramandi
8. Shell Programming and Scripting
how I can display a file with cat and printing the filename before each line.
file1:five (12 Replies)
Discussion started by: Timmää
9. Shell Programming and Scripting
new to scripting and would like to know how can I have a script which will curl a few URLs and have the results such as the URLs being curled, dns lookup time, connection time, total time, etc save in a html format in a form of table with column and rows.
thank you. (4 Replies)
Discussion started by: squidusr
10. Shell Programming and Scripting
i have a curl process running as cgi directly pushing stdout to the client. but i want to additionally save that stream to a file at the same time.
any directions madly welcome.
thanks in advance (3 Replies)
Discussion started by: scarfake