07-29-2009
Curl getting html tags
I am making a script in which i wana use curl to download a web page and check status.But problem is when i use curl in linux command line it downlaod htlm tags.How can we ignore these tage any idea.
10 More Discussions You Might Find Interesting
1. Solaris
Hi All,
I use a utility to generate a xml file....which looks something as follows
<xml>
<name>some name</name>
<value>some value</value>
<machine>rocker</machine>
</xml>
I would like to run a KSH script which will replace this machine tag value 'rocker' to say 'docker'.
I would like... (1 Reply)
Discussion started by: nem_kirk
1 Replies
2. Shell Programming and Scripting
hi new to the forum so hi every one hope you all well,
Iam attempting to write a bash script at the moment its a scraper/grabber using wget to download webpages related to the users query. that part is no probs when i have the page i need to stipr all the useless (to me) data out of the html... (3 Replies)
Discussion started by: dunryc
3 Replies
3. Shell Programming and Scripting
Hello,
is there a way to go through a file and remove certain html tags with bash? If it needs sed or awk, that'll do too.
The reason why I want this is, because I have a monitor script which generates a logfile in HTML and every time it generates a logfile, the tags are reproduced. The tags... (4 Replies)
Discussion started by: dejavu88
4 Replies
4. Shell Programming and Scripting
hi,
new to scripting and would like to know how can I have a script which will curl a few URLs and have the results such as the URLs being curled, dns lookup time, connection time, total time, etc save in a html format in a form of table with column and rows.
thank you. (4 Replies)
Discussion started by: squidusr
4 Replies
5. Shell Programming and Scripting
Hi there.
Im not very good on shell yet.
This line, will print me YES or NO in console. Its the HTML code returned from the website, simply YES or NO
curl -L "http://www.thewebsite.net/auth/log.jsp?user=$user&sessionId=$sid&serverId=$hash"
How could i save this into a variable, so i... (1 Reply)
Discussion started by: Ziden
1 Replies
6. UNIX for Advanced & Expert Users
Hello Unix Gurus
I am having a problem with one of the files that i am generating using a Unix Script. This Unix Scripts connects to the MY SQL Server and loads the data into a Text file. While generating the Text file for one of the tables the value in one of the column is as follows.
<p>... (3 Replies)
Discussion started by: chetan.mudike
3 Replies
7. Shell Programming and Scripting
Hi there, I'm quite new to the forum and shell scripting.
I want to filter out the "166.0 points". The results, that i found in google / the forum search didn't helped me :(
<a href="/user/test" class="headitem menu" style="color:rgb(83,186,224);">test</a><a href="/points" class="headitem... (1 Reply)
Discussion started by: Mysthik
1 Replies
8. Shell Programming and Scripting
Could someone, please provide a solution to the following:
I would like to remove some tags from the "head" of multiple html documents across the web site. They look like
<link rel="alternate" type="application/rss+xml"
title="Business and Investment in the Philippines"... (2 Replies)
Discussion started by: georgi58
2 Replies
9. Shell Programming and Scripting
I store different variance of the below in an xml file. and apparently, xml has an issue loading up data like this because it contains html tags. i would like to preserve this data as it is, but unfortunately, xml says i cant.
so i have to strip out all the html tags.
the examples i found... (9 Replies)
Discussion started by: SkySmart
9 Replies
10. Shell Programming and Scripting
I tried to find elegant (or at least simple) way to remove all but couple of html tags from html file, but all examples I found dealt with removing all the tags.
The logic of the script would be:
- if there is <li> or <ul> on the line, do nothing (=write same line to output)
- if there is:... (0 Replies)
Discussion started by: juubuntu
0 Replies
LEARN ABOUT MOJAVE
curlopt_connecttimeout_ms
CURLOPT_CONNECTTIMEOUT_MS(3) curl_easy_setopt options CURLOPT_CONNECTTIMEOUT_MS(3)
NAME
CURLOPT_CONNECTTIMEOUT_MS - timeout for the connect phase
SYNOPSIS
#include <curl/curl.h>
CURLcode curl_easy_setopt(CURL *handle, CURLOPT_CONNECTTIMEOUT_MS, long timeout);
DESCRIPTION
Pass a long. It should contain the maximum time in milliseconds that you allow the connection phase to the server to take. This only lim-
its the connection phase, it has no impact once it has connected. Set to zero to switch to the default built-in connection timeout - 300
seconds. See also the CURLOPT_TIMEOUT_MS(3) option.
In unix-like systems, this might cause signals to be used unless CURLOPT_NOSIGNAL(3) is set.
DEFAULT
300000
PROTOCOLS
All
EXAMPLE
CURL *curl = curl_easy_init();
if(curl) {
curl_easy_setopt(curl, CURLOPT_URL, "http://example.com");
/* complete connection within 10000 milliseconds */
curl_easy_setopt(curl, CURLOPT_CONNECTTIMEOUT_MS, 10000L);
curl_easy_perform(curl);
}
AVAILABILITY
Always
RETURN VALUE
Returns CURLE_OK
SEE ALSO
CURLOPT_TIMEOUT(3), CURLOPT_LOW_SPEED_LIMIT(3),
libcurl 7.54.0 February 14, 2016 CURLOPT_CONNECTTIMEOUT_MS(3)