07-29-2009
Curl getting html tags
I am making a script in which i wana use curl to download a web page and check status.But problem is when i use curl in linux command line it downlaod htlm tags.How can we ignore these tage any idea.
10 More Discussions You Might Find Interesting
1. Solaris
Hi All,
I use a utility to generate a xml file....which looks something as follows
<xml>
<name>some name</name>
<value>some value</value>
<machine>rocker</machine>
</xml>
I would like to run a KSH script which will replace this machine tag value 'rocker' to say 'docker'.
I would like... (1 Reply)
Discussion started by: nem_kirk
1 Replies
2. Shell Programming and Scripting
hi new to the forum so hi every one hope you all well,
Iam attempting to write a bash script at the moment its a scraper/grabber using wget to download webpages related to the users query. that part is no probs when i have the page i need to stipr all the useless (to me) data out of the html... (3 Replies)
Discussion started by: dunryc
3 Replies
3. Shell Programming and Scripting
Hello,
is there a way to go through a file and remove certain html tags with bash? If it needs sed or awk, that'll do too.
The reason why I want this is, because I have a monitor script which generates a logfile in HTML and every time it generates a logfile, the tags are reproduced. The tags... (4 Replies)
Discussion started by: dejavu88
4 Replies
4. Shell Programming and Scripting
hi,
new to scripting and would like to know how can I have a script which will curl a few URLs and have the results such as the URLs being curled, dns lookup time, connection time, total time, etc save in a html format in a form of table with column and rows.
thank you. (4 Replies)
Discussion started by: squidusr
4 Replies
5. Shell Programming and Scripting
Hi there.
Im not very good on shell yet.
This line, will print me YES or NO in console. Its the HTML code returned from the website, simply YES or NO
curl -L "http://www.thewebsite.net/auth/log.jsp?user=$user&sessionId=$sid&serverId=$hash"
How could i save this into a variable, so i... (1 Reply)
Discussion started by: Ziden
1 Replies
6. UNIX for Advanced & Expert Users
Hello Unix Gurus
I am having a problem with one of the files that i am generating using a Unix Script. This Unix Scripts connects to the MY SQL Server and loads the data into a Text file. While generating the Text file for one of the tables the value in one of the column is as follows.
<p>... (3 Replies)
Discussion started by: chetan.mudike
3 Replies
7. Shell Programming and Scripting
Hi there, I'm quite new to the forum and shell scripting.
I want to filter out the "166.0 points". The results, that i found in google / the forum search didn't helped me :(
<a href="/user/test" class="headitem menu" style="color:rgb(83,186,224);">test</a><a href="/points" class="headitem... (1 Reply)
Discussion started by: Mysthik
1 Replies
8. Shell Programming and Scripting
Could someone, please provide a solution to the following:
I would like to remove some tags from the "head" of multiple html documents across the web site. They look like
<link rel="alternate" type="application/rss+xml"
title="Business and Investment in the Philippines"... (2 Replies)
Discussion started by: georgi58
2 Replies
9. Shell Programming and Scripting
I store different variance of the below in an xml file. and apparently, xml has an issue loading up data like this because it contains html tags. i would like to preserve this data as it is, but unfortunately, xml says i cant.
so i have to strip out all the html tags.
the examples i found... (9 Replies)
Discussion started by: SkySmart
9 Replies
10. Shell Programming and Scripting
I tried to find elegant (or at least simple) way to remove all but couple of html tags from html file, but all examples I found dealt with removing all the tags.
The logic of the script would be:
- if there is <li> or <ul> on the line, do nothing (=write same line to output)
- if there is:... (0 Replies)
Discussion started by: juubuntu
0 Replies
LEARN ABOUT MOJAVE
curlopt_tcp_keepalive
CURLOPT_TCP_KEEPALIVE(3) curl_easy_setopt options CURLOPT_TCP_KEEPALIVE(3)
NAME
CURLOPT_TCP_KEEPALIVE - enable TCP keep-alive probing
SYNOPSIS
#include <curl/curl.h>
CURLcode curl_easy_setopt(CURL *handle, CURLOPT_TCP_KEEPALIVE, long probe);
DESCRIPTION
Pass a long. If set to 1, TCP keepalive probes will be sent. The delay and frequency of these probes can be controlled by the CUR-
LOPT_TCP_KEEPIDLE(3) and CURLOPT_TCP_KEEPINTVL(3) options, provided the operating system supports them. Set to 0 (default behavior) to dis-
able keepalive probes
DEFAULT
0
PROTOCOLS
All
EXAMPLE
CURL *curl = curl_easy_init();
if(curl) {
curl_easy_setopt(curl, CURLOPT_URL, "http://example.com");
/* enable TCP keep-alive for this transfer */
curl_easy_setopt(curl, CURLOPT_TCP_KEEPALIVE, 1L);
/* keep-alive idle time to 120 seconds */
curl_easy_setopt(curl, CURLOPT_TCP_KEEPIDLE, 120L);
/* interval time between keep-alive probes: 60 seconds */
curl_easy_setopt(curl, CURLOPT_TCP_KEEPINTVL, 60L);
curl_easy_perform(curl);
}
AVAILABILITY
Added in 7.25.0
RETURN VALUE
Returns CURLE_OK if the option is supported, and CURLE_UNKNOWN_OPTION if not.
SEE ALSO
CURLOPT_TCP_KEEPIDLE(3), CURLOPT_TCP_KEEPINTVL(3),
libcurl 7.54.0 February 03, 2016 CURLOPT_TCP_KEEPALIVE(3)