I have a little script that I got of the internet and that I use in Squid to block ads.
I used that script with linux but now i have moved my servers to freebsd. I have a step learning curve there but it is fun: Back to the script issue.
The script used to work i with linux but freebsd is a bit different.
This line is causing me issue
If I use the line above it in the script below, the destination folder is going to be completely emptied. The goal is to get rid of the HTML tags "(^|\.)" in the list that is given by http address "pgl.yoyo.org" for bad ad website. Then it is used by squid proxy.
The line above is unusable. The script works well if i modified the line above without the pipe, grep and the tags
Then the list is being updated correctly and not emptied but still with the HTML tags in it.
Code:
#!/bin/sh
# Get new ad server list
/usr/local/bin/wget -O /tmp/temp_ad_file \
'http://pgl.yoyo.org/adservers/serverlist.php?hostformat=squid-dstdom-regex;showintro=0&mimetype=plaintext'
# Clean HTML headers out of the list
cat /tmp/temp_ad_file > "/usr/local/etc/squid/squid.adservers"
# cat /tmp/temp_ad_file | grep "(^|\.)" > "/usr/local/etc/squid/squid.adservers"
# Refresh Squid
/usr/local/sbin/squid -k reconfigure
# Remove tmp file
rm -rf /tmp/temp_ad_file
Any help is much appreciated
Kind Regards,
Last edited by Scott; 11-20-2011 at 02:23 PM..
Reason: Code tags
ahamed101, thanks for replying.
I have pasted the start of the file (txt file)
The HTML tags would be "(^|\.)" & $. If left in that list, the acl squid can't use the file.
My first step is to go and download the list as a txt file and save it to squid folder as squid.adservers.
Then the line above is to update the list once every 3 days. With the line above the destination folder squid.adservers gets emptied when the script is run and the acl inside squid is then complaining.
Regards,
Last edited by Franklin52; 11-21-2011 at 08:04 AM..
Reason: Code tags
I am confused... You have pasted the contents of /tmp/temp_ad_file right?... The grep statement is looking for pattern (^|\.) and populating those in the squid.adservers file... try the grep statement without the redirection and see if you get anything on the screen...
Sorry for the confusion ahamed101
tried without the redirection so staying in the tmp directory with folder "temp_ad_file"
grep '(^|\\.)' /tmp/temp_ad_file. When I look in the temp_ad_file and the list is complete with '(^|\\.)'
Here is an extract below.
Basically what I am trying is clean the html part and redirect the entire list to the squid folder to file called squid.adservers
Hello,
I want to parse the contents of a multiline html tag
ex:
<html>
<body>
<p>some other text</p>
<div>
<p class="margin-bottom-0">
text1
<br>
text2
<br>
<br>
text3
</p>
</div>
</body> (15 Replies)
I want to print from <fruits> to </fruits> tag which have <fruit> as mango. Also i want both <fruits> and </fruits> in output. Please help
eg.
<fruits>
<fruit id="111">mango<fruit>
.
another 20 lines
.
</fruits> (3 Replies)
Hi
I am new to string extractions in shell script... I am trying to extract a string such as #1753 from html tag looks like below.
<a class="model-link tl-tr" href="lastSuccessfulBuild/">Last successful build (#1753), 40 min ago</a>
and want the value as
1753
Could someone help me to... (3 Replies)
I am cleaning forum posts to convert them in offline reading version with clean html text. All files are with html extension and reside in one folder. There is some java script i would like to remove, which looks like
<script LANGUAGE="JavaScript1.1">
<!--
function mMz()
{
var mPz = "";... (2 Replies)
Hi everyone:
I want to extract string which is in between certain html tag.
e.g.
I tried with grep,cut, awk but could not find exact syntax for this one. :wall:
PS>Sorry about bad english. (8 Replies)
Hai friends
I have a small doubt..
how can we use html tag in shell scripting
code :
echo "<html>"
echo "<body>"
echo " welcome to peace world "
echo "</body>"
echo "</html>"
output displayed like this:
<html>
<body>
welcome to peace world
</body>
</html> (5 Replies)
I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part.
Same problem happens in "type" command in MS-DOS.
I know you can do it by opening it in Internet Explorer,... (4 Replies)
