04-26-2012
How to remove urls from html files
Does anybody know how to remove all urls from html files?
all urls are links with anchor texts in the form of
<a href="http://www.anydomain.com">ANCHOR</a>
they may start with www or not.
Goal is to delete all urls and keep the ANCHOR text and if possible to change tags around anchor to <strong> or <em>.
any help is greatly appreciated
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
is there a way to go through a file and remove certain html tags with bash? If it needs sed or awk, that'll do too.
The reason why I want this is, because I have a monitor script which generates a logfile in HTML and every time it generates a logfile, the tags are reproduced. The tags... (4 Replies)
Discussion started by: dejavu88
4 Replies
2. Shell Programming and Scripting
Hello,
i try to extract urls from google-search-results, but i have problem with sed filtering of html-code.
what i wont is just list of urls thay apears between ........<p><a href=" and next following " in html code.
here is my code, i use wget and pipelines to filtering. wget works, but... (13 Replies)
Discussion started by: L0rd
13 Replies
3. Shell Programming and Scripting
Hello,
I have one file which has been inserted intermittently with HTML web page.
I would like to remove all text between "<html xmlns="http://www.w3.org/1999/xhtml">" and </html> tags.
Can any one please suggest me sed regular expression for it.
Thanks (3 Replies)
Discussion started by: nrbhole
3 Replies
4. Shell Programming and Scripting
Hi,
I need to basically get a list of all the tarballs located at uri
I am currently doing a wget on urito get the index.html page
Now this index page contains the list of uris that I want to use in my bash script.
can someone please guide me ,.
I am new to Linux and shell scripting.
... (5 Replies)
Discussion started by: mnanavati
5 Replies
5. Shell Programming and Scripting
Hi everyone. I have an html file with lines like so:
link href="localFolder/...">
link href="htp://...">
img src="localFolder/...">
img src="htp://...">
I want to remove the links with http in the href and imgs with http in its src. I'm having trouble removing them because there... (4 Replies)
Discussion started by: CowCow339
4 Replies
6. Shell Programming and Scripting
Hello,
I just saw that on my vps (centOS) my oscommerce with a seo script
has created millions of tmp files inside the /html/cache/ directory.
I would need to remove all those files (millions), I tried via shell but the vps
loads goes to very high and it hangs, is there some way to do a... (7 Replies)
Discussion started by: andymc1
7 Replies
7. Shell Programming and Scripting
Does anybody know how i can remove string from <a> tag?
There are several hundred posts in a few forums that need to be cleaned up.
The precise situation is
----------
<a href="http://mydomain.com/cgi-bin/anyboard.cgi?fvp=/family/sexuality_and_spirituality/&cmd=rA&cG=43">
-------------
my... (6 Replies)
Discussion started by: georgi58
6 Replies
8. UNIX for Dummies Questions & Answers
Hi all,
How might I go about writing a program that will read all input as an HTML file, and subsequently strip all HTML, embedded scripts and style sheets from its input, leaving only text as the output?
I am a beginner, so the simpler, the better.
Thanks for any advice :) (4 Replies)
Discussion started by: Molly.P.
4 Replies
9. Shell Programming and Scripting
Hi,
I have a txt file which contain this:
<a href="linux">Linux</a>
<a href="unix">Unix</a>
<a href="oracle">Oracle</a>
<a href="perl">Perl</a>
I'm trying to extract the text in between these anchor tag and ignoring everything else using grep. I managed to ignore the tags but unable to... (6 Replies)
Discussion started by: KCApple
6 Replies
10. Shell Programming and Scripting
Hi,
I am looking for a regex that will validate a URL and files accessed in a browser.
For example:http://www.google.co.uk
http://www.google.com
https://www.google.co.uk
https://www.google.com
ftp://
file:///somefile/on/a/server/accessed/from/browser/file.txt
So far I have:
... (4 Replies)
Discussion started by: muay_tb
4 Replies
LEARN ABOUT DEBIAN
urls_txt
URLS.TXT(5) File Formats Manual URLS.TXT(5)
NAME
urls.txt - URL database for regression testing
INTRODUCTION
The urls.txt file is installed by default in /etc/siege/urls.txt. When siege is invoked without a command line reference to a URL, then by
default it looks for urls in that file. The advantage of using the urls.txt file is two-fold: One, it frees you free retyping a url with
every invocation. And two, it allows you to conduct full site regression testing.
When the urls.txt file is used, siege reads all the urls in that file into memory and runs through the list in one of two ways, sequen-
tially or randomly. The default run is sequential from start to finish and back again until the --reps or the --time option has been satis-
fied. With the -i/--internet option selected, siege runs through the file randomly simulating the stress applied by a community of inter-
net users.
The -f/--file option allows you to select a file other then the default urls.txt file. You may also instruct siege to use a different file
with the "file" directive in .siegerc, i.e., "file = /usr/local/etc/urls.txt"
You may set and reference variables inside the urls.txt file. All variables must be declared BEFORE they are referenced. Variables are
declared with the "=" operator, VARIABLE = VALUE. They are then referenced inside $() or ${}, example: $(HOST), ${HOST}
HOST=joey.joedog.org
http://${HOST}/browse.jsp?size=5
http://${HOST}/admin.jsp?name=ralph
EXAMPLE FILE
This is an exmple urls.txt file. Lines beginning with a hash (#) are comments and ignored by siege.
#
# Example urls.txt file
# URLs database for siege
#
http://www.haha.com/index.html
http://www.haha.com/howto/index.html
http://www.haha.com/cgi-bin/howto/display.cgi?1013
www.haha.com/cgi-bin/fm.cgi?first=j.&last=fulmer
https://www.haha.com/index.shtml
https://www.whoohoo.com/my_whoohoo.jsp
# POST data requires a POST directive
www.haha.com/cgi-bin/foo.cgi POST first=bart&last=simpson
www.haha.com/hoho.jsp POST name=jeff&pass=secret
# POST the contents of a file using the
# line input character "<"
http://www.haha.com/my.jsp POST </home/jeff/data.txt
AUTHOR
Jeffrey Fulmer <jeff@joedog.org>, et al.
BUGS
Report bugs to jeff@joedog.org. Give a detailed description of the problem and report the version of siege that you are using.
COPYRIGHT
Copyright (C) 2007 Jeffrey Fulmer, et al.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 675 Mass Ave, Cambridge, MA 02139, USA.
AVAILABILITY
The most recent released version of siege is available by anonymous FTP from ftp.joedog.org in the directory pub/siege.
SEE ALSO
siege(1) siege.config(1) layingsiege(7)
Siege v2.70 April-17-2012 URLS.TXT(5)