Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to remove html tag which has multiple lines in SHELL?
Top Forums Shell Programming and Scripting How to remove html tag which has multiple lines in SHELL? Post 302961481 by YuhuiFeng on Monday 30th of November 2015 10:57:49 AM
Old 11-30-2015
How to remove html tag which has multiple lines in SHELL?
I want to clean a html file.

I try to remove the script part in the html and remove the rest of tags and empty lines.

The code I try to use is the following:
Code:
sed '/<script/,/<\/script>/d' webpage.html | sed -e 's/<[^>]*>//g' | sed '/^\s*$/d' > output.txt

However, in this method, I can not handle the case which a tag with multiple lines of properties, like:
Code:
<body class="three-col logged-out Streams" 
data-fouc-class-names="swift-loading"
 dir="ltr">

Are there any other methods to deal with this kind of case in SHELL?
Last edited by vbe; 11-30-2015 at 12:33 PM.. Reason: code tags... not icode
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies

2. Shell Programming and Scripting

how to use html tag in shell scripting

Hai friends I have a small doubt.. how can we use html tag in shell scripting code : echo "<html>" echo "<body>" echo " welcome to peace world " echo "</body>" echo "</html>" output displayed like this: <html> <body> welcome to peace world </body> </html> (5 Replies)
Discussion started by: jrex1983
5 Replies

3. Shell Programming and Scripting

command to remove attribute of an html tag

Is there any shell command to clean an html tag of its attributes. For ex <p align ="center"> with <p>. Thanks for your help!! (2 Replies)
Discussion started by: parshant_bvcoe
2 Replies

4. Shell Programming and Scripting

How to remove some xml tag lines using shell script

I have existing XML file as below, now based on input string in shell script on workordercode i need to create a seprate xml file for e.g if we pass the input string as 184851 then it find the tag data from <workOrder>..</workOrder> and write to a new file and similarly next time if i pass the... (3 Replies)
Discussion started by: balrajg
3 Replies

5. Shell Programming and Scripting

shell command to remove some XML tag is needed

Hi all, I have a file which i have to remove some line from it, the lines that i have to remove from my file is as below: </new_name></w"s" langue="Fr-fr" version="1.0" encoding="UTF-8" ?> <New_name> and it is finding at the middle of my file, is there any command line in linux to do it or do... (10 Replies)
Discussion started by: id_2pc
10 Replies

6. Shell Programming and Scripting

How to remove string inside html tag <a>

Does anybody know how i can remove string from <a> tag? There are several hundred posts in a few forums that need to be cleaned up. The precise situation is ---------- <a href="http://mydomain.com/cgi-bin/anyboard.cgi?fvp=/family/sexuality_and_spirituality/&cmd=rA&cG=43"> ------------- my... (6 Replies)
Discussion started by: georgi58
6 Replies

7. Shell Programming and Scripting

How can I remove some xml tag lines using shell script?

Hi All, My name is Prathyu and I am working as a ETL develper. I have one requirement to create a XML file based on the provided XSD file. As per the Datastage standards Key(repeatable) field does not contain any Null values so I am inserting some dummy tag line to that XML file. ... (14 Replies)
Discussion started by: Prathyu
14 Replies

8. Shell Programming and Scripting

Search for a html tag and print the entire tag

I want to print from <fruits> to </fruits> tag which have <fruit> as mango. Also i want both <fruits> and </fruits> in output. Please help eg. <fruits> <fruit id="111">mango<fruit> . another 20 lines . </fruits> (3 Replies)
Discussion started by: Ashik409
3 Replies

9. Shell Programming and Scripting

Creating multiple xml tag lines in a file

Hi All, Can someone tell me how can we create same xml tag lines based on the number of lines present in other file and replace the Name variable vaule present in other file. basically I have this xml line <typ:RequestKey NameType="RIC" Name="A1" Service="DDA"/> and say I... (4 Replies)
Discussion started by: Optimus81
4 Replies

10. UNIX for Beginners Questions & Answers

Multiline html tag parse shell script

Hello, I want to parse the contents of a multiline html tag ex: <html> <body> <p>some other text</p> <div> <p class="margin-bottom-0"> text1 <br> text2 <br> <br> text3 </p> </div> </body> (15 Replies)
Discussion started by: SorcRR
15 Replies

LEARN ABOUT DEBIAN

htpurge

htdig(1)						      General Commands Manual							  htdig(1)

NAME

       htpurge -  remove unused documents from the database (general maintenance script)

SYNOPSIS

       htpurge [-][-a][-c configfile][-u][-v]

DESCRIPTION

       Htpurge	functions to remove specified URLs from the databases as well as bad URLs, unretrieved URLs, obsolete documents, etc. It is recom-
       mended that htpurge be run after htdig to clean out any documents of this sort.

       OPTIONS

       -      Take URL list from standard input (rather than specified with -u). Format of input file is one URL per line.  -a Use alternate  work
	      files.  Tells htpurge to append .work to database files, causing a second copy of the database to be built. This allows the original
	      files to be used by htsearch during the run.

       -c configfile
	      Use the specified configfile instead of the default.

       -u URL Add this URL to the list of documents to remove. Must be specified multiple times if more than one URL are to be removed. Should nor
	      be used together with -.

       -v     Verbose  mode.  This  increases the verbosity of the program.  Using more than 2 is probably only useful for debugging purposes. The
	      default verbose mode (using only one -v) gives a nice progress report while digging.

FILES

       /etc/htdig/htdig.conf
	      The default configuration file.

SEE ALSO

       Please refer to the HTML pages (in the htdig-doc package) /usr/share/doc/htdig-doc/html/index.html and the manual  pages  htdigconfig(8)  ,
       htdig(1) and htmerge(1) for a detailed description of ht://Dig and its commands.

AUTHOR

       This manual page was written by Robert Ribnitz, based on the HTML documentation of ht://Dig.

								   January 2004 							  htdig(1)
All times are GMT -4. The time now is 10:02 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy