Script: Removing HTML tags and duplicate lines Post: 302780715

Sponsored Content

Homework and Emergencies Homework & Coursework Questions Script: Removing HTML tags and duplicate lines Post 302780715 by tburns517 on Friday 15th of March 2013 03:10:53 AM

03-15-2013

Registered User

Script: Removing HTML tags and duplicate lines

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!

1. The problem statement, all variables and given/known data:
You will write a script that will remove all HTML tags from an HTML document and remove any consecutive duplicate lines, and save it as a text document. The user should have the option of including the name of an html file as an argument for the script, but if none is provided, then the script should prompt the user for the file name.

Something is wrong with this script I just can't figure out what it is. It says it can't find the file yet it exists. I also have no clue how to direct the updated file to a new text document properly.

2. Relevant commands, code, scripts, algorithms:

3. The attempts at a solution (include all code and scripts):

cd ~
read -p "What file would you like to clean? " html

if [ -f $html ]
then
sed 's/<[^>]*>//g' $html | uniq > syllabus.html.txt
else
echo "File does not exist."
fi

4. Complete Name of School (University), City (State), Country, Name of Professor, and Course Number (Link to Course):
Jackson Community College, Jackson MI, USA, M. Brinkman, CIS106

Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).

Last edited by tburns517; 03-15-2013 at 04:22 AM..

tburns517

View Public Profile for tburns517

Find all posts by tburns517

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Removing duplicate lines ignore case

hi, I have the following input in file: abc ab a AB b c a C B When I use uniq -u file,the out put file is: abc ab AB c v B C

2. UNIX for Dummies Questions & Answers

removing duplicate lines from a file

Hi, I am trying to remove duplicate lines from a file. For example the contents of example.txt is: this is a test 2342 this is a test 34343 this is a test 43434 and i want to remove the "this is a test" lines only and end up with the numbers in the file, that is, end up with: 2342...

3. Shell Programming and Scripting

removing duplicate blank lines

Hi, how to remove the blank lines from the file only If we have more than one blank line. thanks rameez

4. Shell Programming and Scripting

removing the duplicate lines in a file

Hi, I need to concatenate three files in to one destination file.In this if some duplicate data occurs it should be deleted. eg: file1: ----- data1 value1 data2 value2 data3 value3 file2: ----- data1 value1 data4 value4 data5 value5 file3: ----- data1 value1 data4 value4

5. Shell Programming and Scripting

Removing duplicates from string (not duplicate lines)

please help me in getting following: Input Desired output x="foo" foo x="foo foo" foo x="foo foo" foo x="foo abc foo" foo abc x="foo foo1 foo2" foo foo1 foo2 I need to remove duplicated from string..

6. Shell Programming and Scripting

Removing Duplicate Lines per Section

Hello, I am in need of removing duplicate lines from within a file per section. File: ABC1 012345 header ABC2 7890-000 ABC3 012345 Header Table ABC4 ABC5 593.0000 587.4800 ABC5 593.5000 587.6580 <= dup need to remove ABC5 593.5000 ...

7. Shell Programming and Scripting

remove html tags,consecutive duplicate lines

I need help with a script that will remove all HTML tags from an HTML document and remove any consecutive duplicate lines, and save it as a text document. The user should have the option of including the name of an html file as an argument for the script, but if none is provided, then the script...

8. Shell Programming and Scripting

Removing all except couple of html tags from html file

I tried to find elegant (or at least simple) way to remove all but couple of html tags from html file, but all examples I found dealt with removing all the tags. The logic of the script would be: - if there is <li> or <ul> on the line, do nothing (=write same line to output) - if there is:...

9. Shell Programming and Scripting

Removing a block of duplicate lines from a file

Hi all, I have a file with the data 1 abc 2 123 3 ; 4 rao 5 bell 6 ; 7 call 8 abc 9 123 10 ; 11 rao 12 bell 13 ;

10. UNIX for Dummies Questions & Answers

Removing a set of Duplicate lines from a file

Hi, How do i remove a set of duplicate lines from a file. My file contains the lines: abc def ghi abc def ghi jkl mno pqr jkl mno

LEARN ABOUT DEBIAN

html2stx

html2stx(1)						      General Commands Manual						       html2stx(1)

NAME

       html2stx - convert HTML documents into Stx

SYNOPSIS

       html2stx [ file ]

DESCRIPTION

       html2stx takes the given file, which should contain an HTML document, and converts it to structured text (Stx).	If no file is given, stan-
       dard input is read instead.

       The program does not attempt to convert every possibly convertible piece of markup into Stx.  For example, <font> tags are simply  ignored.
       This  tends  to result in a nice, clean, beautiful document.  (If it doesn't, the source document probably does not contain enough informa-
       tion to start with.)

OPTIONS

       None.

DIAGNOSTICS

       html2stx is a python script and will throw an exception if something goes amiss.  In this case, the return value will be non-zero.

SEE ALSO

       stx2any (1), Stx-ref.html

BUGS

	   o   The word wrapping algorithm is probably not very clever.

	   o   Sometimes there are extra linebreaks in the output.

	   o   Probably many others.

AUTHOR

       This manual page was written by Panu A. Kalliokoski.

       html2stx is derived from the html2text utility by Aaron Swartz.	html2text is a utility for  converting	html  into  "Markdown"	structured
       text; the changes required to make it work for Stx were done by Panu Kalliokoski.

Panu A. Kalliokoski														       html2stx(1)