Extract the tables from html Post: 303032240

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers Extract the tables from html Post 303032240 by RudiC on Thursday 14th of March 2019 05:33:47 AM

03-14-2019

Registered User

Please note that awk is NOT an adequate tool (nor is shell) to analyse / extract html data; there are way more apt tools to do this.
Please note as well that none of your files is valid html.
And, "csv" means "comma separated values", so I used commas for the extracted datas' separator.

Howsoever, for this - and exactly this - simple case, try

Code:

awk '
/<TABLE/        {P = 1
                }
/<\/TABLE/      {P = 0
                }
!P              {next
                }
/<[Tt][Rr]>/    {printf ORS
                 DL = ""
                }
/<td/           {gsub (/<[^>]*>/, "")
                 gsub (/^ *| *$/, "")
                 printf "%s%s", DL, $0
                 DL = ","
                }
' file

No,ExpSchemae,ExportTables,ImpSchema,ImportTables,Diff
1,FVT4,54,PRDCUSTO,54,
1,FVT4,56,AllImpSchema,54,2
No,TABLENAME,ExportedRows,ImportedRows,DiffRows
1,NAME_DATA,24760,,NotexistonImp
2,WHITE_LIST_MIG,12912,,NotexistonImp
No,TABLENAME,ExportedRows,ImportedRows,DiffRows
1,ADDRESS_DATA,13753,13753,0
2,ADDRESS_NAME_LINK,68715,68715,0
3,AGREEMENT,0,0,0
4,AGREEMENT_RESOURCE,29979,29979,0
5,AGR_RES_HISTORY,0,0,0
6,AR1_ACCOUNT,12912,12912,0
.
.
.

Last edited by RudiC; 03-14-2019 at 07:12 AM..

This User Gave Thanks to RudiC For This Post:

RudiC

View Public Profile for RudiC

Find all posts by RudiC

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,...

2. UNIX for Dummies Questions & Answers

extract data from html tables

hi i need to use unix to extract data from several rows of a table coded in html. I know that rows within a table have the tags <tr> </tr> and so i thought that my first step should be to to delete all of the other html code which is not contained within these tags. i could then use this method...

3. UNIX for Advanced & Expert Users

sed to extract HTML content

Hiya, I am trying to extract a news article from a web page. The sed I have written brings back a lot of Javascript code and sometimes advertisments too. Can anyone please help with this one ??? I need to fix this sed so it picks up the article ONLY (don't worry about the title or date .. i got...

4. AIX

Extract data from DB2 tables and FTP it to outside company's firewall

Please help me in creating the script in AIX. requirement is; The new component's main function is to extract the data from DB2 tables and company's firewall directly. The component function needs to check the timestamp in the DB2 tables ((CREDAT and CRETIM) with the requested timestamp and...

5. Shell Programming and Scripting

How to extract url from html page?

for example, I have an html file, contain <a href="http://awebsite" id="awebsite" class="first">website</a>and sometime a line contains more then one link, for example <a href="http://awebsite" id="awebsite" class="first">website</a><a href="http://bwebsite" id="bwebsite"...

6. Shell Programming and Scripting

awk to create two HTML Tables

I am working on awk script to generate an HTML format output. With input file as below I am able to generate a HTML file however I want to saperate spare devices in a different table than rest of the devices and which has only Bunch ID, RAW Size and "Bunch Spare" status columns. INPUT File : ...

7. UNIX for Dummies Questions & Answers

Extract table from an HTML file

I want to extract a table from an HTML file. the table starts with <table class="tableinfo" and ends with next closing table tag </table> how can I do this with awk/sed... ---------- Post updated at 04:34 PM ---------- Previous update was at 04:28 PM ---------- also I want to...

8. Shell Programming and Scripting

Splitting csv into 3 tables in html file

I have the data in csv in 3 tables. how can I output the same into 3 tables in html.also how can I set the width. tried multiple options . attached is the format. #!/bin/ksh awk 'BEGIN{ FS="," print "<HTML><BODY><TABLE border = '1' cellpadding=10 width=100>" print...

9. HP-UX

Unable to send attachment with html tables in UNIX shell script

Heyy, any help would be grateful.... LOOKING FOR THE WAYS TO SEND AN EMAIL WITH ATTACHMENT & HTML TABLES IN BODY THROUGH SHELL SCRIPT (LINUX)..NOT SURE, IF WE HAVE ANY INBUILT HTML TAG OR UNIX COMMAND TO SEND THE ATTACHMENTS. KINDLY HELP below is small script posted for our understanding.....

10. UNIX for Beginners Questions & Answers

awk to extract value after keyword in html

Using awk to extract value after a keyword in an html, and store in ts. The awk does execute but ts is empty. I use the tag as a delimiter and the keyword as a pattern, but there probably is a better way. Thank you :). file <html><head><title>xxxxxx xxxxx</title><style type="text/css"> ...

LEARN ABOUT SUSE

irrecord

IRRECORD(1)								FSF							       IRRECORD(1)

NAME

       irrecord - application for recording IR-codes for usage with LIRC

SYNOPSIS

       irrecord [options] file

DESCRIPTION

       This  program  will record the signals from your remote control and create a config file for lircd. A proper config file for lircd is maybe
       the most vital part of this package, so you should invest some time to create a working config file. Although I put a good deal	of  effort
       in this program it is often not possible to automatically recognize all features of a remote control.

       If  the program fails to recognize the protocol of the remote control you should use the --force option to at least create a config file in
       raw mode.

       If file already exists and contains a valid config irrecord will use the protocol description found there and will only try to  record  the
       buttons.  This is very useful if you want to learn a remote where config files of the same brand are already available. Of course this will
       only work if the remotes use the same protocol but it's worth a try. You will find template files for the  most	common	protocols  in  the
       remotes/generic/ directory of this package. The name of the new file is created by appending .conf to the given filename in this case.

       -h --help
	      display this message

       -v --version
	      display version

       -a --analyse
	      analyse raw_codes config files

       -f --force
	      force raw mode

       -n --disable-namespace
	      disables namespace checks

       -l --list-namespace
	      list valid button names

       -H --driver=driver
	      use given driver

       -d --device=device
	      read from given device

SEE ALSO

       The documentation for lirc is maintained as html pages. They are located under html/ in the documentation directory.

       Further information on this topic is available in section "Adding new remote controls" in html/help.html

irrecord $Revision: 5.100 $					     May 2010							       IRRECORD(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

Discussion started by: los111

2. UNIX for Dummies Questions & Answers

extract data from html tables

Discussion started by: Streetrcr

3. UNIX for Advanced & Expert Users

sed to extract HTML content

Discussion started by: stargazerr

4. AIX

Extract data from DB2 tables and FTP it to outside company's firewall

Discussion started by: priyanka3006