Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract the tables from html
Top Forums UNIX for Beginners Questions & Answers Extract the tables from html Post 303032240 by RudiC on Thursday 14th of March 2019 05:33:47 AM
Old 03-14-2019
Please note that awk is NOT an adequate tool (nor is shell) to analyse / extract html data; there are way more apt tools to do this.
Please note as well that none of your files is valid html.
And, "csv" means "comma separated values", so I used commas for the extracted datas' separator.

Howsoever, for this - and exactly this - simple case, try


Code:
awk '
/<TABLE/        {P = 1
                }
/<\/TABLE/      {P = 0
                }
!P              {next
                }
/<[Tt][Rr]>/    {printf ORS
                 DL = ""
                }
/<td/           {gsub (/<[^>]*>/, "")
                 gsub (/^ *| *$/, "")
                 printf "%s%s", DL, $0
                 DL = ","
                }
' file

No,ExpSchemae,ExportTables,ImpSchema,ImportTables,Diff
1,FVT4,54,PRDCUSTO,54,
1,FVT4,56,AllImpSchema,54,2
No,TABLENAME,ExportedRows,ImportedRows,DiffRows
1,NAME_DATA,24760,,NotexistonImp
2,WHITE_LIST_MIG,12912,,NotexistonImp
No,TABLENAME,ExportedRows,ImportedRows,DiffRows
1,ADDRESS_DATA,13753,13753,0
2,ADDRESS_NAME_LINK,68715,68715,0
3,AGREEMENT,0,0,0
4,AGREEMENT_RESOURCE,29979,29979,0
5,AGR_RES_HISTORY,0,0,0
6,AR1_ACCOUNT,12912,12912,0
.
.
.

Last edited by RudiC; 03-14-2019 at 07:12 AM..
This User Gave Thanks to RudiC For This Post:
deepti01
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies

2. UNIX for Dummies Questions & Answers

extract data from html tables

hi i need to use unix to extract data from several rows of a table coded in html. I know that rows within a table have the tags <tr> </tr> and so i thought that my first step should be to to delete all of the other html code which is not contained within these tags. i could then use this method... (8 Replies)
Discussion started by: Streetrcr
8 Replies

3. UNIX for Advanced & Expert Users

sed to extract HTML content

Hiya, I am trying to extract a news article from a web page. The sed I have written brings back a lot of Javascript code and sometimes advertisments too. Can anyone please help with this one ??? I need to fix this sed so it picks up the article ONLY (don't worry about the title or date .. i got... (2 Replies)
Discussion started by: stargazerr
2 Replies

4. AIX

Extract data from DB2 tables and FTP it to outside company's firewall

Please help me in creating the script in AIX. requirement is; The new component's main function is to extract the data from DB2 tables and company's firewall directly. The component function needs to check the timestamp in the DB2 tables ((CREDAT and CRETIM) with the requested timestamp and... (1 Reply)
Discussion started by: priyanka3006
1 Replies

5. Shell Programming and Scripting

How to extract url from html page?

for example, I have an html file, contain <a href="http://awebsite" id="awebsite" class="first">website</a>and sometime a line contains more then one link, for example <a href="http://awebsite" id="awebsite" class="first">website</a><a href="http://bwebsite" id="bwebsite"... (36 Replies)
Discussion started by: 14th
36 Replies

6. Shell Programming and Scripting

awk to create two HTML Tables

I am working on awk script to generate an HTML format output. With input file as below I am able to generate a HTML file however I want to saperate spare devices in a different table than rest of the devices and which has only Bunch ID, RAW Size and "Bunch Spare" status columns. INPUT File : ... (2 Replies)
Discussion started by: dynamax
2 Replies

7. UNIX for Dummies Questions & Answers

Extract table from an HTML file

I want to extract a table from an HTML file. the table starts with <table class="tableinfo" and ends with next closing table tag </table> how can I do this with awk/sed... ---------- Post updated at 04:34 PM ---------- Previous update was at 04:28 PM ---------- also I want to... (4 Replies)
Discussion started by: koutroul
4 Replies

8. Shell Programming and Scripting

Splitting csv into 3 tables in html file

I have the data in csv in 3 tables. how can I output the same into 3 tables in html.also how can I set the width. tried multiple options . attached is the format. #!/bin/ksh awk 'BEGIN{ FS="," print "<HTML><BODY><TABLE border = '1' cellpadding=10 width=100>" print... (7 Replies)
Discussion started by: archana25
7 Replies

9. HP-UX

Unable to send attachment with html tables in UNIX shell script

Heyy, any help would be grateful.... LOOKING FOR THE WAYS TO SEND AN EMAIL WITH ATTACHMENT & HTML TABLES IN BODY THROUGH SHELL SCRIPT (LINUX)..NOT SURE, IF WE HAVE ANY INBUILT HTML TAG OR UNIX COMMAND TO SEND THE ATTACHMENTS. KINDLY HELP below is small script posted for our understanding..... (2 Replies)
Discussion started by: Harsha Vardhan
2 Replies

10. UNIX for Beginners Questions & Answers

awk to extract value after keyword in html

Using awk to extract value after a keyword in an html, and store in ts. The awk does execute but ts is empty. I use the tag as a delimiter and the keyword as a pattern, but there probably is a better way. Thank you :). file <html><head><title>xxxxxx xxxxx</title><style type="text/css"> ... (4 Replies)
Discussion started by: cmccabe
4 Replies

LEARN ABOUT CENTOS

acpidump

ACPIDUMP(1)                                                   General Commands Manual                                                  ACPIDUMP(1)

NAME

       acpidump - dump a system's ACPI tables to an ASCII file
       acpixtract - convert ASCII acpidump output to raw binary table
       turbostat - gather performance statistics

SYNOPSIS

       acpidump [options]
       acpixtract [options] [filename]
       turbostat [options] [command [arg]...]

DESCRIPTION

       This manual page documents briefly the acpidump , acpixtract and turbostat commands.

       turbostat  reads hardware registers and gather statistics on the processor clock frequency and C-state usage. Works properly on Nehalem and
       newer processors and on Linux kernel 2.6.30 and later versions.

OPTIONS

       acpidump options are as follow:

       -a, --addr 0x1234
              look for tables at this phisical address

       -t, --table DSDT
              only dump table with DSDT signature

       -o, --output filename
              redirect output from stdout to filename

       -b, --binary
              dump data in binary form rather than in hex-dump format

       -l, --lenght 0x456
              works only with --addr, dump phisical memory region without trying to understand it's contents

       -s, --skip 2
              skip 2 tables of the given name and output only 3rd one

       -h, --help
              outputs an help message

OPTIONS

       acpixtract options are as follow:

       -a     extract all tables, not just DSDT/SSDT

       -l     list table summaries, do not extract

       -s<Signature>
              Extract all tables named <Signature>

OPTIONS

       turbostat options are as follow:

       -v     makes turbostat more verbose

       -i <sec>
              polling interval, default is 5

       When given a command turbostat runs it and outputs statistics gathered while the program was running.

EXAMPLES

       Dump the DSDT table to the file DSDT.aml in binary format (this can be disassembled later with iasl(1)):
               acpidump -b -t DSDT -o DSDT.aml

       Show the FACP table:
               acpidump -t FACP > FACP.dat
               acpixtract -a FACP.dat
               iasl -d FACP.dat

       Dump and extract all ACPI tables:
               acpidump -o DSDT.dat
               acpixtract -a

       Parse APIC tables:
               acpidump -o DSDT.dat
               acpixtract -sAPIC DSDT.dat

SEE ALSO

       iasl(1),

AUTHOR

       acpidump was written by Alexey Starikovskiy and Len Brown.

       This manual page was written by Mattia Dongili <malattia@debian.org>, for the Debian project (but may be used by others).

                                                                 October 19, 2005                                                      ACPIDUMP(1)
All times are GMT -4. The time now is 10:47 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy