Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Multiline html tag parse shell script Post 303044115 by stomp on Friday 14th of February 2020 04:51:23 AM
Old 02-14-2020
Hi,

here's a suggestion using pup, a html-parser written in go:

Code:
pup 'div p text{}' < data.html

# Output:

        text1
        

        text2
        

        text3

Explanation: Get all p-Elements with div-elements as parents and output the text data of it.

To get rid of the empty lines, I suggest a small sed command afterwards:

Code:
pup 'div p text{}' < data.html | sed '/^\s*$/d'

# Output
        text1
        text2
        text3

Another short demonstration of pup which I shortly used to get the numbers of cases for the coronovirus out of a complex website and into variables(for generating this graph: coronavirus statistics)) with only one combined command:

Code:
 read n n n n infected deceased recovered < <(wget -O- -q https://www.worldometers.info/coronavirus/  \
       | pup 'div[id="maincounter-wrap"]' | pup 'h1,span text{}' | xargs echo)

Pup is found here: pup on Github

As all GO binaries, it's statically linked and quite large in size(4 MB). Precompiled Binaries are available on github(link above).

Last edited by stomp; 02-14-2020 at 08:32 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies

2. Shell Programming and Scripting

how to use html tag in shell scripting

Hai friends I have a small doubt.. how can we use html tag in shell scripting code : echo "<html>" echo "<body>" echo " welcome to peace world " echo "</body>" echo "</html>" output displayed like this: <html> <body> welcome to peace world </body> </html> (5 Replies)
Discussion started by: jrex1983
5 Replies

3. UNIX for Advanced & Expert Users

shell script to parse html file

hi all, i have a html file something similar to this. <tr class="evenrow"> <td class="data">added</td><td class="data">xyz@abc.com</td> <td class="data">filename.sql</td><td class="modifications-data">08/25/2009 07:58:40</td><td class="data">Added TK prof script</td> </tr> <tr... (1 Reply)
Discussion started by: sais
1 Replies

4. Shell Programming and Scripting

Parse HTML tag parameters and text

Hi! I have a bunch of HTML files, which I want to parse to CSV files. Every page has a table in it, and I need to parse each row into a csv record. With awk and sed, I managed to put every table row in separate lines. So my file looks like this: <TR> .... </TR> <TR> .... </TR> ...One... (1 Reply)
Discussion started by: senszey
1 Replies

5. Shell Programming and Scripting

Script to delete HTML tag

Guys, I have a little script that I got of the internet and that I use in Squid to block ads. I used that script with linux but now i have moved my servers to freebsd. I have a step learning curve there but it is fun: Back to the script issue. The script used to work i with linux but... (15 Replies)
Discussion started by: zongo
15 Replies

6. Shell Programming and Scripting

awk Script to parse a XML tag

I have an XML tag like this: <property name="agent" value="/var/tmp/root/eclipse" /> Is there way using awk that i can get the value from the above tag. So the output should be: /var/tmp/root/eclipse Help will be appreciated. Regards, Adi (6 Replies)
Discussion started by: asirohi
6 Replies

7. Shell Programming and Scripting

Search for a html tag and print the entire tag

I want to print from <fruits> to </fruits> tag which have <fruit> as mango. Also i want both <fruits> and </fruits> in output. Please help eg. <fruits> <fruit id="111">mango<fruit> . another 20 lines . </fruits> (3 Replies)
Discussion started by: Ashik409
3 Replies

8. Shell Programming and Scripting

Using shell command need to parse multiple nested tag value of a XML file

I have this XML file - <gp> <mms>1110012</mms> <tg>988</tg> <mm>LongTime</mm> <lv> <lkid>StartEle=ONE, Desti = Motion</lkid> <kk>12</kk> </lv> <lv> <lkid>StartEle=ONE, Source = Velocity</lkid> <kk>2</kk> </lv> <lv> ... (3 Replies)
Discussion started by: NeedASolution
3 Replies

9. Shell Programming and Scripting

XML Parse between to tag with upper tag

Hi Guys Here is my Input : <?xml version="1.0" encoding="UTF-8"?> <xn:MeContext id="01736"> <xn:VsDataContainer id="01736"> <xn:attributes> <xn:vsDataType>vsDataMeContext</xn:vsDataType> ... (12 Replies)
Discussion started by: pareshkp
12 Replies

10. Shell Programming and Scripting

How to remove html tag which has multiple lines in SHELL?

I want to clean a html file. I try to remove the script part in the html and remove the rest of tags and empty lines. The code I try to use is the following: sed '/<script/,/<\/script>/d' webpage.html | sed -e 's/<*>//g' | sed '/^\s*$/d' > output.txt However, in this method, I can not... (10 Replies)
Discussion started by: YuhuiFeng
10 Replies
GLBLENDEQUATIONSEPAR(3G)					    OpenGL 3.3						  GLBLENDEQUATIONSEPAR(3G)

NAME
glBlendEquationSeparate - set the RGB blend equation and the alpha blend equation separately C SPECIFICATION
void glBlendEquationSeparate(GLenum modeRGB, GLenum modeAlpha); PARAMETERS
modeRGB specifies the RGB blend equation, how the red, green, and blue components of the source and destination colors are combined. It must be GL_FUNC_ADD, GL_FUNC_SUBTRACT, GL_FUNC_REVERSE_SUBTRACT, GL_MIN, GL_MAX. modeAlpha specifies the alpha blend equation, how the alpha component of the source and destination colors are combined. It must be GL_FUNC_ADD, GL_FUNC_SUBTRACT, GL_FUNC_REVERSE_SUBTRACT, GL_MIN, GL_MAX. DESCRIPTION
The blend equations determines how a new pixel (the ''source'' color) is combined with a pixel already in the framebuffer (the ''destination'' color). This function specifies one blend equation for the RGB-color components and one blend equation for the alpha component. The blend equations use the source and destination blend factors specified by either glBlendFunc() or glBlendFuncSeparate(). See glBlendFunc() or glBlendFuncSeparate() for a description of the various blend factors. In the equations that follow, source and destination color components are referred to as R s G s B s A s and R d G d B d A d, respectively. The result color is referred to as R r G r B r A r. The source and destination blend factors are denoted s R s G s B s A and d R d G d B d A, respectively. For these equations all color components are understood to have values in the range 0 1. +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ | | | | | Mode | RGB | Alpha | | | Components | Component | | | | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ |GL_FUNC_ADD | <div> | <div> | | | | | | | | | | | Rr | Ar | | | = | = | | | | | | | R | A | | | s | s | | | | | | | | | | | s | s | | | R | A | | | | | | | + | + | | | R | A | | | d | d | | | | | | | | | | | d | d | | | R | A | | | | | | | | | | | | | | | </div> | </div> | | | <div> | | | | | | | | | | | | Gr | | | | = | | | | | | | | G | | | | s | | | | | | | | | | | | s | | | | G | | | | | | | | + | | | | G | | | | d | | | | | | | | | | | | d | | | | G | | | | | | | | | | | | | | | | </div> | | | | <div> | | | | | | | | | | | | Br | | | | = | | | | | | | | B | | | | s | | | | | | | | | | | | s | | | | B | | | | | | | | + | | | | B | | | | d | | | | | | | | | | | | d | | | | B | | | | | | | | | | | | | | | | </div> | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ |GL_FUNC_SUBTRACT | <div> | <div> | | | | | | | | | | | Rr | Ar | | | = | = | | | | | | | R | A | | | s | s | | | | | | | | | | | s | s | | | R | A | | | | | | | - | - | | | R | A | | | d | d | | | | | | | | | | | d | d | | | R | A | | | | | | | | | | | | | | | </div> | </div> | | | <div> | | | | | | | | | | | | Gr | | | | = | | | | | | | | G | | | | s | | | | | | | | | | | | s | | | | G | | | | | | | | - | | | | G | | | | d | | | | | | | | | | | | d | | | | G | | | | | | | | | | | | | | | | </div> | | | | <div> | | | | | | | | | | | | Br | | | | = | | | | | | | | B | | | | s | | | | | | | | | | | | s | | | | B | | | | | | | | - | | | | B | | | | d | | | | | | | | | | | | d | | | | B | | | | | | | | | | | | | | | | </div> | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ |GL_FUNC_REVERSE_SUBTRACT | <div> | <div> | | | | | | | | | | | Rr | Ar | | | = | = | | | | | | | R | A | | | d | d | | | | | | | | | | | d | d | | | R | A | | | | | | | - | - | | | R | A | | | s | s | | | | | | | | | | | s | s | | | R | A | | | | | | | | | | | | | | | </div> | </div> | | | <div> | | | | | | | | | | | | Gr | | | | = | | | | | | | | G | | | | d | | | | | | | | | | | | d | | | | G | | | | | | | | - | | | | G | | | | s | | | | | | | | | | | | s | | | | G | | | | | | | | | | | | | | | | </div> | | | | <div> | | | | | | | | | | | | Br | | | | = | | | | | | | | B | | | | d | | | | | | | | | | | | d | | | | B | | | | | | | | - | | | | B | | | | s | | | | | | | | | | | | s | | | | B | | | | | | | | | | | | | | | | </div> | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ |GL_MIN | <div> | <div> | | | | | | | | | | | Rr | Ar | | | = | = | | | | | | | min | min | | | | | | | | | | | | | | | R | A | | | s | s | | | | | | | | | | | | | | | R | A | | | d | d | | | | | | | | | | | | | | | | | | | | | | | </div> | </div> | | | <div> | | | | | | | | | | | | Gr | | | | = | | | | | | | | min | | | | | | | | | | | | | | | | G | | | | s | | | | | | | | | | | | | | | | G | | | | d | | | | | | | | | | | | | | | | | | | | | | | | </div> | | | | <div> | | | | | | | | | | | | Br | | | | = | | | | | | | | min | | | | | | | | | | | | | | | | B | | | | s | | | | | | | | | | | | | | | | B | | | | d | | | | | | | | | | | | | | | | | | | | | | | | </div> | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ |GL_MAX | <div> | <div> | | | | | | | | | | | Rr | Ar | | | = | = | | | | | | | max | max | | | | | | | | | | | | | | | R | A | | | s | s | | | | | | | | | | | | | | | R | A | | | d | d | | | | | | | | | | | | | | | | | | | | | | | </div> | </div> | | | <div> | | | | | | | | | | | | Gr | | | | = | | | | | | | | max | | | | | | | | | | | | | | | | G | | | | s | | | | | | | | | | | | | | | | G | | | | d | | | | | | | | | | | | | | | | | | | | | | | | </div> | | | | <div> | | | | | | | | | | | | Br | | | | = | | | | | | | | max | | | | | | | | | | | | | | | | B | | | | s | | | | | | | | | | | | | | | | B | | | | d | | | | | | | | | | | | | | | | | | | | | | | | </div> | | +-----------------------------+-----------------------------------------------------+-----------------------------------------------------+ The results of these equations are clamped to the range 0 1. The GL_MIN and GL_MAX equations are useful for applications that analyze image data (image thresholding against a constant color, for example). The GL_FUNC_ADD equation is useful for antialiasing and transparency, among other things. Initially, both the RGB blend equation and the alpha blend equation are set to GL_FUNC_ADD. NOTES
The GL_MIN, and GL_MAX equations do not use the source or destination factors, only the source and destination colors. ERRORS
GL_INVALID_ENUM is generated if either modeRGB or modeAlpha is not one of GL_FUNC_ADD, GL_FUNC_SUBTRACT, GL_FUNC_REVERSE_SUBTRACT, GL_MAX, or GL_MIN. ASSOCIATED GETS
glGet() with an argument of GL_BLEND_EQUATION_RGB glGet() with an argument of GL_BLEND_EQUATION_ALPHA SEE ALSO
glGetString(), glBlendColor(), glBlendFunc(), glBlendFuncSeparate() COPYRIGHT
Copyright (C) 2006 Khronos Group. This material may be distributed subject to the terms and conditions set forth in the Open Publication License, v 1.0, 8 June 1999. http://opencontent.org/openpub/. OpenGL 3.3 03/08/2011 GLBLENDEQUATIONSEPAR(3G)
All times are GMT -4. The time now is 01:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy