Using SED/AWK to extract xml at end of file Post: 302466428

Sponsored Content

Top Forums Shell Programming and Scripting Using SED/AWK to extract xml at end of file Post 302466428 by hugh86 on Tuesday 26th of October 2010 10:58:58 AM

10-26-2010

Registered User

Using SED/AWK to extract xml at end of file

Hello everyone,

Firstly i do not require alot of help.. i am right at the end of finishing my scipt but cannot find a solution to the last part.

What i need to do is, prompt the user for a file to work with, which i have done.
promt the user for an output file - which is done.

Code:

#!/bin/bash
echo "Get my XML"
echo -n "Enter the source file name : "
read infile
echo -n "Enter output file name : "
read outfile
sed -n 1433,1615p $infile >> $outfile
echo "Data should be in $outfile if this compiled correctly"

The file, is .txt and is massive, i only need the last 200 lines or so which is XML... I know i can use SED to specify what line numbers to extract to the output file, but not all documents that use this script will require the last 200, it could be the midlle 50.

Which leads me on to my problem, using SED or AWK i would like to extract all the xml after 'Sending XML' which is consistant accross all documents, up until the words ' Message sending ended.'

I have been reading various articles/forums which have helped and has lead me to providing my current example. Although, using line numbers is not feasible, they will differ accross the documents, whereas the words above are always present.

I really hope someone can help as i have spent far too much time on this!

Thanks!

H

Last edited by hugh86; 10-26-2010 at 12:00 PM.. Reason: english

hugh86

View Public Profile for hugh86

Find all posts by hugh86

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed or awk to extract data from Xml file

Hi, I want to get data from Xml file by using sed or awk command. I want to get the following result : mon titre 1;Createur1;Dossier1 mon titre 1;Createur1;Dossier1 and save it in cvs file (fichier.cvs). FROM this Xml file (test.xml): <playlist version="1"> <trackList> <track>...

2. UNIX for Dummies Questions & Answers

Using sed to extract a substring at end of line

This is the line that I am using: sed 's/^*${3}*$$/\1 /' <test.txt >results.txt and suppose that test.txt contains the following lines: http://www.example.com/200904/AUS.txt http://www.example.com/200903/_RUS.txt http://www.example.com/200902/.FRA.txt What I expected to see in results.txt...

3. Shell Programming and Scripting

SED extract XML value

I have the following string: <min-pool-size>2</min-pool-size> When I pipe the string into the following code I am expcting for it to return just the value "2", but its just reurning the whole string. Why?? sed -n '/<min-pool-size>/,/<\/min-pool-size>/p' Outputting:...

4. UNIX for Dummies Questions & Answers

Extract a specific number from an XML file based on the start and end tags

Hello People, I have the following contents in an XML file ........... ........... .......... ........... <Details = "Sample Details"> <Name>Bob</Name> <Age>34</Age> <Address>CA</Address> <ContactNumber>1234</ContactNumber> </Details> ........... ............. ..............

5. Shell Programming and Scripting

reformatting xml file, sed or awk I think (possibly perl)

I have some xml files that cannot be read using a standard parser, or I am using the wrong parser. The issues seems to be spaces in some of the tags. Here is a sample,<UgUn 2 > <Un> -0.426753 </Un> </UgUn>The parser isn't able to find the number 2, so that information is lost, etc. It seems...

6. Shell Programming and Scripting

sed extract from xml

I have an xml file that generally looks like this: "<row><dnorpattern>02788920</dnorpattern><description/></row><row><dnorpattern>\+ 44146322XXXX</dnorpattern><description/></row><row><dnorpattern>40XXX</dnorpattern><description/></row><row><dnorpattern>11</dn...

7. Shell Programming and Scripting

Extract XML message from a log file using awk

Dear all I have a log file and the content like this file name: temp.log <?xml version="1.0" encoding="cp850"?> <!DOCTYPE aaabbb SYSTEM '/dtdpath'> <aaabbb> <tranDtl> <msgId>000001</msgId> </tranDtl> ..... </aaabbb> ... ...

8. Shell Programming and Scripting

Use grep sed or awk to extract string from log file and put into CSV

I'd like to copy strings from a log file and put them into a CSV. The strings could be on different line numbers, depending on size of log. Example Log File: File = foo.bat Date = 11/11/11 User = Foo Bar Size = 1024 ... CSV should look like: "foo.bat","11/11/11","Foo Bar","1024"

9. Shell Programming and Scripting

sed - extract text from xml file

hi, please help, i have an xml file, e.g: ... <tag> test text asdas="${abc}" xvxvbs:asdas${222}sdad asasa="${aa_bb_22}" </tag> ... i want to extract all "${...}", e.g: ${abc} ${222} ${aa_bb_22} thank you.

10. Shell Programming and Scripting

Extract a particular xml only from an xml jar file

Hi..need help on how to extract a particular xml file only from an xml jar file... thanks!

LEARN ABOUT DEBIAN

cgi::xml

XML(3pm)						User Contributed Perl Documentation						  XML(3pm)

NAME

       CGI::XML - Perl extension for converting CGI.pm variables to/from XML

SYNOPSIS

	 use CGI::XML;
	 $q = new CGI::XML;

	 # convert CGI.pm variables to XML
	 $xml = $q->toXML;
	 $xml = $q->toXML($root);

	 # convert XML to CGI.pm variables
	 $q->toCGI($xml);

DESCRIPTION

       The CGI::XML module converts CGI.pm variables to XML and vice versa.

       CGI::XML is a subclass of CGI.pm, so it reads the CGI variables just as CGI.pm would.

METHODS

       $q = new CGI::XML
	   creates a new instance of CGI::XML. You also have access to all of the methods in CGI.pm.

       $q->toXML([$root])
	   where $root is an optional parameter that specifies the root element. By default, toXML will not return a root element.

       $q->toCGI($xml)
	   where $xml is the XML you would like to convert to CGI.pm parameters. Values in the XML will overwrite any existing values if they
	   exist.

NOTE

       CGI::XML does not currently handle multiple selections passed from HTML forms. This will be added in a future release.

AUTHOR

       Jonathan Eisenzopf <eisen@pobox.com>

CONTRIBUTORS

       David Black <dblack@candle.superlink.net>

SEE ALSO

       perl(1), XML::Parser(3).

perl v5.8.8							    2004-12-05								  XML(3pm)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed or awk to extract data from Xml file

Discussion started by: yeclota

2. UNIX for Dummies Questions & Answers

Using sed to extract a substring at end of line

Discussion started by: figaro

3. Shell Programming and Scripting

SED extract XML value

Discussion started by: ArterialTool

4. UNIX for Dummies Questions & Answers

Extract a specific number from an XML file based on the start and end tags

Discussion started by: sushant172