Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Need get data from XML file through shell script..

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need get data from XML file through shell script..
# 1  
Old 05-02-2019
Need get data from XML file through shell script..
hi all, here is the sample log file and these errors are repeated in log file..
i need all the repeated time stamp ,severity and message tags needs to print in output file.. through shell script
Code:
 <log-message>
 <timestamp>2019-03-13T04:52:49.648-05:00</timestamp>
 <severity>ERROR</severity>
 <application-id>xxxxx</application-id>
 <subsystem-id>INTF</subsystem-id> 
<host-name>xxxx</host-name>
 <log-origin>PFL</log-origin>
 <thread-id>MCulEngine14</thread-id> 
<uid>606</uid> 
<message>cannot make thumbnail image</message>
 <user-id> </user-id> 
<additional-info> </additional-info>
</log-message>

Can any one help me on this.

OUTPUT should be on below manner:
Code:
 <timestamp>2019-03-13T04:52:49.648-05:00</timestamp>
<severity>ERROR</severity>
<message>cannot make thumbnail image</message>

 <timestamp>2019-03-13T04:52:49.648-05:00</timestamp>
<severity>ERROR</severity>
<message>cannot make thumbnail image</message>

Thanks in Advance,
Last edited by ravi; 05-02-2019 at 04:39 AM..
# 2  
Old 05-02-2019
Hello ravi,

Could you please try following once.
Code:
awk -F"[><]" '
/\/log-message/{
  if(value){
    print value
  }
  value=""
  next
}
/timestamp/{
  value="timestamp="$3
  next
}
/severity/{
  value=value ORS "severioty="$3
  next
}
/message/{
  value=value ORS "message="$3
}
END{
  if(value){
    print value
  }
}
'    Input_file

Thanks,
R. Singh
This User Gave Thanks to RavinderSingh13 For This Post:
ravi
# 3  
Old 05-02-2019
Code:
awk '
/ERROR/                 {print prev ORS $0; flag=1}
/message/ && flag       {print; flag=0}
                        {prev = $0}
' file > out.log

This User Gave Thanks to nezabudka For This Post:
ravi
# 4  
Old 05-02-2019
Quote:
Originally Posted by RavinderSingh13
Hello ravi,

Could you please try following once.
Code:
awk -F"[><]" '
/\/log-message/{
  if(value){
    print value
  }
  value=""
  next
}
/timestamp/{
  value="timestamp="$3
  next
}
/severity/{
  value=value ORS "severity="$3
  next
}
/message/{
  value=value ORS "message="$3
}
END{
  if(value){
    print value
  }
}
'    Input_file

Thanks,
R. Singh
Hi Singh, Thanks for your help, the above code is giving the out put but i need out put which are related to severity=ERROR and message = cannot make thumbnail image .. these two conditions need to satisfy ..

Thanks.
# 5  
Old 05-02-2019
Quote:
Originally Posted by ravi
Hi Singh, Thanks for your help, the above code is giving the out put but i need out put which are related to severity=ERROR and message = cannot make thumbnail image .. these two conditions need to satisfy ..
Thanks.
Hello ravi,

2 things here.

1- For thanking any person for any useful post(s) you could HIT thanks button at bottom left corner of each post Smilie
2- For your question; you have to provide samples of input and output in correct needed manner on forums, we can't guess that; so please provide in your post with CODE TAGS(see how your first post was edited).

Thanks,
R. Singh
This User Gave Thanks to RavinderSingh13 For This Post:
ravi
# 6  
Old 05-02-2019
Quote:
Originally Posted by RavinderSingh13
Hello ravi,

2 things here.

1- For thanking any person for any useful post(s) you could HIT thanks button at bottom left corner of each post Smilie
2- For your question; you have to provide samples of input and output in correct needed manner on forums, we can't guess that; so please provide in your post with CODE TAGS(see how your first post was edited).

Thanks,
R. Singh
hi Singh, this first time am using this forum, so am not aware to click that thanks button, because of that i conveyed my greetings in words, going forward i will do HIT thanks button

I have updated my requirement input and output. thanks for your suggestion. Please help me on this.
Last edited by ravi; 05-02-2019 at 04:41 AM..
# 7  
Old 05-02-2019
With your amended spec, try also
Code:
grep -E "<(timestamp|severity|message)" file | paste -sd"\t\t\n" | grep -E "ERROR.*thumbnail" | tr '\t' '\n'

These 2 Users Gave Thanks to RudiC For This Post:
nezabudka ravi
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Pass some data from csv to xml file using shell/python

Hello gurus, I have a csv file with bunch of datas in each column. (see attached) Now I have an .xml file in the structure of below: ?xml version="1.0" ?> <component id="root" name="root"> <component id="system" name="system"> <param name="number_of_A" value="8"/> ... (5 Replies)
Discussion started by: Zam_1234
5 Replies

2. Shell Programming and Scripting

How to extract data from XML file using shell scripting?

Hi , I have input file as XML. following are input data #complex.xml Code: <?xml version="1.0" encoding="UTF-8"?><TEST_doc xmlns="http://www.w3.org/2001/XMLSchema-instance"> <ENTRY uid="123456"> <protein> <name>PROT001</name> <organism>Human</organism> ... (1 Reply)
Discussion started by: arun_kohan
1 Replies

3. Shell Programming and Scripting

How to extract data from xml file using shell scripting?

Hi evry1, This is my 1st post in this forum.Pls help me I want to extract some data froma xml file which has 2000 lines using shell scripting. Actually my xml file has some "audio and video codes" which i need to arrange in a column wise format after extracting it using shell scripting.I... (4 Replies)
Discussion started by: arun_kohan
4 Replies

4. UNIX for Advanced & Expert Users

Shell Script to read XML tags and the data within that tag

Hi unix Gurus, I am really new to Unix Scripting. Please help me to create a shell script which reads the xml file and from that i need to fetch a particular information. For example <SOURCE BUSINESSNAME ="" DATABASETYPE ="Teradata" DBDNAME ="DWPROD3" DESCRIPTION ="" NAME... (2 Replies)
Discussion started by: SmilePlease
2 Replies

5. Shell Programming and Scripting

How to Parse the XML data along with the URL in Shell Script?

Hi, Can anybody help to solve this. I want to parse some xmldata along with the URL in the Shell. I'm calling the URL via the curl command Given below is my shell script file export... (7 Replies)
Discussion started by: Megala
7 Replies

6. Shell Programming and Scripting

Shell script to extract data in repeating tags from xml

Hi, I am new to shell scripting. I need to extract data between repeating tags from an xml file and store the data in an array to process it further. <ns1:root xmlns:ns1="http://example.com/config"> <ns1:interface>in1</ns1:interface> <ns1:operation attribute1="true" attribute2="abd"... (2 Replies)
Discussion started by: sailendra
2 Replies

7. Shell Programming and Scripting

Convert XML to Data File in Shell Script

Hi All, I will be getting a huge XML file with a lot of records in it. I need to convert it into multiple data files. SAMPLE XML FILE <ABSProductCatalog xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> - <ProductSalesHierachy> - <Portfolios> - <Portfolio productCode="P1"> ... (8 Replies)
Discussion started by: ragha81
8 Replies

8. Shell Programming and Scripting

How to remove xml namespace from xml file using shell script?

I have an xml file: <AutoData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <Table1> <Data1 10 </Data1> <Data2 20 </Data2> <Data3 40 </Data3> <Table1> </AutoData> and I have to remove the portion xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" only. I tried using sed... (10 Replies)
Discussion started by: Gary1978
10 Replies

9. Shell Programming and Scripting

Help with shell script to extract data from XML file

Hello Scripting Gurus, I need help with extracting data from the XML file using shell script. The data is in a large XML and I need to extract the id values of all completedworkflows. Here is a sample of it. Input and output data is also in the attached text files. <wfregistry>... (5 Replies)
Discussion started by: yajaykumar
5 Replies

10. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies
Login or Register to Ask a Question