Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: search and grab data from a huge file
Top Forums UNIX for Dummies Questions & Answers search and grab data from a huge file Post 302075792 by cgunn23 on Tuesday 6th of June 2006 09:41:37 PM
Old 06-06-2006
Try this
Hi, I had the same issue with a large XML file being on one line. If you have Pearl on your server, you can use this command to add carriage returns after the closing xml tags so you can use the sed command.

cat $file | perl -p -i -e 's@><@>\n<@g' > `echo ${file} | cut -d. -f1`_broken.xml

Replace "$file" with your filename. This will create a copy of the file called filename_broken.xml with carriage returns.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to extract data from a huge file?

Hi, I have a huge file of bibliographic records in some standard format.I need a script to do some repeatable task as follows: 1. Needs to create folders as the strings starts with "item_*" from the input file 2. Create a file "contents" in each folders having "license.txt(tab... (5 Replies)
Discussion started by: srsahu75
5 Replies

2. Shell Programming and Scripting

insert a header in a huge data file without using an intermediate file

I have a file with data extracted, and need to insert a header with a constant string, say: H|PayerDataExtract if i use sed, i have to redirect the output to a seperate file like sed ' sed commands' ExtractDataFile.dat > ExtractDataFileWithHeader.dat the same is true for awk and... (10 Replies)
Discussion started by: deepaktanna
10 Replies

3. Shell Programming and Scripting

search a string in a huge file

How to search a string which has occured numerous times in a single row. I tried many options, I am facing issue with the file size. Anything I go for, it says it is huge.. File is 82MB. Assume, the file contains the string 'Name' in many places.. Something Like below. ... (5 Replies)
Discussion started by: Muthuraj K
5 Replies

4. Shell Programming and Scripting

Optimised way for search & replace a value on one line in a very huge file (File Size is 24 GB).

Hi Experts, I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised... (7 Replies)
Discussion started by: manishkomar007
7 Replies

5. Shell Programming and Scripting

search a number in very very huge amount of data

Hi, I have to search a number in a very long listing of files.the total size of the files in which I have to search is 10 Tera Bytes. How to search a number in such a huge amount of data effectively.I used fgrep but it is taking many hours to search. Is there any other feasible solution to... (3 Replies)
Discussion started by: vsachan
3 Replies

6. Shell Programming and Scripting

Grab data between 2 keywords any do an array operation and write the file intact

Hi Unix Gurus, I need to grep for a block that is between a start and end keyword and then in between I need to find and replace a keyword. for eg: I need to search between Test = 000; and Test = 000; and find K9 and replace with M9 INPUT FILE Define { Replace = K9; Test =... (6 Replies)
Discussion started by: naveen@
6 Replies

7. Shell Programming and Scripting

Grab 2 pieces of data within a file

I am a newbie and what I have is a captured file of content. I want to be able to grab 2 pieces of data, multiple times and print them to the screen. DataFile owner: locke user: fun data size: 60 location: Anaheim owner: david user: work data size: 80 location: Orange my script... (2 Replies)
Discussion started by: greglocke
2 Replies

8. Shell Programming and Scripting

Grab data within a table in a long log file.

in my file which is a rather long log file it contains many text and tables and there is one table with 15 columns and I am interested to read in the value in column6 and its corresponding value in column2. Trouble is I do not know how to script it as the line number various between different log... (8 Replies)
Discussion started by: piynik
8 Replies

9. Shell Programming and Scripting

How to grab a block of data in a file with repeating pattern?

I need to send email to receipient in each block of data in a file which has the sender address under TO and just send that block of data where it ends as COMPANY. I tried to work this out by getting line numbers of the string HELLO but unable to grab the next block of data to send the next... (5 Replies)
Discussion started by: loggedout
5 Replies

10. Shell Programming and Scripting

awk to grab data in range then search for pattern

im using the following code to grab data, but after the data in the range im specifying has been grabbed, i want to count how many instances of a particular pattern is found? awk 'BEGIN{count=0} /parmlib.*RSP/,/seqfiles.*SSD/ {print; count++ } /103 error in ata file/ END { print count }'... (3 Replies)
Discussion started by: SkySmart
3 Replies

LEARN ABOUT SUSE

xmlstarlet

XMLSTARLET(1)							 xmlstarlet Manual						     XMLSTARLET(1)

NAME

       xmlstarlet - command line XML/XSLT toolkit

SYNOPSIS

       xmlstarlet [<options>] [<command>] [<cmd-options>]

INTRODUCTION

       XMLStarlet is a set of command line utilities (tools) which can be used to transform, query, validate, and edit XML documents and files us-
       ing simple set of shell commands in similar way it is done for plain text files using UNIX grep, sed, awk, diff, patch, join, etc commands.
       This  set of command line utilities can be used by those who deal with many XML documents on UNIX shell command prompt as well as for auto-
       mated XML processing with shell scripts.

OPTIONS

       --version
	      Display the version of xmlstarlet.

       --help Display help.

COMMANDS

       Type: xml <command> --help <ENTER> for command help

       Available commands include:

       ed (or edit)
	      Edit/update XML document(s).

       sel (or select)
	      Select data or query XML document(s) (XPATH, etc).

       tr (or transform)
	      Transform XML documents(s) using XSLT.

       val (or validate)
	      Validate XML document(s) (well-formed/DTD/XSD/RelaxNG).

       fo (or format)
	      Format XML document(s).

       el (or elements)
	      Display element structure of XML document.

       c14n (or canonic)
	      XML canonicalization.

       ls (or list)
	      List directory as XML.

       esc (or escape)
	      Escape special XML characters.

       unesc (or unescape)
	      Unescape special XML characters.

       pyx (or xmln)
	      Convert XML into PYX format (based on ESIS - ISO 8879).

       p2x (or depyx)
	      Convert PYX into XML.

REFERENCES

       XMLStarlet is a command line  toolkit  to  query/edit/check/transform  XML  documents  (for  more  information  see  http://xmlstar.source-
       forge.net/).

AUTHOR

       Mikhail Grushinskiy.

																     XMLSTARLET(1)
All times are GMT -4. The time now is 06:25 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy