Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

splitting huge xml into multiple files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting splitting huge xml into multiple files
# 1  
Old 06-17-2008
splitting huge xml into multiple files
hi all
i have a some huge html files (500MB to 1GB). Each file has multiple
<html></html> tags

<html>
.................
....................
....................
</html>
<html>
.................
....................
....................
</html>
<html>
.................
....................
....................
</html>
..........
..........

I want to split these html files into smaller files with <html> in the beginning and </html> at the end

<html>
.......
.......
</html>
<html>
..........
..........
</html>

Kindly suggest me a perl/awk/sed or any shell script solution.

Thanks and Regards,
uttam hoode
# 2  
Old 06-17-2008
Something like this?

Code:
awk '/<html>/{c++}c>2{exit}1'  file

Regards
# 3  
Old 06-17-2008
hi franklin,
how can i create multiple file from a huge html file?

i tried this

awk '/<html>/{n++}{print >"output" n ".html" }' input.html


but splitting is not proper. one file should contain many <html> </html> sets

Thanks and Regards,
uttam
# 4  
Old 06-17-2008
Try this:

Code:
awk '
/<html>/{close("file"c".html");c++}
{print $0 > "file"c".html"}
' file

Regards
# 5  
Old 06-17-2008
hi franklin,
its is creating one file for <html> </html>. how can i create one file for more than one set of <html> </html>?


eg

file.1.html
<html>
....
....
</html>
<html>
....
....
</html>
<html>
....
....
</html>


file2.html
<html>
....
....
</html>
<html>
....
....
</html>
<html>
....
....
</html>


file3.html
<html>
....
....
</html>
<html>
....
....
</html>
<html>
....
....
</html>


so on...

last file will contain remaining <html>...</html> s

Thanks and Regards,
uttam hoode
# 6  
Old 06-17-2008
Code:
awk 'BEGIN{c=1}
/<html>/{n++}
n==4{n=1;c++;close("file"c".html")}
{print $0 > "file"c".html"}
' file

Regards
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Splitting the XML file and renaming the files

Hello Gurus, I have a requirement to split the xml file into different xml files. Can you please help me with that? Here is my Source XML file <jms-system-resource> <name>PS6SOAJMSModule</name> <target>soa_server1</target> <sub-deployment> ... (3 Replies)
Discussion started by: Siv51427882
3 Replies

2. Shell Programming and Scripting

Splitting the XML file into three different files

Hello Shell Guru's I have a requirement to split the source xml file into three different text file. And i need your valuable suggestion to finish this. Here is my source xml snippet, here i am using only one entry of <jms-system-resource>. There may be multiple entries in the source file. ... (5 Replies)
Discussion started by: Siv51427882
5 Replies

3. Shell Programming and Scripting

Splitting a single xml file into multiple xml files

Hi, I'm having a xml file with multiple xml header. so i want to split the file into multiple files. Sample.xml consists multiple headers so how can we split these multiple headers into multiple files in unix. eg : <?xml version="1.0" encoding="UTF-8"?> <ml:individual... (3 Replies)
Discussion started by: Narendra921631
3 Replies

4. Shell Programming and Scripting

Splitting xml file into several xml files using perl

Hi Everyone, I'm new here and I was checking this old post: /shell-programming-and-scripting/180669-splitting-file-into-several-smaller-files-using-perl.html (cannot paste link because of lack of points) I need to do something like this but understand very little of perl. I also check... (4 Replies)
Discussion started by: mcosta
4 Replies

5. Shell Programming and Scripting

XML Splitting into multi files

Hi , I have a XML file like below file name : sample.xml <?xml version="1.0"?> <catalog> <author>Rajini</author> <title>XML Guide</title> <Text> </Text> <genre>Computer</genre> <price>44.95</price> </catalog> <?xml version="1.0"?> <catalog> ... (5 Replies)
Discussion started by: karthinvk
5 Replies

6. Shell Programming and Scripting

Help required in Splitting a xml file into multiple and appending it in another .xml file

HI All, I have to split a xml file into multiple xml files and append it in another .xml file. for example below is a sample xml and using shell script i have to split it into three xml files and append all the three xmls in a .xml file. Can some one help plz. eg: <?xml version="1.0"?>... (4 Replies)
Discussion started by: ganesan kulasek
4 Replies

7. Shell Programming and Scripting

splitting a huge line of file into multiple lines with fixed number of columns

Hi, I have a huge file with a single line. But I want to break that line into lines of with each line having five columns. My file is like this: code: "hi","there","how","are","you?","It","was","great","working","with","you.","hope","to","work","you." I want it like this: code:... (1 Reply)
Discussion started by: rajsharma
1 Replies

8. Shell Programming and Scripting

splitting a file (xml) into multiple files

To split the files Hi, I'm having a xml file with multiple xml header. so i want to split the file into multiple files. Test.xml --------- <?xml version="UTF_8"> <emp: ....> <name>a</name> <age>10</age> </emp> <?xml version="UTF_8"> <emp: ....> <name>b</name> <age>10</age>... (11 Replies)
Discussion started by: sasi_u
11 Replies

9. Shell Programming and Scripting

Splitting the Huge file into several files...

Hi I have to write a script to split the huge file into several pieces. The file columns is | pipe delimited. The data sample is as: 6625060|1420215|07308806|N|20100120|5572477081|+0002.79|+0000.00|0004|0001|......... (3 Replies)
Discussion started by: lakteja
3 Replies

10. Shell Programming and Scripting

Splitting huge XML Files into fixsized wellformed parts

Hi, I need to split xml-files with sizes greater than 2 gb into smaler chunks. As I dont want to end up with billions of files, I want those splitted files to have configurable sizes like 250 MB. Each file should be well formed having an exact copy of the header (and footer as the closing of the... (0 Replies)
Discussion started by: Malapha
0 Replies
Login or Register to Ask a Question