|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Split large xml into mutiple files and with header and footer in file
Post 303027484 by karthik on Sunday 16th of December 2018 06:44:01 PM
12-16-2018
Hi Corona,
Below are the steps I am doing sampletest11.xml is my sample file and the xml node slightly differs and the body node is "Recipient"
party_ID is my footer so changed it accordingly in xml_split.awk
Script worked fine with 200 records and when the xml file got 18k records which is expected file it throws the below exception
Sample xml skeleton:
Command :
--- Post updated at 11:44 PM ---
Kindly assist on the above is the issue because of the file size or number of records in the file??
Below are the steps I am doing sampletest11.xml is my sample file and the xml node slightly differs and the body node is "Recipient"
party_ID is my footer so changed it accordingly in xml_split.awk
Script worked fine with 200 records and when the xml file got 18k records which is expected file it throws the below exception
Code:
awk: xmlsplit.awk:37: (FILENAME=sampletest11.xml FNR=4) fatal: can't redirect to `/0001' (Permission denied)
Code:
<?xml version="1.0" encoding="UTF-8"?>
<DocumentSet>
<Recipient>
<Context>
<TESTER>08</TESTER>
<name>TEST</name>
<Locale>en_AU</Locale>
<Channel>kjsdhfuis</Channel>
<UserId>8</UserId>
<HLX>000000</HLX>
<Key1>TEST1</Key1>
<Key2>TEST2</Key2>
<Key3>TEST3</Key3>
<KeyID>hotdirectorytest</KeyID>
<dummy2222>TEST7</dummy2222>
<EffectiveFrom>20170612000000</EffectiveFrom>
<Currency>AUD</Currency>
</Context>
<Document>
<Form>
<Name>TESTER2</Name>
<Data>
<DocumentSetC>
<HeaderData>
<TESTER>08</TESTER>
<Channel>kjsdhfuis</Channel>
<UserId>X009189</UserId>
<HLX>000000</HLX>
<dummy>08VIC000000</dummy>
<Key1>TEST2</Key1>
<Key2>TEST3</Key2>
<Key3/>
<KeyID>TEST70</KeyID>
<dummy2222>Approval Letter</dummy2222>
<TEST7>APPA08120617206891</TEST7>
<EffectiveFrom>20170612000000</EffectiveFrom>
<HLX44>12345</HLX44>
<SystemDate>20170612</SystemDate>
</HeaderData>
<FormData>
<Name>TESTER2</Name>
<Context>
<UniqueDocID>1240525</UniqueDocID>
<dummy11112233>LEN_APP_0010_OUT</dummy11112233>
<TEST2ApprovedAmount>8989</TEST2ApprovedAmount>
</Context>
<ReceivingParty>
<Applicant>
<TEST45456>sfdsfnsdfnff </TEST45456>
</Applicant>
<IndividualDemographics>
</IndividualDemographics>
<DeliveryChannel>POST</DeliveryChannel>
<NoOfCopies>1</NoOfCopies>
</ReceivingParty>
<Application>
<ProductGroups>
<TEST454567>sfdsfnsdfnff </TEST454567>
</ProductGroups>
</Application>
</FormData>
</DocumentSetC>
</Data>
</Form>
<TYP1>5</TYP1>
</Document>
</Recipient>
<Recipient2> ---</Recipient2>
---------------
--------------
-----------------
-----------------
<Recipient18000> ---</Recipient18000>
<PartyID>12345</PartyID>
</DocumentSet>Code:
$ awk -f yanx.awk -f xmlsplit.awk X="x." ROWS="10" sampletest11.xml sampletest11.xml
Kindly assist on the above is the issue because of the file size or number of records in the file??
| Moderator's Comments: | ||
|
Last edited by RudiC; 12-17-2018 at 04:07 AM.. Reason: Added CODE tags.
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi, I need to chope the header and footer record from an input file and make a new output file, please let me know how i can do it in unix.thanks. (4 Replies)
Discussion started by: coolbudy
4 Replies
2. Shell Programming and Scripting
I am trying to get a total number of tapes w/out headers or footers in a ERV file and append it to the file. For some reason I cannot get it to work. Any ideas?
#!/bin/sh
dat=`date +"%b%d_%Y"`
+ date +%b%d_%Y
dat=Nov16_2006
tapemgr="/export/home/legato/tapemgr/rpts"... (1 Reply)
Discussion started by: gzs553
1 Replies
3. Shell Programming and Scripting
I have one large file, after every 200 line i have to split the file and the add header and footer to each small file?
It is possible to add different header and footer to each file? (1 Reply)
Discussion started by: ashish4422
1 Replies
4. Shell Programming and Scripting
I have one large file, after every 200 line i have to split the file and the add header and footer to each small file?
It is possible to add different header and footer to each file? (7 Replies)
Discussion started by: ashish4422
7 Replies
5. Shell Programming and Scripting
I am having report file with header and footer . The details in between header and footer are separated by a pipe charater. I want to sort the file by considering multiple columns in between header and footer.
pls help (4 Replies)
Discussion started by: suryanarayana
4 Replies
6. Shell Programming and Scripting
This is my file(Target.txt)
name|age|locaction
abc|23|del
xyz|24|mum
jkl|25|kol
The file should be like this
1|03252012
1|name|age|location
2|abc|23|del
2|xyz|24|mum
2|jkl|25|kol
2|kkk|26|hyd
3|4
Column 1 is row indicator
for row 1 and 2, column indicator is 1,for data rows... (1 Reply)
Discussion started by: itsranjan
1 Replies
7. Shell Programming and Scripting
Hi Every one,
what is the coomand to remove header or footer from a file.
Please help me by providing command/syntax to remove header/footer from unix.
Thanks in advance for all your support. (5 Replies)
Discussion started by: sridhardwh
5 Replies
8. Shell Programming and Scripting
currently I've a file
Insert into CD_CARD_TYPE
(CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE)
Values
('024', '024', 2, sysdate);
Insert into CD_CARD_TYPE
(CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE)
Values
('032', '032', 2, sysdate);
........
is it... (3 Replies)
Discussion started by: jediwannabe
3 Replies
9. UNIX for Dummies Questions & Answers
Hi There!
I am saving the file count of all files in a directory to an output file using:
wc -l * > FileCount.txt
I get:
114 G4SXORD
3 G4SXORH
0 G4SXORP
117 total
But this count includes header and footer. I want to subtract 2 from the count and get
... (7 Replies)
Discussion started by: gagan8877
7 Replies
10. UNIX for Dummies Questions & Answers
Is there any command to eliminate Header and footer from EBCDIC file (4 Replies)
Discussion started by: abhilashnair
4 Replies