Split large xml into mutiple files and with header and footer in file Post: 303030084

Sponsored Content

Top Forums Shell Programming and Scripting Split large xml into mutiple files and with header and footer in file Post 303030084 by Chubler_XL on Tuesday 5th of February 2019 10:39:48 PM

02-05-2019

Moderator

Firstly I'm assuming you are using Corona688 's code from post #10.

You don't need to specify X on the command line for this version (OUT= was set in the BEGIN block instead).

If you change the code as follows (changes is red):

Code:

BEGIN {
        ORS=""
        # OUT="x."
        ROWS=5
        ROWTAG="^RECIPIENT[0-9]*$"
        HDRTAG="^DOCUMENTSET$"
        FTRTAG="^DOCUMENTSET$"
}

# First pass, remember headers and footers
NR==FNR {
        if(!HDREND)
        {
                HDR=HDR RS $1 OFS $2
                if(TAG ~ HDRTAG) HDREND=FNR
                next
        }

        if(FTRSTART || (CTAG ~ FTRTAG))
        {
                FTR=FTR RS $1 OFS $2
                if(CTAG ~ FTRTAG) FTRSTART=FNR
        }

        next
}

# Skip header and footer
(FNR <= HDREND) || (FNR >= FTRSTART) { next }

# Close output file once enough DOCUMENT records
((XNR%(ROWS+1)) == 0) {
#       printf("FNR==%d XNR==%d FILE=%s\n", FNR, XNR, FILE)>"/dev/stderr"
        if(!length(OUT)) FBASE=FILENAME "."
                else FBASE = OUT "."
        if(FILE) {
                print FTR > FILE
                close(FILE);
        }

        FILE=sprintf("%s%04d", FBASE,++FILENUM);
        print HDR > FILE
        XNR++
}

{       print RS $0 > FILE      }

CTAG ~ ROWTAG { XNR++ }

END {   if(FILE) print FTR > FILE       }

This will create files with your XML filename followed by .nnnnn filenumbers or you can specify a name on the command line eg:

Code:

awk -f xml_String_split.awk -f xml_split.awk OUT=$x"_split" ROWS="400" $x $x

This User Gave Thanks to Chubler_XL For This Post:

Chubler_XL

View Public Profile for Chubler_XL

Find all posts by Chubler_XL

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to Chop Header and Footer record from input file

Hi, I need to chope the header and footer record from an input file and make a new output file, please let me know how i can do it in unix.thanks.

2. Shell Programming and Scripting

Total of lines w/out header and footer incude for a file

I am trying to get a total number of tapes w/out headers or footers in a ERV file and append it to the file. For some reason I cannot get it to work. Any ideas? #!/bin/sh dat=`date +"%b%d_%Y"` + date +%b%d_%Y dat=Nov16_2006 tapemgr="/export/home/legato/tapemgr/rpts"...

3. Shell Programming and Scripting

Split large file and add header and footer to each file

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?

4. Shell Programming and Scripting

Split large file and add header and footer to each small files

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?

5. Shell Programming and Scripting

sort a report file having header and footer

I am having report file with header and footer . The details in between header and footer are separated by a pipe charater. I want to sort the file by considering multiple columns in between header and footer. pls help

6. Shell Programming and Scripting

Add header and footer with record count in footer

This is my file(Target.txt) name|age|locaction abc|23|del xyz|24|mum jkl|25|kol The file should be like this 1|03252012 1|name|age|location 2|abc|23|del 2|xyz|24|mum 2|jkl|25|kol 2|kkk|26|hyd 3|4 Column 1 is row indicator for row 1 and 2, column indicator is 1,for data rows...

7. Shell Programming and Scripting

Removing header or footer from file

Hi Every one, what is the coomand to remove header or footer from a file. Please help me by providing command/syntax to remove header/footer from unix. Thanks in advance for all your support.

8. Shell Programming and Scripting

Is there a way to append both at header and footer of a file

currently I've a file Insert into CD_CARD_TYPE (CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE) Values ('024', '024', 2, sysdate); Insert into CD_CARD_TYPE (CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE) Values ('032', '032', 2, sysdate); ........ is it...

9. UNIX for Dummies Questions & Answers

File Row Line Count without Header Footer

Hi There! I am saving the file count of all files in a directory to an output file using: wc -l * > FileCount.txt I get: 114 G4SXORD 3 G4SXORH 0 G4SXORP 117 total But this count includes header and footer. I want to subtract 2 from the count and get ...

10. UNIX for Dummies Questions & Answers

Eliminate Header and footer from EBCDIC file

Is there any command to eliminate Header and footer from EBCDIC file

LEARN ABOUT POSIX

grub-mkrescue

GRUB-MKRESCUE(1)						   User Commands						  GRUB-MKRESCUE(1)

NAME

       grub-mkrescue - make a GRUB rescue image

SYNOPSIS

       grub-mkrescue [OPTION...] [OPTION] SOURCE...

DESCRIPTION

       Make GRUB CD-ROM, disk, pendrive and floppy bootable image.

       --compress=no|xz|gz|lzo
	      compress GRUB files [optional]

       -d, --directory=DIR
	      use images and modules under DIR [default=/usr/lib/grub/<platform>]

       --fonts=FONTS
	      install FONTS [default=unicode]

       --install-modules=MODULES
	      install only MODULES and their dependencies [default=all]

       -k, --pubkey=FILE
	      embed FILE as public key for signature checking

       --locale-directory=DIR use translations under DIR
	      [default=/usr/share/locale]

       --locales=LOCALES
	      install only LOCALES [default=all]

       --modules=MODULES
	      pre-load specified modules MODULES

       --themes=THEMES
	      install THEMES [default=starfield]

       -v, --verbose
	      print verbose messages.

       --arcs-boot
	      enable ARCS (big-endian mips machines, mostly SGI) boot. Disables HFS+, APM, sparc64 and boot as disk image for i386-pc

       --core-compress=xz|none|auto
	      choose the compression to use for core image

       --label-bgcolor=COLOR
	      use COLOR for label background

       --label-color=COLOR
	      use COLOR for label

       --label-font=FILE
	      use FILE as font for label

       -o, --output=FILE
	      save output in FILE [required]

       --product-name=STRING
	      use STRING as product name

       --product-version=STRING
	      use STRING as product version

       --rom-directory=DIR
	      save ROM images in DIR [optional]

       --sparc-boot
	      enable sparc boot. Disables HFS+, APM, ARCS and boot as disk image for i386-pc

       --xorriso=FILE
	      use FILE as xorriso [optional]

       -?, --help
	      give this help list

       --usage
	      give a short usage message

       -V, --version
	      print program version

       Mandatory or optional arguments to long options are also mandatory or optional for any corresponding short options.

       Generates  a  bootable CD/USB/floppy image.  Arguments other than options to this program are passed to xorriso, and indicate source files,
       source directories, or any of the mkisofs options listed by the output of `xorriso -as mkisofs -help'.

       Option -- switches to native xorriso command mode.

       Mail xorriso support requests to <bug-xorriso@gnu.org>.

REPORTING BUGS

       Report bugs to <bug-grub@gnu.org>.

SEE ALSO

       grub-mkimage(1)

       The full documentation for grub-mkrescue is maintained as a Texinfo manual.  If the info and grub-mkrescue programs are properly  installed
       at your site, the command

	      info grub-mkrescue

       should give you access to the complete manual.

grub-mkrescue (GRUB) 2.02-2ubuntu8.3				     July 2018							  GRUB-MKRESCUE(1)