Sponsored Content
Full Discussion: Split file by data group
Top Forums Shell Programming and Scripting Split file by data group Post 302372326 by Scrutinizer on Tuesday 17th of November 2009 05:21:13 PM
Old 11-17-2009
Pfeww, that was fun Smilie. Not as nice as a single script, but I liked trying another approach.
Code:
sed -r     '/vital/{s/\w+ \w+://;s/(\w+: \w+)/\n\1/g};' infile                  |
awk -F': ' 'function prl() { if(s!=""){print s>f".dat"}; sub(/[^ ]* /,"")       }
            BEGIN          { h="category|style|texture|color|srm|og|sp|comment" }
            /^[0-9]+\./    { prl(); f=$1; print h>f".dat"; s=""                 }
            /^[0-9]+[A-Z]/ { prl(); s=f"|"$1                                    }
            /:/            { s=s"|"$2                                           }
            END            { prl()                                              }'

-or-
Code:
sed        '/vital/{s/\w\+ \w\+://;s/\(\w\+: \w\+\)/\n\1/g};' infile            |

if your sed does not support -r

---------- Post updated at 23:21 ---------- Previous update was at 22:34 ----------

They will ask me where I got all those bits and who my accomplice is, you know Smilie

Last edited by Scrutinizer; 11-17-2009 at 05:40 PM..
 

10 More Discussions You Might Find Interesting

1. HP-UX

Need to split a large data file using a Unix script

Greetings all: I am still new to Unix environment and I need help with the following requirement. I have a large sequential file sorted on a field (say store#) that is being split into several smaller files, one for each store. That means if there are 500 stores, there will be 500 files. This... (1 Reply)
Discussion started by: SAIK
1 Replies

2. Shell Programming and Scripting

Can I split a 10GB file into 1 GB sizes using my repeating data pattern

I'm not a unix guy so excuses my ignorance... I'm the database ETL guy. I'm trying to be proactive and devise a plan B for a ETL process where I expect a file 10X larger than what I process daily for a recast job. The ETL may handle it but I just don't know. This file may need to be split... (3 Replies)
Discussion started by: john091
3 Replies

3. Shell Programming and Scripting

split file based on group count

Hi, can some one please help me to split the file based on groups. like in the below scenario x indicates the begining of the group and the file should be split each with 2 groups below there are 10 groups it should create 5 files. could you please help? (4 Replies)
Discussion started by: hitmansilentass
4 Replies

4. Shell Programming and Scripting

Split, Search and Reformat by Data Group

Hi, I am writing just to share my appreciation for help I have received from this site in the past. In a previous post Split File by Data Group I received a lot of help with a troublesome awk script to reformat some complicated data blocks. What I learned really came in hand recently when I... (1 Reply)
Discussion started by: mkastin
1 Replies

5. Shell Programming and Scripting

split input data file and put into same output file

Hi All, I have two input file and need to generate a CSV file. The existing report just "GREP" the records with the Header and Tailer records with the count of records. Now i need to split the data into 25 records each in the same CSV file. id_file (Input file ) 227050994 232510151... (4 Replies)
Discussion started by: rasmith
4 Replies

6. Shell Programming and Scripting

How to split a data file into separate files with the file names depending upon a column's value?

Hi, I have a data file xyz.dat similar to the one given below, 2345|98|809||x|969|0 2345|98|809||y|0|537 2345|97|809||x|544|0 2345|97|809||y|0|651 9685|98|809||x|321|0 9685|98|809||y|0|357 9685|98|709||x|687|0 9685|98|709||y|0|234 2315|98|809||x|564|0 2315|98|809||y|0|537... (2 Replies)
Discussion started by: nithins007
2 Replies

7. Shell Programming and Scripting

Split File data using awk

HI Guys, I need to split the file in to number of files . file contains FILEHEADER and EOF . I have to split n number of times . I have to form the file with each splitted message between FILEHEADER and EOF using awk beign and end . how to implement please suggest. (2 Replies)
Discussion started by: manish8484
2 Replies

8. Shell Programming and Scripting

Split a file into several files using a data

Hi All, I have file(File1) with data like below: 102100|LName|Gender|Company|Branch|Bday|Salary|Age 102100|bbbb|male|cccc|dddd|19900814|15000|20| 102101|asdg|male|gggg|ksgu|19911216||| 102102|bdbm|male|kkkk|acke|19931018||23| 102102|kfjg|male|kkkc|gkgg|19921213|14000|24|... (2 Replies)
Discussion started by: sarav.shan
2 Replies

9. Solaris

Create file for group of data:

Hi folks, I have the following data.Any help is greatly appreciated. order File_name 7222245 7222245.pdf 7222245 7222245a.pdf 7222245 7222245b.pdf 7222245 7222245c.pdf 7222245 7222245d.pdf 7222250 ... (1 Reply)
Discussion started by: kumar444
1 Replies

10. UNIX for Dummies Questions & Answers

Split binary file every occurrence of a group of characters

Hello I am new to scripts, codes, bash, terminal, etc. I apologize this my be very scattered because I frankly don't have any idea where to begin and I have had trouble sleeping lately. I have several 2GB files I wish to split. This Code 00 00 01 BA ** ** ** ** ** ** ** ** C3 F8 00 00 01 BB 00... (17 Replies)
Discussion started by: PatrickE
17 Replies
IP-TUNNEL(8)							       Linux							      IP-TUNNEL(8)

NAME
ip-tunnel - tunnel configuration SYNOPSIS
ip [ OPTIONS ] tunnel { COMMAND | help } ip tunnel { add | change | del | show | prl } [ NAME ] [ mode MODE ] [ remote ADDR ] [ local ADDR ] [ [i|o]seq ] [ [i|o]key KEY ] [ [i|o]csum ] ] [ encaplimit ELIM ] [ ttl TTL ] [ tos TOS ] [ flowlabel FLOWLABEL ] [ prl-default ADDR ] [ prl-nodefault ADDR ] [ prl-delete ADDR ] [ [no]pmtudisc ] [ dev PHYS_DEV ] [ dscp inherit ] MODE := { ipip | gre | sit | isatap | ip6ip6 | ipip6 | any } ADDR := { IP_ADDRESS | any } TOS := { NUMBER | inherit } ELIM := { none | 0..255 } TTL := { 1..255 | inherit } KEY := { DOTTED_QUAD | NUMBER } TIME := NUMBER[s|ms] DESCRIPTION
tunnel objects are tunnels, encapsulating packets in IP packets and then sending them over the IP infrastructure. The encapulating (or outer) address family is specified by the -f option. The default is IPv4. ip tunnel add - add a new tunnel ip tunnel change - change an existing tunnel ip tunnel delete - destroy a tunnel name NAME (default) select the tunnel device name. mode MODE set the tunnel mode. Available modes depend on the encapsulating address family. Modes for IPv4 encapsulation available: ipip, sit, isatap and gre. Modes for IPv6 encapsulation available: ip6ip6, ipip6 and any. remote ADDRESS set the remote endpoint of the tunnel. local ADDRESS set the fixed local address for tunneled packets. It must be an address on another interface of this host. ttl N set a fixed TTL N on tunneled packets. N is a number in the range 1--255. 0 is a special value meaning that packets inherit the TTL value. The default value for IPv4 tunnels is: inherit. The default value for IPv6 tunnels is: 64. tos T dsfield T tclass T set a fixed TOS (or traffic class in IPv6) T on tunneled packets. The default value is: inherit. dev NAME bind the tunnel to the device NAME so that tunneled packets will only be routed via this device and will not be able to escape to another device when the route to endpoint changes. nopmtudisc disable Path MTU Discovery on this tunnel. It is enabled by default. Note that a fixed ttl is incompatible with this option: tun- nelling with a fixed ttl always makes pmtu discovery. key K ikey K okey K ( only GRE tunnels ) use keyed GRE with key K. K is either a number or an IP address-like dotted quad. The key parameter sets the key to use in both directions. The ikey and okey parameters set different keys for input and output. csum, icsum, ocsum ( only GRE tunnels ) generate/require checksums for tunneled packets. The ocsum flag calculates checksums for outgoing packets. The icsum flag requires that all input packets have the correct checksum. The csum flag is equivalent to the combination icsum ocsum. seq, iseq, oseq ( only GRE tunnels ) serialize packets. The oseq flag enables sequencing of outgoing packets. The iseq flag requires that all input packets are serialized. The seq flag is equivalent to the combination iseq oseq. It isn't work. Don't use it. dscp inherit ( only IPv6 tunnels ) Inherit DS field between inner and outer header. encaplim ELIM ( only IPv6 tunnels ) set a fixed encapsulation limit. Default is 4. flowlabel FLOWLABEL ( only IPv6 tunnels ) set a fixed flowlabel. ip tunnel prl - potential router list (ISATAP only) dev NAME mandatory device name. prl-default ADDR prl-nodefault ADDR prl-delete ADDR Add or delete ADDR as a potential router or default router. ip tunnel show - list tunnels This command has no arguments. SEE ALSO
ip(8) AUTHOR
Original Manpage by Michail Litvak <mci@owl.openwall.com> iproute2 20 Dec 2011 IP-TUNNEL(8)
All times are GMT -4. The time now is 05:47 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy