Sponsored Content
Top Forums Shell Programming and Scripting Split Large Files Based On Row Pattern.. Post 302876649 by aimy on Tuesday 26th of November 2013 01:04:28 AM
Old 11-26-2013
Oh God, you are so kind Don.

Thank you so much!

But would you mind to explain a little bit about the code? Why FNR <=2 not FNR == 2?

Thanks.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

split large file based on field criteria

I have a file containing date/time sorted data of the form ... 2009/06/10,20:59:59.950,XAG/USD,Q,1,1115, 14.3025,100,1,1 2009/06/10,20:59:59.950,XAG/USD,Q,1,1116, 14.3026,125,1,1 2009/06/10,20:59:59.950,XAG/USD,R,0,0, , 0,0,0 2009/06/10,20:59:59.950,XAG/USD,R,1,0, 14.1910,100,1,1... (6 Replies)
Discussion started by: asriva
6 Replies

2. Shell Programming and Scripting

Split large file based on last digit from a column

Hello, What's the best way to split a large into multiple files based on the last digit in the first column. input file: f 2738483300000x0y03772748378831x1y13478378358383x2y23743878383802x3y33787828282820x4y43748838383881x5y5 Desired Output: f0 3738483300000x0y03787828282820x4y4 f1... (9 Replies)
Discussion started by: alain.kazan
9 Replies

3. Shell Programming and Scripting

Split a file into multiple files based on the input pattern

I have a file with lines something like. ...... 123_start ...... ....... 123_end .... ..... 456_start ...... ..... 456_end .... ..... 789_start .... .... 789_end (6 Replies)
Discussion started by: abinash
6 Replies

4. Shell Programming and Scripting

Splitting large file into multiple files in unix based on pattern

I need to write a shell script for below scenario My input file has data in format: qwerty0101TWE 12345 01022005 01022005 datainala alanfernanded 26 qwerty0101mXZ 12349 01022005 06022008 datainalb johngalilo 28 qwerty0101TWE 12342 01022005 07022009 datainalc hitalbert 43 qwerty0101CFG 12345... (19 Replies)
Discussion started by: jimmy12
19 Replies

5. Shell Programming and Scripting

split XML file into multiple files based on pattern

Hello, I am using awk to split a file into multiple files using command: nawk '{ if ( $1 == "<process" ) { n=split($2, arr, "\""); file=arr } print > file }' processes.xml <process name="Process1.process"> ... (3 Replies)
Discussion started by: chiru_h
3 Replies

6. Shell Programming and Scripting

Problem with splitting large file based on pattern

Hi Experts, I have to split huge file based on the pattern to create smaller files. The pattern which is expected in the file is: Master..... First... second.... second... third.. third... Master... First.. second... third... Master... First... second.. second.. second..... (2 Replies)
Discussion started by: saisanthi
2 Replies

7. Shell Programming and Scripting

Help needed - Split large file into smaller files based on pattern match

Help needed urgently please. I have a large file - a few hundred thousand lines. Sample CP START ACCOUNT 1234556 name 1 CP END ACCOUNT CP START ACCOUNT 2224444 name 1 CP END ACCOUNT CP START ACCOUNT 333344444 name 1 CP END ACCOUNT I need to split this file each time "CP START... (7 Replies)
Discussion started by: frustrated1
7 Replies

8. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below <!--###### ###### START-->... (6 Replies)
Discussion started by: KishM
6 Replies

9. UNIX for Advanced & Expert Users

Split one file to many based on pattern

Hello All, I have records in a file in a pattern A,B,B,B,B,K,A,B,B,K Is there any command or simple logic I can pull out records into multiple files based on A record? I want output as File1: A,B,B,B,B,K File2: A,B,B,K (9 Replies)
Discussion started by: deal1dealer
9 Replies

10. Shell Programming and Scripting

Split files based on row delimiter count

I have a huge file (around 4-5 GB containing 20 million rows) which has text like: <EOFD>11<EOFD>22<EORD>2<EOFD>2222<EOFD>3333<EORD>3<EOFD>44<EOFD>55<EORD>66<EOFD>888<EOFD>9999<EORD> Actually above is an extracted file from a Sql Server with each field delimited by <EOFD> and each row ends... (8 Replies)
Discussion started by: amvip
8 Replies
addresses(5)                                                    File Formats Manual                                                   addresses(5)

NAME
addresses - formats for Internet mail addresses INTRODUCTION
A mail address is a string of characters containing @. Every mail address has a local part and a domain part. The domain part is everything after the final @. The local part is everything before. For example, the mail addresses God@heaven.af.mil @heaven.af.mil @at@@heaven.af.mil all have domain part heaven.af.mil. The local parts are God, empty, and @at@. Some domains have owners. It is up to the owner of heaven.af.mil to say how mail messages will be delivered to addresses with domain part heaven.af.mil. The domain part of an address is interpreted without regard to case, so God@heaven.af.mil God@HEAVEN.AF.MIL God@Heaven.AF.Mil all refer to the same domain. There is one exceptional address that does not contain an @: namely, the empty string. The empty string cannot be used as a recipient address. It can be used as a sender address so that the real sender doesn't receive bounces. QMAIL EXTENSIONS
The qmail system allows several further types of addresses in mail envelopes. First, an envelope recipient address without an @ is interpreted as being at envnoathost. For example, if envnoathost is heaven.af.mil, the address God will be rewritten as God@heaven.af.mil. Second, the address #@[] is used as an envelope sender address for double bounces. Third, envelope sender addresses of the form pre@host-@[] are used to support variable envelope return paths (VERPs). qmail-send will re- write pre@host-@[] as prerecip=domain@host for deliveries to recip@domain. Bounces directly from qmail-send will come back to pre@host. CHOOSING MAIL ADDRESSES
Here are some suggestions on choosing mail addresses for the Internet. Do not use non-ASCII characters. Under RFC 822 and RFC 821, these characters cannot be used in mail headers or in SMTP commands. In prac- tice, they are regularly corrupted. Do not use ASCII control characters. NUL is regularly corrupted. CR and LF cannot be used in some combinations and are corrupted in all. None of these characters are usable on business cards. Avoid spaces and the characters "<>()[],;: These all require quoting in mail headers and in SMTP. Many existing mail programs do not handle quoting properly. Do not use @ in a local part. @ requires quoting in mail headers and in SMTP. Many programs incorrectly look for the first @, rather than the last @, to find the domain part of an address. In a local part, do not use two consecutive dots, a dot at the beginning, or a dot at the end. Any of these would require quoting in mail headers. Do not use an empty local part; it cannot appear in SMTP commands. Avoid local parts longer than 64 characters. Be wary of uppercase letters in local parts. Some mail programs (and users!) will incorrectly convert God@heaven.af.mil to god@heaven.af.mil. Be wary of the following characters: $&!#~`'^*|{} Some users will not know how to feed these characters safely to their mail programs. In domain names, stick to letters, digits, dash, and dot. One popular DNS resolver has, under the banner of security, recently begun destroying domain names that contain certain other characters, including underscore. Exception: A dotted-decimal IP address in brackets, such as [127.0.0.1], identifies a domain owned by whoever owns the host at that IP address, and can be used safely. In a domain name, do not use two consecutive dots, a dot at the beginning, or a dot at the end. This means that, when a domain name is broken down into components separated by dots, there are no empty components. Always use at least one dot in a domain name. If you own the mil domain, don't bother using the address root@mil; most users will be unable to send messages to that address. Same for the root domain. Avoid domain names longer than 64 characters. ENCODED ADDRESSES IN SMTP COMMANDS
RFC 821 defines an encoding of mail addresses in SMTP. For example, the addresses God@heaven.af.mil a"quote@heaven.af.mil The Almighty.One@heaven.af.mil could be encoded in RCPT commands as RCPT TO:<God@heaven.af.mil> RCPT TO:<a"quote@heaven.af.mil> RCPT TO:<The Almighty.One@heaven.af.mil> There are several restrictions in RFC 821 on the mail addresses that can be used over SMTP. Non-ASCII characters are prohibited. The local part must not be empty. The domain part must be a sequence of elements separated by dots, where each element is either a component, a sequence of digits preceded by #, or a dotted-decimal IP address surrounded by brackets. The only allowable characters in components are letters, digits, and dashes. Every component must (believe it or not) have at least three characters; the first character must be a let- ter; the last character must not be a hyphen. ENCODED ADDRESSES IN MAIL HEADERS
RFC 822 defines an encoding of mail addresses in certain header fields in a mail message. For example, the addresses God@heaven.af.mil a"quote@heaven.af.mil The Almighty.One@heaven.af.mil could be encoded in a To field as To: God@heaven.af.mil, <@brl.mil:"a"quote"@heaven.af.mil>, "The Almighty".One@heaven.af.mil or perhaps To: < "God"@heaven .af.mil>, "a"quote" (Who?) @ heaven . af. mil , God<"The Almighty.One"@heaven.af.mil> There are several restrictions on the mail addresses that can be used in these header fields. Non-ASCII characters are prohibited. The domain part must be a sequence of elements separated by dots, where each element either (1) begins with [ and ends with ] or (2) is a nonempty string of printable ASCII characters not including any of ".<>()[],;: and not including space. SEE ALSO
envelopes(5), qmail-header(5), qmail-inject(8), qmail-remote(8), qmail-smtpd(8) addresses(5)
All times are GMT -4. The time now is 02:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy