10-15-2009
Large pipe delimited file that I need to add CR/LF every n fields
I have a large flat file with variable length fields that are pipe delimited. The file has no new line or CR/LF characters to indicate a new record. I need to parse the file and after some number of fields, I need to insert a CR/LF to start the next record.
Input file
1|b|c|d|e|f|g|h|i|j|k|l|m|n|o|p|q|r|s|t
If counting 4 fields, I need the output to be
1|b|c|d
e|f|g|h
i|j|k|l
m|n|o|p
q|r|s|t
Thank you for your assistance
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a pipe delimited input file as below. First byte of the each line indicate the record type. Then i need to split the file based on record_type = null,0,1,2,6 and create 5 files. How do i do this in a ksh script? Pls help
|sl||SL|SL|SL|1996/04/03|1988/09/15|C|A|sl||||*|... (4 Replies)
Discussion started by: njgirl
4 Replies
2. Shell Programming and Scripting
i have a file whose data is like this::
osr_pe_assign|-120|wg000d@att.com|4|
osr_evt|-21|wg000d@att.com|4|
pe_avail|-21|wg000d@att.com|4|
osr_svt|-11|wg000d@att.com|4|
pe_mop|-13|wg000d@att.com|4|
instar_ready|-35|wg000d@att.com|4|
nsdnet_ready|-90|wg000d@att.com|4|... (6 Replies)
Discussion started by: priyanka3006
6 Replies
3. UNIX for Dummies Questions & Answers
I have a large(ish) pipe delimited file.
The last line of the file contains a total row count and a checksum:
END|1537451|1328569446
After making other adjustments to the file, I need to strip out the checksum and apply a new value - I have a script to generate the checksum and 'cat' it... (3 Replies)
Discussion started by: relentl3ss
3 Replies
4. Shell Programming and Scripting
Hi All,
I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted...
AA ATIU2345098809 009697 005374
BB ATIU2345097809 005445 006518
CC ATIU9685098809 003215 003571
DD... (7 Replies)
Discussion started by: nithins007
7 Replies
5. UNIX for Dummies Questions & Answers
Hi Guys,
i am reading a pipe delimited file using awk command.
I have tested the gawk separately. it was fine.
But when i execute the script. i am getting the following error saying command not found.
Can somebody point out as what i am doing wrong.
Cheers!!! (3 Replies)
Discussion started by: mac4rfree
3 Replies
6. UNIX for Advanced & Expert Users
Can anybody help me how to check whether a file is Pipe delimited or not? (1 Reply)
Discussion started by: Allwin333
1 Replies
7. UNIX for Dummies Questions & Answers
i need to add a new field in a pipe delimited line. the field will be the current date today.
aa|a|s|w|1
as|oiy|oiy|oiy|2
given that all lines are uniformed in the number of fields
i want it to look like this:\
aa|a|s|w|1|20120126
as|oiy|oiy|oiy|2|20120126
please help :) (3 Replies)
Discussion started by: kokoro
3 Replies
8. Shell Programming and Scripting
I have a file which was pipe delimited, I need to make it tab delimited. I tried with sed but no use
cat file | sed 's/|//t/g'
The above command substituted "/t" not tab in the place of pipe.
Sample file:
abc|123|2012-01-30|2012-04-28|xyz
have to convert to:
abc 123... (6 Replies)
Discussion started by: karumudi7
6 Replies
9. Shell Programming and Scripting
Hi guys,
I need to know how i can ignore Pipe '|' if Pipe is coming as a column in Pipe delimited file
for eg:
file 1:
xx|yy|"xyz|zzz"|zzz|12...
using below awk command
awk 'BEGIN {FS=OFS="|" } print $3
i would get xyz
But i want as :
xyz|zzz to consider as whole column... (13 Replies)
Discussion started by: rohit_shinez
13 Replies
10. UNIX for Dummies Questions & Answers
Hi, I have a rquirement in unix as below .
I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column.
ex:
Input Text file:
1|A|apple
2|B|bottle
excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies
LEARN ABOUT DEBIAN
kinosearch1::queryparser::queryparser
KinoSearch1::QueryParser::QueryParser(3pm) User Contributed Perl Documentation KinoSearch1::QueryParser::QueryParser(3pm)
NAME
KinoSearch1::QueryParser::QueryParser - transform a string into a Query object
SYNOPSIS
my $query_parser = KinoSearch1::QueryParser::QueryParser->new(
analyzer => $analyzer,
fields => [ 'bodytext' ],
);
my $query = $query_parser->parse( $query_string );
my $hits = $searcher->search( query => $query );
DESCRIPTION
The QueryParser accepts search strings as input and produces Query objects, suitable for feeding into KinoSearch1::Searcher.
Syntax
The following constructs are recognized by QueryParser.
o Boolean operators 'AND', 'OR', and 'AND NOT'.
o Prepented +plus and -minus, indicating that the labeled entity should be either required or forbidden -- be it a single word, a phrase,
or a parenthetical group.
o Logical groups, delimited by parentheses.
o Phrases, delimited by double quotes.
o Field-specific terms, in the form of "fieldname:termtext". (The field specified by fieldname will be used instead of the QueryParser's
default fields).
A field can also be given to a logical group, in which case it is the same as if the field had been prepended onto every term in the
group. For example: "foo:(bar baz)" is the same as "foo:bar foo:baz".
METHODS
new
my $query_parser = KinoSearch1::QueryParser::QueryParser->new(
analyzer => $analyzer, # required
fields => [ 'bodytext' ], # required
default_boolop => 'AND', # default: 'OR'
);
Constructor. Takes hash-style parameters:
o analyzer - An object which subclasses KinoSearch1::Analysis::Analyzer. This must be identical to the Analyzer used at index-time, or
the results won't match up.
o fields - the names of the fields which will be searched against. Must be supplied as an arrayref.
o default_field - deprecated. Use "fields" instead.
o default_boolop - two possible values: 'AND' and 'OR'. The default is 'OR', which means: return documents which match any of the query
terms. If you want only documents which match all of the query terms, set this to 'AND'.
parse
my $query = $query_parser->parse( $query_string );
Turn a query string into a Query object. Depending on the contents of the query string, the returned object could be any one of several
subclasses of KinoSearch1::Search::Query.
COPYRIGHT
Copyright 2005-2010 Marvin Humphrey
LICENSE, DISCLAIMER, BUGS, etc.
See KinoSearch1 version 1.00.
perl v5.14.2 2011-11-15 KinoSearch1::QueryParser::QueryParser(3pm)