Sponsored Content
Top Forums Shell Programming and Scripting Remove newline character between two delimiters Post 302652319 by sushine11 on Thursday 7th of June 2012 03:05:18 AM
Old 06-07-2012
Remove newline character between two delimiters

hi i am having delimited .dat file having content like below.

test.dat(5 line of records)
======
Code:
PT2~Stag~Pt2 Stag Test.
Updated~PT2 S T~Area~~UNCEF R20~~2012-05-24 ~2014-05-24~~
PT2~Stag y~Pt2 Stag Test.
Updated~PT2 S T~Area~METR~~~2012-05-24~2014-05-24~~test
PT2~Pt2 Stag Test~~PT2 S T~Area~~UNCEFACT R20~true~2012-05-24~2014-05-24~~

sometime we are getting newline character in between data(like its there in 1st 2 lines hence it get spilted into 4).we want newline char only at end of line. if any new line character coming in between then want to replace with space.each line have 11 delimiters.

expected output Smilie3 line)
==============
Code:
PT2~Stag~Pt2 Stag Test.Updated~PT2 S T~Area~~UNCEF R20~~2012-05-24 ~2014-05-24~~
PT2~Stag y~Pt2 Stag Test.Updated~PT2 S T~Area~METR~~~2012-05-24~2014-05-24~~
PT2~Pt2 Stag Test~~PT2 S T~Area~~UNCEFACT R20~true~2012-05-24~2014-05-24~~



can you please suggest any command for that.
thanks in advance!!!!!

Moderator's Comments:
Mod Comment How to use code tags

Last edited by Franklin52; 06-07-2012 at 04:15 AM.. Reason: Please use code tags
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove a newline character at the end of filename

Hi All, I have named a file with current date,time and year as follows: month=`date | awk '{print $2}'` date=`date | awk '{print $3}'` year=`date | awk '{print $6}'` time=`date +%Hh_%Mm_%Ss'` filename="test_"$month"_"$date"_"$year"_"$time".txt" > $filename The file is created with a... (2 Replies)
Discussion started by: amio
2 Replies

2. Shell Programming and Scripting

To remove the newline character while appending into a file

Hi All, We append the output of a file's size in a file. But a newline character is appended after the variable. Pls help how to clear this. filesize=`ls -l test.txt | awk `{print $5}'` echo File size of test.txt is $filesize bytes >> logfile.txt The output we got is, File size of... (4 Replies)
Discussion started by: amio
4 Replies

3. Shell Programming and Scripting

Remove newline character conditionally

Hi All, I have 5000 records like this Request_id|Type|Status|Priority|Ticket Submitted Date and Time|Actual Resolved Date and Time|Current Ticket Owner Group|Case final Ticket Owner Group|Customer Severity|Reported Symptom/Request|Component|Hot Topic|Reason for Missed SLA|Current Ticket... (2 Replies)
Discussion started by: j_53933
2 Replies

4. Shell Programming and Scripting

select contents between two delimiters (not working if newline in encountered)

Hi, I am facing difficulties in selecting the contents between two delimiters when there is a new line occurs.. Eg: >more sample.txt abcd -- this is the first line % efgh-- this is the second line and not able to print % ijkl -- this is the 3rd line % when i search for abcd and... (8 Replies)
Discussion started by: Balaji PK
8 Replies

5. Shell Programming and Scripting

any savant ? using AWK/SED to remove newline character between two strings : conditional removal

I'd like to remove (do a pattern or precise replacement - this I can handle in SED using Regex ) ---AFTER THE 1ST Occurrence ( i.e. on the 2nd occurrence - from the 2nd to fourth occurance ) of a specific string : type 1 -- After the 1st occurrence of 1 string1 till the 1st occurrence of... (4 Replies)
Discussion started by: sieger007
4 Replies

6. Shell Programming and Scripting

Remove \n <newline> character inside the records.

Hi, In my file, I have '\n' characters inside a single record. Because of this, a single records appears in many lines and looks like multiple records. In the below file. File 1 ==== 1,nmae,lctn,da\n t 2,ghjik,o\n ut,de\n fk Expected output after the \n removed File 2 =====... (5 Replies)
Discussion started by: machomaddy
5 Replies

7. Shell Programming and Scripting

Remove newline character or join the broken record

Hi, I have a very huge file, around 1GB of data. I want to remove the newline characters in the file but not preceded by the original end delimiter {} sample data will look like this 1234567 abcd{} 1234sssss as67 abcd{} 12dsad3dad 4sdad567 abcdsadd{} this should look like this... (6 Replies)
Discussion started by: ratheeshjulk
6 Replies

8. Shell Programming and Scripting

Remove last newline character..

Hi all.. I have a text file which looks like below: abcd efgh ijkl (blank space) I need to remove only the last (blank space) from the file. When I try wc -l the file name,the number of lines coming is 3 only, however blank space is there in the file. I have tried options like... (14 Replies)
Discussion started by: Sathya83aa
14 Replies

9. Shell Programming and Scripting

How to remove newline character if it is the only character in the entire file.?

I have a file which comes every day and the file data look's as below. Vi abc.txt a|b|c|d\n a|g|h|j\n Some times we receive the file with only a new line character in the file like vi abc.txt \n (8 Replies)
Discussion started by: rak Kundra
8 Replies

10. UNIX for Beginners Questions & Answers

Remove newline character from column spread over multiple lines in a file

Hi, I came across one issue recently where output from one of the columns of the table from where i am creating input file has newline characters hence, record in the file is spread over multiple lines. Fields in the file are separated by pipe (|) delimiter. As header will never have newline... (4 Replies)
Discussion started by: Prathmesh
4 Replies
Data::Stag::BaseHandler(3pm)				User Contributed Perl Documentation			      Data::Stag::BaseHandler(3pm)

NAME
Data::Stag::BaseHandler - Base class for writing tag stream handlers SYNOPSIS
# EXAMPLE 1 package MyPersonHandler; use base qw(Data::Stag::BaseHandler); # handler that prints <person> nodes as they are parsed; # after each <person> node is intercepted, it is discarded # (it does not go to form the final tree) sub e_person { my $self = shift; my $node = shift; printf "Person name:%s address:%s ", $node->sget('name'), $node->sget('address'); return; # prune this from tree } 1; # EXAMPLE 2 package MyStatsHandler; use base qw(Data::Stag::BaseHandler); # handler that modifies tree as it goes # changes <measurement><unit>inch</unit><quantity>10</quantity></measurement> # to <measurement><unit>cm</unit><quantity>25</quantity></measurement> sub e_measurement { my $self = shift; my $node = shift; if ($node->sget('unit') eq 'inch') { $node->set('unit', 'cm'); $node->set('quantity', $node->get('quantity') * 2.5); } return $node; # replace <measurement> with new data in result tree } 1; # Using the handlers my $handler = MyHandler->new; my $stag = Data::Stag->parse(-fh=>$fh, -handler=>$handler); # Using a handler from the command line: unix> stag-handle.pl -m MyHandler input.xml > post-processed.xml DESCRIPTION
Default Simple Event Handler, other handlers inherit from this class See also Data::Stag and Data::Stag::BaseGenerator Stag has an event-handling architecture; parsers or generators generate or fire events. Events can be hierarchical/nested, just like stag nodes. These events are caught by handlers. By default, uncaught events stack to form stag trees. Stag has built in parsers for parsing xml, sxpr and itext data. You can construct your own parsers for dealing with your own formats specific to your own data; these should inherit from Data::Stag::BaseGenerator Stag also has built in handlers for these formats. You can construct your own - either as modules that inherit from this one, or as hashes of anonymous subroutines. If you wish to write your own handler that writes out to another format, you may wish to inherit from Data::Stag::Writer CATCHING EVENTS This class catches Data::Stag node events (start, end and body) and allows the subclassing module to intercept these. Unintercepted events get pushed into a tree. The final tree is returned at the end of a parse() call This class can take SAX events and turn them into simple Data::Stag events the events recognised are start_event(node-name) evbody(node-data) end_event(node-name) and also event(node-name, node-data|[nodes]) which is just a wrapper for the other events you can either intercept these methods; or you can define methods s_<element_name> e_<element_name> that get called on the start/end of an event; you can dynamically change the structure of the tree by returning nodes from these methods. # the follow handler prunes <foo> nodes from the tree, and writes # out data from the <person> node # when parsing large datasets, it can be a good idea to prune nodes # from the tree, so the result tree of the parse is not too big my $h = Data::Stag->makehandler( foo => 0, person => sub { my $self = shift; my $node = shift; printf "Person name:%s address:%s ", $node->sget('name'), $node->sget('address'); return; }); my $parser = MyParser->new; $parser->handler($h); $parser->parse(-fh=>$fh); my $result_tree = $h->stag; PUBLIC METHODS - new Title: new Args: Return: L<Data::Stag::BaseHandler> Example: returns the tree that was built from all uncaught events tree (stag) Title: tree Synonym: stag Args: Return: L<Data::Stag> Example: print $parser->handler->tree->xml; returns the tree that was built from all uncaught events CAUGHT EVENTS
A Data::Stag::BaseGenerator class will generate events by calling the following methods on this class: start_event NODENAME evbody DATA end_event NODENAME {optional} event NODENAME DATA These events can be nested/hierarchical If uncaught, these events are stacked into a stag tree, which can be written as xml or one of the other stag formats PROTECTED METHODS - s_* Args: handler L<Data::Stag::BaseHandler> Return: Example: autogenerated method - called by the parser when ever it starts a node; * matches the node name override this class providing the name of the node you wish to intercept e_* Args: handler L<Data::Stag::BaseHandler>, node L<Data::Stag> Return: node L<Data::Stag> Example: autogenerated method - called by the parser when ever it ends a node; * matches the node name override this class providing the name of the node you wish to intercept CONSUMES define this in your handler class to make explicit the list of node names that your parser consumes; this is then used if your handler is placed in a chain package MyHandler; use base qw(Data::Stag::BaseHandler); sub CONSUMES {qw(person city)} sub e_person {....} sub e_city {....} depth Title: depth Args: Return: depth int Example: depth of the nested event tree up Title: up Args: dist int Return: node stag Example: $stag->up(-2); when called when intercepting a node <foo>, this will look dist up the tree to find the container node For example, if our data contains the node <blah> below: <blah> <foo> <a>1</b> </foo> <foo> <a>2</b> </foo> </blah> # and we have the following code: $h = Data::Stag->makehandler(foo=>sub { my ($self, $foo) = @_; print $foo->up(1)->xml; return}); The <foo> handler will be called twice; it will print the structure of the containing <blah> node, but the first time round, the <blah> node will not be complete up_to Title: up_to Args: nodename str Return: node stag Example: $stag->up_to('blah'); Similar to up(), but it will go up the container event nodes until it finds one with the matching name perl v5.10.0 2008-06-03 Data::Stag::BaseHandler(3pm)
All times are GMT -4. The time now is 01:46 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy