Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Merge lines together in unix
Top Forums UNIX for Dummies Questions & Answers Merge lines together in unix Post 302448689 by ygemici on Thursday 26th of August 2010 04:38:39 PM
Old 08-26-2010
MySQL
Code:
# cat infile
2010-08-26 11:22:34,611 INFO [Thread-xxxx]- [(xxxx,2723)Service Message : 111
2010-08-26 11:28:11,573 INFO [Thread-abcd]- [(xxxxx,2723)Service Message : 000
2010-08-26 11:32:35,187 INFO [Thread-zs]- [(xxxxx,2581)Service Message : |LS
2010-08-26 11:33:35,189 INFO [Thread-zs]- [(xxxxx,2581)Service Message : 111
2010-08-26 11:33:35,189 INFO [Thread-zs]- [(xxxxx,2581)Service Message : 111
2010-08-26 11:34:36,189 INFO [Thread-zs]- [(xxxxx,2581)Service Message : 111
2010-08-26 11:35:37,573 INFO [Thread-abcd]- [(xxxxx,2724)Service Message : |LS
2010-08-26 11:36:38,189 INFO [Thread-zs]- [(xxxxx,2585)Service Message : 111

Code:
# ./justdoit
2010-08-26 11:22:34
2010-08-26 11:33:35 to 2010-08-26 11:34:36
2010-08-26 11:36:38

Code:
 
## justdoit ##
#!/bin/bash
notdel=111
rm -f tmpX 2>/dev/null
while read -r l
  do
    if [[ $(echo "$l" | grep $notdel) ]] ; then
     echo "$l" >> tmpX
    else
     cnt=$(cat tmpX 2>/dev/null | wc -l )
     y="";   x="N;"
      while [ $(( cnt -= 1 )) -gt 1 ]
       do
        y="$y$x";
       done
       sed -e '{/111/N;}' -e "{/111/!d;$y;bx}"  -e :x -e '{s/^\([^,]*\).*\n\([^,]*\).*$/\1 to \2/}' tmpX 2>/dev/null | sed 's/,.*//'
       rm -f tmpX
    fi
  done<infile
cnt=$(cat tmpX 2>/dev/null | wc -l )
y="";x="N;"
   while [ $(( cnt -= 1 )) -gt 1 ]
    do
     y="$y$x";
    done
      sed -e '{/111/N;}' -e '{s/^\([^,]*\).*\n\([^,]*\).*$/\1 to \2/}'  tmpX 2>/dev/null | sed 's/,.*//'

This User Gave Thanks to ygemici For This Post:
mnjx
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge lines into one

Source data file from oracle, terminated by ",". 'Cause some of fields have \r\n, then those lines were splitted into multiple lines in the expoted data file. Just vi this file, and found ^M. How to concatenate these line into one if it has a ^M at then end. thanks, (7 Replies)
Discussion started by: anypager
7 Replies

2. Shell Programming and Scripting

Merge two lines

Hi I have two lines of data formatted as displayed below shop, price, remark, date a,#N/A,order to -fd, 20091011 and would like it to be shop:a price:#N/A remark:order to -fd date:20091011 How can I do it? Many thanks (2 Replies)
Discussion started by: lalelle
2 Replies

3. Shell Programming and Scripting

Merge 2 lines in file

Hi All, I have a data in flat file like below. Some of the information are in second row. 111_ABCProcess ----- ----- IN 0/0 111_PQRTrimPRocess ----- ----- OI 0/0 111_ZigZagTrimProcess ----- ----- ... (1 Reply)
Discussion started by: Amit.Sagpariya
1 Replies

4. Shell Programming and Scripting

merge lines

Hi guys in input every 1st line 1st ID value located in 2nd line 1st occurrence . I need to print them down accordingly.. Thanx in advance input rs1040480_XXXXX.value rs1040481_YYYYY.value rs1040482_TXXXX.value 0.7408157 0.3410044 0.7408157 ... (7 Replies)
Discussion started by: stateperl
7 Replies

5. Shell Programming and Scripting

Merge two lines using sed

Hi, I am trying to merge two lines, first line starts with a particular pattern and second line ends with a particular pattern in a file. Something like: First line starts with say ABC Second line ends with say XYZ After a merge, the line should become ABC.......XYZ I tried... (14 Replies)
Discussion started by: Sunny Arora
14 Replies

6. UNIX for Dummies Questions & Answers

To merge a few lines to 1 line

Hi Experts, This is my input file. input.txt 0 /dev/fd 25 /var 1 /tmp 1 /var/run 1. If this file has single line, then leave it, print the single line else merge the 4 lines above into 1 line as below e.g (6 Replies)
Discussion started by: streddy
6 Replies

7. Shell Programming and Scripting

remove blank lines and merge lines in shell

Hi, I'm not a expert in shell programming, so i've come here to take help from u gurus. I'm trying to tailor a csv file that i got to make it work for the LOAD FROM command. I've a datatable csv of the below format - --in file format xx,xx,xx ,xx , , , , ,,xx, xxxx,, ,, xxx,... (11 Replies)
Discussion started by: dvah
11 Replies

8. Shell Programming and Scripting

Merge two non-consecutive lines

Hello - First post here. I need help combining two lines that are non-consecutive in a file. Using sed, awk or perl preferably. So the file looks as follows. Please note, the "Line#:" is there only for reference. The lines can only be distinguished by whether they have "start" or "done" in... (2 Replies)
Discussion started by: munkee
2 Replies

9. Shell Programming and Scripting

Merge lines

Hello I have a file with CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 How can merge the CAR and the COLOR + SIZE (if there are COLOR,SIZE) CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 Every line begin in... (4 Replies)
Discussion started by: sharong
4 Replies

10. Shell Programming and Scripting

Merge Lines

Hello I have an input as below this is test we are( ) one end of description I am looking for output this is test we are () one end of description (2 Replies)
Discussion started by: Tomlight
2 Replies

LEARN ABOUT DEBIAN

www::facebook::api::message

WWW::Facebook::API::Message(3pm)			User Contributed Perl Documentation			  WWW::Facebook::API::Message(3pm)

NAME

       WWW::Facebook::API::Message - Facebook Message

SYNOPSIS

	   use WWW::Facebook::API::Message;

DESCRIPTION

       Methods for accessing message with WWW::Facebook::API

SUBROUTINES
/METHODS
       base
	   Returns the WWW::Facebook::API base object.

       new Constructor.

       get_threads_in_folder( %params )
	   The message.getThreadsInFolder method of the Facebook API:

	       $response = $client->message->get_threads_in_folder(
		   folder_id => '0|1|4',
		   limit     => $limit,
	       );

DIAGNOSTICS

       None.

CONFIGURATION AND ENVIRONMENT

       WWW::Facebook::API::Message requires no configuration files or environment variables.

DEPENDENCIES

       See WWW::Facebook::API

INCOMPATIBILITIES

       None reported.

BUGS AND LIMITATIONS

       No bugs have been reported.

       Please report any bugs or feature requests to "bug-www-facebook-api@rt.cpan.org", or through the web interface at <http://rt.cpan.org>.

AUTHOR

       David Romano  "<unobe@cpan.org>"

LICENSE AND COPYRIGHT

       Copyright (c) 2010, David Romano "<unobe@cpan.org>". All rights reserved.

       This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic.

DISCLAIMER OF WARRANTY

       BECAUSE THIS SOFTWARE IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE SOFTWARE, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT
       WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND,
       EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
       THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE SOFTWARE IS WITH YOU. SHOULD THE SOFTWARE PROVE DEFECTIVE, YOU ASSUME THE COST OF
       ALL NECESSARY SERVICING, REPAIR, OR CORRECTION.

       IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR
       REDISTRIBUTE THE SOFTWARE AS PERMITTED BY THE ABOVE LICENSE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL, OR
       CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING
       RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE SOFTWARE TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF
       SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

perl v5.10.1							    2010-03-13					  WWW::Facebook::API::Message(3pm)
All times are GMT -4. The time now is 06:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy