Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to concatenate lines with specific pattern?
Top Forums Shell Programming and Scripting How to concatenate lines with specific pattern? Post 302825937 by nixtime on Tuesday 25th of June 2013 12:36:43 PM
Old 06-25-2013
Question How to concatenate lines with specific pattern?
How to concatenate lines with specific pattern?
I have data dumped from a table into text file. In some occurrence the data row is split into two rows.

Example:

Code:
 
12345678|Global Test|Global Test Task|My Request|Date|Date|Date|1|1|
12345679|Global Test2|Global Test Task2|My Request2|Date|Date|Date|2|2|
12345680|Global Test1232|Global Test Task2|My Request2|Date|Date|Date|3|3|
12345681|Global Test1232123455|Global Test Task2343212312334
|My Request 3|Date|Date|4|4|
12345682|Global Test|Global Test Task|My Request|Date|Date|Date|1|1|

Expected Result:

Code:
 
12345678|Global Test|Global Test Task|My Request|Date|Date|Date|1|1|
12345679|Global Test2|Global Test Task2|My Request2|Date|Date|Date|2|2|
12345680|Global Test1232|Global Test Task2|My Request2|Date|Date|Date|3|3|
12345681|Global Test1232123455|Global Test Task2343212312334|My Request 3|Date|Date|4|4|
12345682|Global Test|Global Test Task|My Request|Date|Date|Date|1|1|

In the example above. Line #4 and #5 is one data row. The text file has about 300K+ rows.

Basically concatenate the current line with the next line if the next line starts with '|'.
Last edited by nixtime; 06-25-2013 at 01:47 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Concatenate lines between lines starting with a specific pattern

Hi, I have a file such as: --- >contig00001 length=35524 numreads=2944 gACGCCGCGCGCCGCGGCCAGGGCTGGCCCA CAGGCCGCGCGGCGTCGGCTGGCTGAG >contig00002 length=4242 numreads=43423 ATGCCGAAGGTCCGCCTGGGGCTGG CGCCGGGAGCATGTAGCG --- I would like to concatenate the lines not starting with ">"... (9 Replies)
Discussion started by: s052866
9 Replies

2. Shell Programming and Scripting

how to delete lines from a file which starts with a specific pattern

I need to delete those lines from a file, which starts with 45. How to do it? (3 Replies)
Discussion started by: mady135
3 Replies

3. Shell Programming and Scripting

merging of 2 consecutive lines in a file for a specific pattern

Hi , I'm looking for a way to merge two lines only for a given pattern / condition. Input : abcd/dad + -49.201 2.09 -49.5 34 ewrew rewtre * fdsgfds/dsgf/sdfdsfasdd + -4.30 0.62 -49.5 45 sdfdsf cvbbv * sdfds/retret/asdsaddsa + ... (1 Reply)
Discussion started by: novice_man
1 Replies

4. Shell Programming and Scripting

NAWK to remove lines that matches a specific pattern

Hi, I have requirement that I need to split my input file into two files based on a search pattern "abc" For eg. my input file has below content abc defgh zyx I need file 1 with abc and file2 with defgh zyx I can use grep command to acheive this. But with grep I need... (8 Replies)
Discussion started by: sbhuvana20
8 Replies

5. Shell Programming and Scripting

Delete multiple lines starting with a specific pattern

Hi, just tried some script, awk, sed for the last 2 hours and now need help. Let's say I have a huge file of 800,000 lines like this : It's a tedious job to look through it, I'd like to remove those useless lines in it as there's a few thousands : Or to be even more precise : if line1 =... (6 Replies)
Discussion started by: Zurd
6 Replies

6. Shell Programming and Scripting

Append lines for a specific pattern

Input: 09:43:46,538 INFO first text 10:45:46,538 INFO second text 11:00:46,538 INFO third more text Output: 09:43:46,538 INFO first text 10:45:46,538 INFO second text 11:00:46,538 INFO third more text The rule is to append all lines so each line contains this format... (7 Replies)
Discussion started by: chitech
7 Replies

7. Shell Programming and Scripting

Want to get lines before specific pattern

Hi , I want to insert data into a new file after grepping specific pattern . for more info please read following for example: abc=12345678902222 def=45678904444 ------- ------- INAVLID ABC I want to "INAVLID ABC" grep above pattern from multiple files and want to write abc value and ... (3 Replies)
Discussion started by: vipin auja
3 Replies

8. Shell Programming and Scripting

Vi editor deleting lines with specific pattern

Hi, I need to delete all lines in the file using vi editor which start with word aternqaco. Please assist. aternqaco.__oracle_base='/amdbqa01/app/oracle'#ORACLE_BASE set from environment aternqa.__oracle_base='/amdbqa01/app/oracle'#ORACLE_BASE set from environment... (3 Replies)
Discussion started by: Vishal_dba
3 Replies

9. Shell Programming and Scripting

Delete lines that contain a pattern from specific line to the end.

Gents, I am trying to delete all lines which start with "H" character, but keeping the fist header. Example In the input file I will delete all lines starting from line 8 which contents character "H" to the end of the file. I try sed '8,10000{/^H/d;}' file But as don't know the end... (1 Reply)
Discussion started by: jiam912
1 Replies

10. Shell Programming and Scripting

Print all lines between two keyword if a specific pattern exist

I have input file as below I need to check for a pattern and if it is there in file then I need to print all the lines below BEGIN and END keyword. Could you please help me how to get this in AIX using sed or awk. Input file: ABC ******** BEGIN ***** My name is Amit. I am learning unix.... (8 Replies)
Discussion started by: Amit Joshi
8 Replies

LEARN ABOUT DEBIAN

date::calc::xs

Date::Calc::XS(3pm)					User Contributed Perl Documentation				       Date::Calc::XS(3pm)

NAME

       Date::Calc::XS - XS wrapper and C library plug-in for Date::Calc

SYNOPSIS

       You never use this module directly.  Use Date::Calc(3) instead!

DESCRIPTION

       You never use this module directly.  Use Date::Calc(3) instead!

SEE ALSO

       Date::Calc(3), Date::Calc::PP(3).

VERSION

       This man page documents "Date::Calc::XS" version 6.3.

AUTHOR

	 Steffen Beyer
	 mailto:STBEY@cpan.org
	 http://www.engelschall.com/u/sb/download/

COPYRIGHT

       Copyright (c) 1995 - 2012 by Steffen Beyer. All rights reserved.

LICENSE

       This package is free software; you can use, modify and redistribute it under the same terms as Perl itself, i.e., at your option, under the
       terms either of the "Artistic License" or the "GNU General Public License".

       The C library at the core of the module "Date::Calc::XS" can, at your discretion, also be used, modified and redistributed under the terms
       of the "GNU Library General Public License".

       Please refer to the files "Artistic.txt", "GNU_GPL.txt" and "GNU_LGPL.txt" in the "license" subdirectory of this distribution for any
       details!

DISCLAIMER

       This package is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
       MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

       See the "GNU General Public License" for more details.

perl v5.14.2							    2012-05-17						       Date::Calc::XS(3pm)
All times are GMT -4. The time now is 11:28 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy