Sponsored Content
Top Forums Shell Programming and Scripting Removing consecutive lines in a file Post 302562012 by deneuve01 on Wednesday 5th of October 2011 05:12:55 PM
Old 10-05-2011
Question Removing consecutive lines in a file

We have very large transaction logs that have transactions which start with a line that starts with 'Begin :' and ends with a line that starts with 'End :'. For most transactions there is valid data between those two lines.

I am trying to get rid of lines that look like this:

Begin : Transaction Id 1245 04-Oct-2011 04:01:48 Username smith
End : Transaction Id 1245 04-Oct-2011 04:01:49

So, get rid of the first line, then get rid of the very next line if that next line starts with 'End :'. If there is data between, I want to preserve those lines throughout the entire file.

Thank you !
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Cutting n consecutive lines from a file...

Hi, I have this problem of separating 10 consecutive lines from a file, say starting from 21 to 30... I have used a filter like this.. head -n 30 myfile | tail -n 10 Is there a simpler way than this? (2 Replies)
Discussion started by: Vishnu
2 Replies

2. Shell Programming and Scripting

merging of 2 consecutive lines in a file for a specific pattern

Hi , I'm looking for a way to merge two lines only for a given pattern / condition. Input : abcd/dad + -49.201 2.09 -49.5 34 ewrew rewtre * fdsgfds/dsgf/sdfdsfasdd + -4.30 0.62 -49.5 45 sdfdsf cvbbv * sdfds/retret/asdsaddsa + ... (1 Reply)
Discussion started by: novice_man
1 Replies

3. Shell Programming and Scripting

Find time difference between two consecutive lines in same file.

Hello I have a file in following format: IV 08:09:07 NM 08:12:01 IC 08:12:00 MN 08:14:20 NM 08:14:15 I need a script to compare time on each line with previous line and show the inconsecutive line. Ex.: 08:12:00 08:14:15 A better way... (6 Replies)
Discussion started by: vilibit
6 Replies

4. Shell Programming and Scripting

how to delete two consecutive lines from the file

Hi guys I am deleting a unique line from the file and also need to remove the line above it which is NOT unique and servers as a record separator. Here is an example: # 101 803E 823F 8240 # 102 755f 4F2A 4F2B # 290 747D 0926 0927 # 999 8123 813E ... (5 Replies)
Discussion started by: aoussenko
5 Replies

5. Shell Programming and Scripting

Scan a file in realtime and execute certain commands on encountering 5 consecutive identical lines

Mysql log has something like below: I need a bash shell script that will do the following: 1) The script will scan the mysql.log file constantly in real time (something like tail -F mysql.log) 2) If it encounters 5 consecutive identical lines then it would invoke some commands (say... (4 Replies)
Discussion started by: proactiveaditya
4 Replies

6. Shell Programming and Scripting

How to compare the values of a column in awk in a same file and consecutive lines..

I would like to compare the values of 2nd column of consecutive lines of same file in such a way so that if the difference between first value and second value is more than 100 it should print complete line else ignore line. Input File ========== PDB 2500 RTDB 123 RTDB-EAGLE 122 VSCCP 2565... (4 Replies)
Discussion started by: manuswami
4 Replies

7. UNIX for Dummies Questions & Answers

Delete 26 consecutive lines in a file

I have a text file that is about 90,000 lines long. How would I delete lines 64-89, 152-177, 240-265, 328-353... etc? The sections I would like to delete are 26 lines long and the number of lines between the sections I would like to delete is 62 lines. Thanks very much in advance. (6 Replies)
Discussion started by: MDeBiasse
6 Replies

8. Shell Programming and Scripting

Grep 2 consecutive lines and replace the second line in a file

I have a file lake this cat ex1.txt </DISCOUNTS> <B2B_SPECIFICATION elem="0"> <B2B_SPECIFICATION elem="0"> <DESCR>Netti 2 </DESCR> <NUMBER>D02021507505</NUMBER> </B2B_SPECIFICATION> <B2B_SPECIFICATION elem="1"> <DESCR>Puhepaketti</DESCR>... (2 Replies)
Discussion started by: Dhoni
2 Replies

9. Shell Programming and Scripting

Removing 3 consecutive lines from script

Hi I need to remove three consecutive lines of code which appear multiple times during a script. Two of the lines also appear in other parts of the scripts and need to stay so I can't strip out the code per se - It needs to be the exact three lines. Hope that makes sense ! Any help much... (5 Replies)
Discussion started by: Grueben
5 Replies

10. Shell Programming and Scripting

Delete all CONSECUTIVE text lines from file shell scripting

Hi I have a text file like below. THe content of the text will vary. Entire text file have four consecutive lines followed with blank line. I want to delete the occurrence of the two consicutive lines in the text file. I don't have pattern to match and delete. Just i need to delete all... (5 Replies)
Discussion started by: RJSKR28
5 Replies
GROFF_ME(7)                                              Miscellaneous Information Manual                                              GROFF_ME(7)

NAME
groff_me - troff macros for formatting papers SYNOPSIS
groff -me [ options ] file ... groff -m me [ options ] file ... DESCRIPTION
This manual page describes the GNU version of the -me macros, which is part of the groff document formatting system. This version can be used with both GNU troff and Unix troff. This package of troff macro definitions provides a canned formatting facility for technical papers in various formats. The macro requests are defined below. Many troff requests are unsafe in conjunction with this package, however, these requests may be used with impunity after the first .pp: .bp begin new page .br break output line here .sp n insert n spacing lines .ls n (line spacing) n=1 single, n=2 double space .na no alignment of right margin .ce n center next n lines .ul n underline next n lines Output of the pic, eqn, refer, and tbl preprocessors is acceptable as input. FILES
/usr/share/groff/1.21/tmac/me.tmac (a wrapper file for e.tmac) /usr/share/groff/1.21/tmac/e.tmac SEE ALSO
groff(1), troff(1) -me Reference Manual, Eric P. Allman Writing Papers with Groff Using -me REQUESTS
This list is incomplete; see The -me Reference Manual for interesting details. Request Initial Cause Explanation Value Break .(c - yes Begin centered block .(d - no Begin delayed text .(f - no Begin footnote .(l - yes Begin list .(q - yes Begin major quote .(x x - no Begin indexed item in index x .(z - no Begin floating keep .)c - yes End centered block .)d - yes End delayed text .)f - yes End footnote .)l - yes End list .)q - yes End major quote .)x - yes End index item .)z - yes End floating keep .++ m H - no Define paper section. m defines the part of the paper, and can be C (chapter), A (appendix), P (preliminary, e.g., abstract, table of contents, etc.), B (bibliography), RC (chapters renumbered from page one each chapter), or RA (ap- pendix renumbered from page one). .+c T - yes Begin chapter (or appendix, etc., as set by .++). T is the chapter title. .1c 1 yes One column format on a new page. .2c 1 yes Two column format. .EN - yes Space after equation produced by eqn or neqn. .EQ x y - yes Precede equation; break out and add space. Equation number is y. The optional argument x may be I to indent equation (default), L to left-adjust the equation, or C to center the equation. .GE - yes End gremlin picture. .GS - yes Begin gremlin picture. .PE - yes End pic picture. .PS - yes Begin pic picture. .TE - yes End table. .TH - yes End heading section of table. .TS x - yes Begin table; if x is H table has repeated heading. .b x no no Print x in boldface; if no argument switch to boldface. .ba +n 0 yes Augments the base indent by n. This indent is used to set the indent on regular text (like paragraphs). .bc no yes Begin new column .bi x no no Print x in bold italics (nofill only) .bu - yes Begin bulleted paragraph .bx x no no Print x in a box (nofill only). .ef 'x'y'z' '''' no Set even footer to x y z .eh 'x'y'z' '''' no Set even header to x y z .fo 'x'y'z' '''' no Set footer to x y z .hx - no Suppress headers and footers on next page. .he 'x'y'z' '''' no Set header to x y z .hl - yes Draw a horizontal line .i x no no Italicize x; if x missing, italic text follows. .ip x y no yes Start indented paragraph, with hanging tag x. Indentation is y ens (default 5). .lp yes yes Start left-blocked paragraph. .np 1 yes Start numbered paragraph. .of 'x'y'z' '''' no Set odd footer to x y z .oh 'x'y'z' '''' no Set odd header to x y z .pd - yes Print delayed text. .pp no yes Begin paragraph. First line indented. .r yes no Roman text follows. .re - no Reset tabs to default values. .sh n x - yes Section head follows, font automatically bold. n is level of section, x is title of section. .sk no no Leave the next page blank. Only one page is remembered ahead. .sm x - no Set x in a smaller pointsize. .sz +n 10p no Augment the point size by n points. .tp no yes Begin title page. .u x - no Underline argument (even in troff). (Nofill only). .uh - yes Like .sh but unnumbered. .xp x - no Print index x. 3rd Berkeley Distribution 31 December 2010 GROFF_ME(7)
All times are GMT -4. The time now is 10:54 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy