Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Using sed command to remove multiple instances of repeating headers in one file?
Top Forums UNIX for Dummies Questions & Answers Using sed command to remove multiple instances of repeating headers in one file? Post 302560348 by rebazon on Thursday 29th of September 2011 01:27:57 PM
Old 09-29-2011
Using sed command to remove multiple instances of repeating headers in one file?
Hi,
I have catenated multiple output files (from a monte carlo run) into one big output file. Each individual file has it's own two line header. So when I catenate, there are multiple two line headers (of the same wording) within the big file. How do I use the sed command to search for the header lines and remove them? Or, is there a way to include this in the cat command (i.e., cat all files, minus the first to lines of each file?)? Thanks so much for your help!
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help:how to remove headers in output file

Hi I am running a script (which compares two directory contents) for which I am getting an output of 70 pages in which few pages are blank so I was able to delete those blank lines. But I also want to delete the headers present for each page. can any one help me by providing the code... (1 Reply)
Discussion started by: raj_thota
1 Replies

2. Shell Programming and Scripting

Remove all instances of duplicate records from the file

Hi experts, I am new to scripting. I have a requirement as below. File1: A|123|NAME1 A|123|NAME2 B|123|NAME3 File2: C|123|NAME4 C|123|NAME5 D|123|NAME6 1) I have 2 merge both the files. 2) need to do a sort ( key fields are first and second field) 3) remove all the instances... (3 Replies)
Discussion started by: vukkusila
3 Replies

3. Shell Programming and Scripting

Remove text between headers while leaving headers intact

Hi, I'm trying to strip all lines between two headers in a file: ### BEGIN ### Text to remove, contains all kinds of characters ... Antispyware-Downloadserver.com (Germany)=http://www.antispyware-downloadserver.c om/updates/ Antispyware-Downloadserver.com #2... (3 Replies)
Discussion started by: Trones
3 Replies

4. Shell Programming and Scripting

Remove repeating pattern from beginning of file names.

I want a shell script that will traverse a file system starting at specific path. And look at all file names for repeating sequences of and remove them from the file name. The portion of the name that gets removed has to be a repeating sequence of the same characters. So the script would... (3 Replies)
Discussion started by: z399y
3 Replies

5. UNIX for Dummies Questions & Answers

sed remove two headers; writing more elegant code

Hi there, I have two questions. First, I was wondering how to use sed to remove two header lines or two tail lines. Here I just do the same operation twice...I'm sure there is a better way. Second, and more importantly, is there a better way to have these operations use files other than... (5 Replies)
Discussion started by: mikey11415
5 Replies

6. Shell Programming and Scripting

sed remove multiple set of lines in one command

is there a way with sed to removed more than one set of lines in one line? so i mean sed ${firstElem},${lastIndex}d web.xml > web1.xml this will delete lines between ${firstElem},${lastIndex} i want in the same line to do somethinkg like this (doesn't work so far) sed... (3 Replies)
Discussion started by: Poki
3 Replies

7. Shell Programming and Scripting

How to remove a semi-repeating character in position 1 of a file

My file is in a good column format but several lines in the file begin with a zero. I'm in KSH and looking for a command to remove this zero and keep the text next to it. I don't want any of the zeros in the other columns removed. Below is a snip from the file... all I need to do is remove that... (2 Replies)
Discussion started by: right_coaster
2 Replies

8. Shell Programming and Scripting

Sed replace using same pattern repeating multiple times in a line

Sed replace using same pattern repeating multiple times in a line I have text like below in a file: I am trying to replace the above line to following How can I acheive this? I am able to do it if the occurrence is for 1 time: But If I try like below I am getting like this: I have to... (4 Replies)
Discussion started by: sol_nov
4 Replies

9. Shell Programming and Scripting

Faster command to remove headers for files in a directory

Good evening Im new at unix shell scripting and im planning to script a shell that removes headers for about 120 files in a directory and each file contains about 200000 lines in average. i know i will loop files to process each one and ive found in this great forum different solutions... (5 Replies)
Discussion started by: alexcol
5 Replies

10. Shell Programming and Scripting

awk and or sed command to sum the value in repeating tags in a XML

I have a XML in which <Amt Ccy="EUR">3.1</Amt> tag repeats. This is under another tag <Main>. I need to sum all the values of <Amt Ccy=""> (Ccy may vary) coming under <Main> using awk and or sed command. can some help? Sample looks like below <root> <Main> ... (6 Replies)
Discussion started by: bk_12345
6 Replies

LEARN ABOUT PLAN9

pr

PR(1)							      General Commands Manual							     PR(1)

NAME

       pr - print file

SYNOPSIS

       pr [ option ...	] [ file ...  ]

DESCRIPTION

       Pr  produces  a printed listing of one or more files on its standard output.  The output is separated into pages headed by a date, the name
       of the file or a specified header, and the page number.	With no file arguments, pr prints its standard input.

       Options apply to all following files but may be reset between files:

       -n     Produce n-column output.

       +n     Begin printing with page n.

       -b     Balance columns on last page, in case of multi-column output.

       -d     Double space.

       -en    Set the tab stops for input text every n spaces.

       -h     Take the next argument as a page header (file by default).

       -in    Replace sequences of blanks in the output by tabs, using tab stops set every n spaces.

       -f     Use formfeeds to separate pages.

       -ln    Take the length of the page to be n lines instead of the default 66.

       -m     Print all files simultaneously, each in one column.

       -n     Number the lines of each file.

       -on    Offset the left margin n character positions.

       -sc    Separate columns by the single character c instead of aligning them with white space.  A missing c is taken to be a tab.

       -t     Do not print the 5-line header or the 5-line trailer normally supplied for each page.

       -wn    For multi-column output, take the width of the page to be n characters instead of the default 72.

SOURCE

       /sys/src/cmd/pr.c

SEE ALSO

       cat(1), lp(1)

																	     PR(1)
All times are GMT -4. The time now is 07:55 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy