Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove Headers throughout a data file
Top Forums Shell Programming and Scripting Remove Headers throughout a data file Post 302192572 by psmall on Wednesday 7th of May 2008 09:19:43 AM
Old 05-07-2008
Remove Headers throughout a data file
I have a data file with over 500,000 records/lines that has the header throughout the file.

SEQ_ID Name Start_Date Ins_date Add1 Add2
1 Harris 04/02/08 03/02/08 333 Main Suite 101
2 Smith 02/03/08 01/23/08 287 Jenkins
SEQ_ID Name Start_Date Ins_date Add1 Add2
3 Norman 03/02/08 03/02/08 14 Florida Suite A
4 Stephen 04/10/08 01/23/08 200 4th St 3rd Floor

There is no particular pattern to where the headers maybe in the file. How would I go about it. I assume it will be a grep then remove the files and deleting the spaces but I am not sure of how to do that as well as getting the loop to stop or do it as a one line command?
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help:how to remove headers in output file

Hi I am running a script (which compares two directory contents) for which I am getting an output of 70 pages in which few pages are blank so I was able to delete those blank lines. But I also want to delete the headers present for each page. can any one help me by providing the code... (1 Reply)
Discussion started by: raj_thota
1 Replies

2. UNIX for Dummies Questions & Answers

Remove certain headers using mailx or sendmail

Hello, So i want to send mails in any way from a solaris 5.8 system, perhaps using mailx or sendmail. My purpose is to stay clear of systems name in head data. So i want to strip at least the "Message-Id" and the "Recieved" headers of the mail. Yet this seems to be a bit of a problem. Now i... (2 Replies)
Discussion started by: congo
2 Replies

3. Shell Programming and Scripting

Remove text between headers while leaving headers intact

Hi, I'm trying to strip all lines between two headers in a file: ### BEGIN ### Text to remove, contains all kinds of characters ... Antispyware-Downloadserver.com (Germany)=http://www.antispyware-downloadserver.c om/updates/ Antispyware-Downloadserver.com #2... (3 Replies)
Discussion started by: Trones
3 Replies

4. Shell Programming and Scripting

Merging of files with different headers to make combined headers file

Hi , I have a typical situation. I have 4 files and with different headers (number of headers is varible ). I need to make such a merged file which will have headers combined from all files (comman coluns should appear once only). For example - File 1 H1|H2|H3|H4 11|12|13|14 21|22|23|23... (1 Reply)
Discussion started by: marut_ashu
1 Replies

5. UNIX for Dummies Questions & Answers

sed remove two headers; writing more elegant code

Hi there, I have two questions. First, I was wondering how to use sed to remove two header lines or two tail lines. Here I just do the same operation twice...I'm sure there is a better way. Second, and more importantly, is there a better way to have these operations use files other than... (5 Replies)
Discussion started by: mikey11415
5 Replies

6. Shell Programming and Scripting

Remove interspersed headers in .dat file with AWK

Heya there, A small selection of my data is shown below. DATE TIME FRAC_DAYS_SINCE_JAN1 2011-06-25 08:03:20.000 175.33564815 2011-06-25 08:03:25.000 175.33570602 2011-06-25 ... (4 Replies)
Discussion started by: gd9629
4 Replies

7. UNIX for Dummies Questions & Answers

Using sed command to remove multiple instances of repeating headers in one file?

Hi, I have catenated multiple output files (from a monte carlo run) into one big output file. Each individual file has it's own two line header. So when I catenate, there are multiple two line headers (of the same wording) within the big file. How do I use the sed command to search for the... (1 Reply)
Discussion started by: rebazon
1 Replies

8. Shell Programming and Scripting

Remove headers thar dont match

Good evening I need your help please, im new at Unix and i wanted to remove the first 5 headers for 100000 records files and then create a control file .ctl that contains the number of records and all seem to work out but when i tested at production it didnt wotk. Here is the code: #!... (6 Replies)
Discussion started by: alexcol
6 Replies

9. Shell Programming and Scripting

Remove white space and duplicate headers

I have a file called "dsout" with empty rows and duplicate headers. DATE TIME TOTAL_GB USED_GB %USED --------- -------- ---------- ---------- ---------- 03/05/013 12:34 PM 3151.24316 2331.56653 73.988785 ... (3 Replies)
Discussion started by: Daniel Gate
3 Replies

10. Shell Programming and Scripting

Checking data in csv file after headers

I had a requirement to check if data exists after headers (typically row 2 & so on) in csv file. please help how we can check through shellscript in linux. Thank you !! (1 Reply)
Discussion started by: chandu123
1 Replies

LEARN ABOUT OPENSOLARIS

iicpbmp

iicpbmp(1M)						  System Administration Commands					       iicpbmp(1M)

NAME

       iicpbmp - copy Availability Suite Point-In-Time bitmap volumes

SYNOPSIS

       iicpbmp [-c] old_bitmap new_bitmap...

DESCRIPTION

       The iicpbmp command copies an Availability Suite Point-in-Time bitmap volume, rewriting the bitmap header so that it is consistent with the
       new bitmap volume name. The configuration entry for the shadow set is rewritten to reflect the location of the new bitmap.

       No checks on the current use of either the old or new bitmap volumes are made. The iicpbmp command should only be run  when  the  Point-In-
       Time Copy shadow set using the old bitmap is suspended.

OPTIONS

       -c	    Do	not  attempt  to  update  the Availability Suite configuration for the Point-in-Time shadow set that uses the bitmap. This
		    option produces a duplicate of the bitmap but does not affect the shadow set using the old bitmap volume.

OPERANDS

       old_bitmap new_bitmap

	   The old and new Point-In-Time bitmap volumes.

WARNINGS

       The iicpbmp should be run only when a system is in single-user mode. iicpbmp makes no attempt to check if an Point-In-Time Copy set  is	in
       use at the time the copy is made. Running iicpbmp without the -c flag while Point-In-Time Copy is using the shadow set results in inconsis-
       tencies in the shadow set the next time Point-In-Time Copy is started.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWiir, SUNWiiu		   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       iiadm(1M), iicpshd(1M), attributes(5)

SunOS 5.11							    2 Oct 2007							       iicpbmp(1M)
All times are GMT -4. The time now is 03:52 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy