Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove Headers throughout a data file
Top Forums Shell Programming and Scripting Remove Headers throughout a data file Post 302192572 by psmall on Wednesday 7th of May 2008 09:19:43 AM
Old 05-07-2008
Remove Headers throughout a data file
I have a data file with over 500,000 records/lines that has the header throughout the file.

SEQ_ID Name Start_Date Ins_date Add1 Add2
1 Harris 04/02/08 03/02/08 333 Main Suite 101
2 Smith 02/03/08 01/23/08 287 Jenkins
SEQ_ID Name Start_Date Ins_date Add1 Add2
3 Norman 03/02/08 03/02/08 14 Florida Suite A
4 Stephen 04/10/08 01/23/08 200 4th St 3rd Floor

There is no particular pattern to where the headers maybe in the file. How would I go about it. I assume it will be a grep then remove the files and deleting the spaces but I am not sure of how to do that as well as getting the loop to stop or do it as a one line command?
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help:how to remove headers in output file

Hi I am running a script (which compares two directory contents) for which I am getting an output of 70 pages in which few pages are blank so I was able to delete those blank lines. But I also want to delete the headers present for each page. can any one help me by providing the code... (1 Reply)
Discussion started by: raj_thota
1 Replies

2. UNIX for Dummies Questions & Answers

Remove certain headers using mailx or sendmail

Hello, So i want to send mails in any way from a solaris 5.8 system, perhaps using mailx or sendmail. My purpose is to stay clear of systems name in head data. So i want to strip at least the "Message-Id" and the "Recieved" headers of the mail. Yet this seems to be a bit of a problem. Now i... (2 Replies)
Discussion started by: congo
2 Replies

3. Shell Programming and Scripting

Remove text between headers while leaving headers intact

Hi, I'm trying to strip all lines between two headers in a file: ### BEGIN ### Text to remove, contains all kinds of characters ... Antispyware-Downloadserver.com (Germany)=http://www.antispyware-downloadserver.c om/updates/ Antispyware-Downloadserver.com #2... (3 Replies)
Discussion started by: Trones
3 Replies

4. Shell Programming and Scripting

Merging of files with different headers to make combined headers file

Hi , I have a typical situation. I have 4 files and with different headers (number of headers is varible ). I need to make such a merged file which will have headers combined from all files (comman coluns should appear once only). For example - File 1 H1|H2|H3|H4 11|12|13|14 21|22|23|23... (1 Reply)
Discussion started by: marut_ashu
1 Replies

5. UNIX for Dummies Questions & Answers

sed remove two headers; writing more elegant code

Hi there, I have two questions. First, I was wondering how to use sed to remove two header lines or two tail lines. Here I just do the same operation twice...I'm sure there is a better way. Second, and more importantly, is there a better way to have these operations use files other than... (5 Replies)
Discussion started by: mikey11415
5 Replies

6. Shell Programming and Scripting

Remove interspersed headers in .dat file with AWK

Heya there, A small selection of my data is shown below. DATE TIME FRAC_DAYS_SINCE_JAN1 2011-06-25 08:03:20.000 175.33564815 2011-06-25 08:03:25.000 175.33570602 2011-06-25 ... (4 Replies)
Discussion started by: gd9629
4 Replies

7. UNIX for Dummies Questions & Answers

Using sed command to remove multiple instances of repeating headers in one file?

Hi, I have catenated multiple output files (from a monte carlo run) into one big output file. Each individual file has it's own two line header. So when I catenate, there are multiple two line headers (of the same wording) within the big file. How do I use the sed command to search for the... (1 Reply)
Discussion started by: rebazon
1 Replies

8. Shell Programming and Scripting

Remove headers thar dont match

Good evening I need your help please, im new at Unix and i wanted to remove the first 5 headers for 100000 records files and then create a control file .ctl that contains the number of records and all seem to work out but when i tested at production it didnt wotk. Here is the code: #!... (6 Replies)
Discussion started by: alexcol
6 Replies

9. Shell Programming and Scripting

Remove white space and duplicate headers

I have a file called "dsout" with empty rows and duplicate headers. DATE TIME TOTAL_GB USED_GB %USED --------- -------- ---------- ---------- ---------- 03/05/013 12:34 PM 3151.24316 2331.56653 73.988785 ... (3 Replies)
Discussion started by: Daniel Gate
3 Replies

10. Shell Programming and Scripting

Checking data in csv file after headers

I had a requirement to check if data exists after headers (typically row 2 & so on) in csv file. please help how we can check through shellscript in linux. Thank you !! (1 Reply)
Discussion started by: chandu123
1 Replies

LEARN ABOUT OPENSOLARIS

dsbitmap

dsbitmap(1M)						  System Administration Commands					      dsbitmap(1M)

NAME

       dsbitmap - size Availability Suite bitmap volumes

SYNOPSIS

       dsbitmap -h

       dsbitmap -p data_volume [bitmap_volume]

       dsbitmap -r data_volume [bitmap_volume]

DESCRIPTION

       The dsbitmap command calculates the size of the Availability Suite bitmap volume required for use with the specified data volume.

OPTIONS

       The following options are supported:

       -h

	   Prints the usage message for the dsbitmap command

       -p data_volume [bitmap_volume]

	   For the given data_volume, dsbitmap calculates and display the required size for the associated Availability Suite Point in Time bitmap
	   volume. The bitmap volume sizes for all possible Availability Suite Point in Time set configurations are  displayed.  These	configura-
	   tions  include  Independent shadow, Full size dependent shadow, and Compact dependent shadow. If the optional bitmap_volume argument is
	   supplied, dsbitmap determines if this volume is large enough to be used as the bitmap volume for data_volume.

       -r data_volume [bitmap_volume]

	   For the given data_volume, dsbitmap calculates and displays the required size for the associated Availability Suite Remote Mirror  bit-
	   map	volume. The bitmap volume sizes for all possible Availability Suite Remote Mirror set configurations are displayed. These configu-
	   rations include Sync replication,  Async replication with memory queue, disk queue and 32 bit refcount.   If the optional bitmap_volume
	   argument is supplied, dsbitmap determines if this volume is large enough to be used as the bitmap volume for data_volume.

USAGE

       dsbitmap  is typically used by the system administrator during the initial stages of configuring Sun StorageTek Availability Suite software
       in order to determine the required bitmap volume sizes, and then to check if the bitmap volumes that have been created are suitable.

EXIT STATUS

       The following exit values are returned:

       0	    Successful completion. If the name of a bitmap volume was specified, that volume is sufficiently large for all potential uses.

       1	    An error occurred.

       2	    An invalid option was supplied on the command line.

       3	    The specified bitmap volume is not large enough to be used as an Availability Suite Remote Mirror bitmap for  an  asynchronous
		    set with a disk queue, but is large enough to be used for all other Remote Mirror set configurations.

       4	    The specified bitmap volume is not large enough to be used as an Availability Suite Remote Mirror bitmap for any Remote Mirror
		    set configuration.

       5	    The specified bitmap volume is not large enough to be used as an Availability Suite Remote Mirror bitmap for any Remote Mirror
		    set configuration.

       6	    The  specified bitmap volume is not large enough to be used as an Availability Suite Point in Time bitmap for a compact depen-
		    dent shadow, but is large enough to be used for all other Point in Time set configurations.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWscmr, SUNWscmu	   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       iiadm(1M), sndradm(1M), attributes(5)

SunOS 5.11							    2 Oct 2007							      dsbitmap(1M)
All times are GMT -4. The time now is 06:09 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy