help with processing a file Post: 302430023

Sponsored Content

Top Forums Shell Programming and Scripting help with processing a file Post 302430023 by dsravan on Wednesday 16th of June 2010 11:01:18 AM

06-16-2010

Registered User

help with processing a file

I have a file with header and data rows. I need to remove the header rows from the file and use the data rows for my processing.
The problem is the header is not always constant number of rows. But the only way to identify the last row of the header is that it has
the header information of each coulmn in the table. The last column will be flights scheduled

Quote:

for e.g here is the header row

"Flight Report"
"Report:","Flight Report "
"Prepared for:","Robin hood "
"Report Start:","Sat May 01 13:36:36 PDT 2010"
"Report End:","Mon May 31 13:36:36 PDT 2010"
"Date Run:","06/15/2010"
"Report Warning:","The following flights were not up to date when this report was generated: CAA (05/26/2010)"

"flight ID","flight Name","route Name","Creative flier","flights scheduled"

data row

Quote:

"10451","DL4567","aLA-BHM","678905","y"

I need to slice off the header and then process the data rows. I thought i can use grep to get the line number where flights scheduled
is and then use it to remove the header. but couldn't get it to work. Any help is appreciated

dsravan

View Public Profile for dsravan

Find all posts by dsravan

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Have a shell script check for a file to exist before processing another file

I have a shell script that runs all the time looking for a certain type of file and then it processes the file through a series of other scripts. The script is watching a directory that has files uploaded to it via SFTP. It already checks the size of the file to make sure that it is not still...

2. Shell Programming and Scripting

Checking for a control file before processing a data file

Hi All, I am very new to Shell scripting... I got a requirement. I will have few text files(data files) in a particular directory. they will be with .txt extension. With same name, but with a different extension control files also will be there. For example, Sample_20081001.txt is the data...

3. Shell Programming and Scripting

how to change the current file processing to some other random file in awk ?

Hello, say suppose i am processing an file emp.dat the field of which are deptno empno empname etc now say suppose i want to change the file to emp.lst then how can i do it? Here i what i attempted but in vain BEGIN{ system("sort emp.dat > emp.lst") FILENAME="emp.lst" } { print...

4. Shell Programming and Scripting

How to processing the log file within certain dates based on the file name

Hi I am working on the script parsing specific message "TEST" from multiple file. The log file name looks like: N3.2009-11-26-03-05-02.console.log.tar.gz N4.2009-11-29-00-25-03.console.log.tar.gz N6.2009-12-01-10-05-02.console.log.tar.gz I am using the following command: zgrep -a --text...

5. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log...

6. Shell Programming and Scripting

File Processing

i am having the input file as below 123456789: xxxxx12xxxxxxxxxxxxxxxxxx a_cnt 123456789: xxxxxxxxxxxxxxxxxxxxxxx a_cnt 123456789: a_cnt xxxxaq1wsxxxxxxxxxxxx12xxxxxxxxxx 123456789: xxxxxxxxxxxxasxxxx a_cnt i need the numbers in the backets of a_cnt O/p required as below 1 2 3 4...

7. Shell Programming and Scripting

Recursive file processing from a path and printing output in a file

Hi All, The script below read the path and searches for the directories/subdirectories and for the files. If files are found in the sub directories then read the content of the all files and put the content in csv(comma delimted) format and the call the write to xml function to write the std...

8. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M...

9. UNIX for Dummies Questions & Answers

awk - Rename output file, after processing, same as input file

I have one input file ABC.txt and one output DEF.txt. After the ABC is processed and created output, I want to rename ABC.txt to ABC.orig and DEF to ABC.txt. Currently when I am doing this, it does not process the input file as it cannot read and write to the same file. How can I achieve this? ...

LEARN ABOUT SUSE

xkballocgeomoverlayrows

XkbAllocGeomOverlayRows(3)					   XKB FUNCTIONS					XkbAllocGeomOverlayRows(3)

NAME

       XkbAllocGeomOverlayRows - Allocate rows in a overlay

SYNOPSIS

       Status XkbAllocGeomOverlayRows (XkbOverlayPtr overlay, int num_needed);

ARGUMENTS

       - overlay
	      section for which rows should be allocated

       - num_needed
	      number of new rows required

DESCRIPTION

       Xkb  provides a number of functions to allocate and free subcomponents of a keyboard geometry. Use these functions to create or modify key-
       board geometries.  Note that these functions merely allocate space for the new element(s), and it is up	to  you  to  fill  in  the  values
       explicitly  in  your  code. These allocation functions increase sz_* but never touch num_* (unless there is an allocation failure, in which
       case they reset both sz_* and num_* to zero). These functions return Success if they succeed, BadAlloc if they are  not	able  to  allocate
       space, or BadValue if a parameter is not as expected.

       XkbAllocGeomOverlayRows allocates num_needed rows and adds them to the overlay.	No initialization of the rows is done.

       To free rows in an overlay, use XkbFreeGeomOverlayRows.

DIAGNOSTICS

       BadAlloc       Unable to allocate storage

       BadValue       An argument is out of range

SEE ALSO

       XkbFreeGeomOverlayRows(3)

X Version 11							   libX11 1.3.2 					XkbAllocGeomOverlayRows(3)