Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to remove page breaks from a flat file???
Top Forums Shell Programming and Scripting How to remove page breaks from a flat file??? Post 302114472 by vgersh99 on Monday 16th of April 2007 10:23:41 AM
Old 04-16-2007
Code:
#!/usr/bin/nawk -f

BEGIN {
  FS=OFS="|"

  FLD_max=11

  FF=sprintf("\f")
  
  stderr="cat 2>&1" 
}
$0 ~ FF { gsub(FF, ""); $1=$1 }

(fld + NF-1) > FLD_max {
       if (fld == FLD_max)
          print rec
       else
          printf("Incomplete record: [%d] :: [%s]\n", FNR, rec) | stderr
       rec=$0; fld=NF;next
}
NF < FLD_max {printf("Bad record: [%d] :: [%s]\n", FNR, $0) | stderr; rec=(rec != "") ? rec $0 : $0; fld+=(NF-1);next }
{rec=$0; fld=NF}
END {
  if (rec != "" && split(rec, a, FS) >= FLD_max ) print rec
}

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Insert page breaks into .csv file

I have large .csv files that I need to get page breaks into. I am taking comma delimited files of over a million records and putting them into a pdf file. Is there a way, using sed or otherwise, to insert some type of page break character into my file? (2 Replies)
Discussion started by: welsht
2 Replies

2. Programming

Page Breaks

Hi, I have a program in Pro*c when I run it I have no problem with the output but when it runs via the at command and except the output has page breaks every 66 lines. I don't want those page breaks to be in the output. any idea? (9 Replies)
Discussion started by: rama71
9 Replies

3. Shell Programming and Scripting

Help on page breaks

Hi, I am new to Unix (AIX). I have a header (in a text file) that needs to be wrtitten on all the pages of a result file (text file). After the header is written, data needs to be read from a file A(text file) and inserted to the result file. If the number of lines reaches 80 in a page, page... (1 Reply)
Discussion started by: simhasuri
1 Replies

4. UNIX for Dummies Questions & Answers

how to remove the first line from a flat file ?

Hi, I want to remove the first line from a flat file using unix command as simple as possible. Can anybody give me a hand ? Thanks in advance. xli (21 Replies)
Discussion started by: xli
21 Replies

5. UNIX for Dummies Questions & Answers

How to remove numeric characters in the flat file

HI, can any one help me please .. i have flat file like qwer123rt ass3242ccf jjk654 kjh838ppp nhdg453ok hdkk34 i want remove numeric characters in the flat file i want output like this qwerrt assccf jjk kjhppp nhdgok hdkk help me... (4 Replies)
Discussion started by: rafimd1985
4 Replies

6. Shell Programming and Scripting

Remove line breaks in csv file using shell script

Hi All, I've a csv file in which the record is getting break into 1 line or more than one line. I want to combine those splits into one line and remove the unwanted character existing in the record i.e. double quote symbol ("). The line gets break only when the record contains double... (4 Replies)
Discussion started by: rajak.net
4 Replies

7. Shell Programming and Scripting

script for adding page number before page breaks

Hi, If there is an expert that can help: I have many txt files that are produced from pdftotext that include page breaks the page breaks seem to be unix style hex 0C. I want to add page numbers before each page break as in : Page XXXX Regards antman (9 Replies)
Discussion started by: antman
9 Replies

8. UNIX for Advanced & Expert Users

Remove duplicates in flat file

Hi all, I have a issues while loading a flat file to the DB. It is taking much time. When analyzed i found out that there are duplicates entry in the flat file. There are 2 type of Duplicate entry. 1) is entire row is duplicate. ( i can use sort | uniq) to remove the duplicated entry. 2) the... (4 Replies)
Discussion started by: samjoshuab
4 Replies

9. UNIX for Dummies Questions & Answers

Page breaks and line breaks

Hi All, Need an urgent solution to an issue . We have created a ksh file or shell script which generates 1 DAT file. the DAT file contains extract of a select statement . Now the issue is , when we are executing the ksh file , the output is coimng with page breaks and line breaks . We have... (4 Replies)
Discussion started by: Ayaskant
4 Replies

10. Shell Programming and Scripting

Remove first NULL Character in Flat File

We have a flat file with below data : ^@^@^@^@00000305^@^@^@^@^@^@430^@430^@^@^@^@^@^@^@^@^@09079989530As we can see ^@ is Null character in this file I want to remove only the first few null characters before string 00000305 How can we do that, any idea. I want a new file without first few... (5 Replies)
Discussion started by: simpltyansh
5 Replies

LEARN ABOUT REDHAT

rec

play(1) 						      General Commands Manual							   play(1)

NAME

       play - play any sound file to audio device

       rec  - record audio to any sound file format

SYNOPSIS

       play [fopts] infile [effect]

       rec [fopts] outfile [effect]

DESCRIPTION

       This manual page briefly documents the play and rec commands.

       play  and  rec are programs that allow you to play and record different types of sound files from the command line.  They are front ends to
       the more general sox(1) package.  Normally, the play command will automatically detect the type and other parameters of the  soundfile.	If
       it can't do so, the parameters can be changed through options.

OPTIONS

       A summary of common options are included below.	For a complete description of options and their values, see the sox(1) man page.

       -c [channels], --channels=[channels]
	      Define the number of channels in the file.

       -d [device], --device=[device]
	      Specify a different device to play the sound file to.

       -f [format], --format=[format]
	      Specify bit format of the sample. One of s, u, U, A, a, or g.

       -r [rate], --rate=[rate]
	      Specify the sample rate of the audio data (samples per second).

       -s [size], --size=[size]
	      Specify the width of each sample.  One of b, w, l, f, d, or D.

       -t [type], --type=[type]
	      Specify audio file format to use.  Useful if it can not be automatically determined.

       -v [volume], --volume=[volume]
	      Change the audio volume

       -x , --xinu
	      Reverse the byte order of the sample (only works with 16 and 32-bit data).

       -h, --help
	      Show summary of options.

       --version
	      Show version of play/rec.

       Description of effects are described in the
	      sox(1) man page.

SEE ALSO

	sox(1)
	soxexam(1)

AUTHOR

       This manual page was written by Guenter Geiger <geiger@iem.mhsg.ac.at>, for the Debian GNU/Linux system.

       Updates by Anonymous.

								 December 11, 2001							   play(1)
All times are GMT -4. The time now is 10:25 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy