Removing inserted newlines from a fileld of fixed width file.
Hi champs!
I have a fixed width file in which the records appear like this
As you see, the record for 33333 is split into two records because of newline inserted in description of 33333. I want these extraneous newlines from description field to be removed for records where ever they appear in the file.
Clues can be : check the file for length 11 -32 for each record and if newline is present strip it off.
Any other solution is welcome too.
I want the output to be :
- it is not fixed that line break will appear after 'description' only..it can appear anywhere in the second field.But it is sure that it will appear in second field only, incase it appears.
- This is just the sample record for understanding, code should not be dependent on it.The code can be dependent on positioning if required.
It is a fixed width file that means each filed is identified by length in the record.
Please let me know if you need more clarification.
Last edited by enigma_1; 08-18-2009 at 06:55 PM..
Reason: code tags, PLEASE!
Hi ,
I have a file :
CSCH74000.00
CSCH74000.00
CSCH74100.00
CSCH74000.00
CSCH74100.00
CSCH74000.00
CSCH74000.00
CSCH74100.00
CSCH74100.00
CSCH74100.00
I have to put a delimiter( say comma) in between after 6th character:
CSCH74,000.00
CSCH74,000.00
CSCH74,100.00 (2 Replies)
I am trying to parse a Fixed width file with data as below. I am trying to assign column values from each record to variables. When I parse the data, the spaces in all coumns are dropped. I would like to retain the spaces as part of the dat stored in the variables. Any help is appreciated.
I... (4 Replies)
I am trying to remove a line feed (\n) within a fixed width record. I tried the tr -d ‘\n' command, but it also removes the record delimiter. Is there a way to remove the line feed without removing the record delimiter? (10 Replies)
Hi All,
I have created a script which generates FIXED-WIDTH file by executing Oracle query.
SELECT RPAD(NVL(col1,CHR(9)),20)||NVL(col2,CHR(9))||NVL(col3,CHR(9) FROM XYZ
It generates the data file with proper alignment. But if same file i transfer to windows server or Mainframe... (5 Replies)
Hi Guys
I am checking the treads to get the answer but i am not able to get the answer for my question.
I have two files. First file is a pattern file and the second file is the file i want to search in it. Output will be the lines from file2.
File1:
P2797f12af 44751228... (10 Replies)
Hi All ,
I have a requirement where I need to remove duplicates from a fixed width file which has multiple key columns .Also , need to capture the duplicate records into another file .
File has 8 columns.
Key columns are col1 and col2.
Col1 has the length of 8 col 2 has the length of 3.
... (5 Replies)
I have a fixed width file of length 53. when is try to get the lengh of the record of that file i get 2 different answers.
awk '{print length;exit}' <File_name>
The above code gives me length 50.
wc -L <File_name>
The above code gives me length 53.
Please clarify on... (2 Replies)
Thank u so much .Its working fine as expected.
---------- Post updated at 03:41 PM ---------- Previous update was at 01:46 PM ----------
I need one more help.
I have another file(fixed length) that will get negative value (ex:-00000000003000) in postion (98 - 112) then i have to... (6 Replies)
Discussion started by: vinus
6 Replies
LEARN ABOUT OSF1
recno
recno(3) Library Functions Manual recno(3)NAME
recno - record number database access method
SYNOPSIS
#include <sys/types.h>
#include <db.h>
DESCRIPTION
The routine dbopen is the library interface to database files. One of the supported file formats is record number files. The general
description of the database access methods is in dbopen(3), this manual page describes only the recno specific information.
The record number data structure is either variable or fixed-length records stored in a flat-file format, accessed by the logical record
number. The existence of record number five implies the existence of records one through four, and the deletion of record number one
causes record number five to be renumbered to record number four, as well as the cursor, if positioned after record number one, to shift
down one record.
The recno access method specific data structure provided to dbopen is defined in the <db.h> include file as follows:
typedef struct {
u_long flags;
u_int cachesize;
u_int psize;
int lorder;
size_t reclen;
u_char bval;
char *bfname;
} RECNOINFO;
The elements of this structure are defined as follows:
flags The flag value is specified by or'ing any of the following values:
R_FIXEDLEN
The records are fixed-length, not byte delimited. The structure element reclen specifies the length of the record, and the
structure element bval is used as the pad character. Any records, inserted into the database, that are less than reclen
bytes long are automatically padded.
R_NOKEY
In the interface specified by dbopen, the sequential record retrieval fills in both the caller's key and data structures. If
the R_NOKEY flag is specified, the cursor routines are not required to fill in the key structure. This permits applications
to retrieve records at the end of files without reading all of the intervening records.
R_SNAPSHOT
This flag requires that a snapshot of the file be taken when dbopen is called, instead of permitting any unmodified records
to be read from the original file.
cachesize
A suggested maximum size, in bytes, of the memory cache. This value is only advisory, and the access method will allocate more mem-
ory rather than fail. If cachesize is 0 (no size is specified) a default cache is used.
psize The recno access method stores the in-memory copies of its records in a btree. This value is the size (in bytes) of the pages used
for nodes in that tree. If psize is 0 (no page size is specified) a page size is chosen based on the underlying file system I/O
block size. See btree(3) for more information.
lorder The byte order for integers in the stored database metadata. The number should represent the order as an integer; for example, big
endian order would be the number 4,321. If lorder is 0 (no order is specified) the current host order is used.
reclen The length of a fixed-length record.
bval The delimiting byte to be used to mark the end of a record for variable-length records, and the pad character for fixed-length
records. If no value is specified, newlines (``
'') are used to mark the end of variable-length records and fixed-length records
are padded with spaces.
bfname The recno access method stores the in-memory copies of its records in a btree. If bfname is non-NULL, it specifies the name of the
btree file, as if specified as the file name for a dbopen of a btree file.
The data part of the key/data pair used by the recno access method is the same as other access methods. The key is different. The data
field of the key should be a pointer to a memory location of type recno_t, as defined in the <db.h> include file. This type is normally
the largest unsigned integral type available to the implementation. The size field of the key should be the size of that type.
Because there can be no meta-data associated with the underlying recno access method files, any changes made to the default values (e.g.
fixed record length or byte separator value) must be explicitly specified each time the file is opened.
In the interface specified by dbopen, using the put interface to create a new record will cause the creation of multiple, empty records if
the record number is more than one greater than the largest record currently in the database.
RESTRICTIONS
Only big and little endian byte order is supported.
ERRORS
The recno access method routines may fail and set errno for any of the errors specified for the library routine dbopen(3) or the following:
[EINVAL]
An attempt was made to add a record to a fixed-length database that was too large to fit.
RELATED INFORMATION btree(3)dbopen(3), hash(3), mpool(3),
Document Processing in a Relational Database System, Michael Stonebraker, Heidi Stettner, Joseph Kalash, Antonin Guttman, Nadene Lynn, Mem-
orandum No. UCB/ERL M82/32, May 1982. delim off
recno(3)