Removing inserted newlines from a fileld of fixed width file. Post: 302345225

Sponsored Content

Top Forums Shell Programming and Scripting Removing inserted newlines from a fileld of fixed width file. Post 302345225 by vgersh99 on Tuesday 18th of August 2009 05:54:48 PM

08-18-2009

Moderator

To keep the forums high quality for all users, please take the time to format your posts correctly.

First of all, use Code Tags when you post any code or data samples so others can easily read your code. You can easily do this by highlighting your code and then clicking on the # in the editing menu. (You can also type code tags [code] and [/code] by hand.)

Second, avoid adding color or different fonts and font size to your posts. Selective use of color to highlight a single word or phrase can be useful at times, but using color, in general, makes the forums harder to read, especially bright colors like red.

Third, be careful when you cut-and-paste, edit any odd characters and make sure all links are working property.

Thank You.

The UNIX and Linux Forums

---------- Post updated at 05:54 PM ---------- Previous update was at 05:38 PM ----------

something to start with...

'len' is a known/expected length of ALL the records (assuming they are of the same length) - defaulted to '73'.

Assumption: there's only ONE extra new-line per 'broken' record.
nawk -f enigma.awk myFile
OR
nawk -v len=63 -f enigma.awk myFile

enigma.awk:

Code:

BEGIN {
  len=(!len)?73:len
}
length < len {
   if (length(s)) { print s OFS $0;s=""}
   else s=$0
   next
}
1

vgersh99

View Public Profile for vgersh99

Find all posts by vgersh99

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Fixed Width file using AWK

I am using the following command at the Unix prompt to make my 'infile' into a fixed width file of 100 characters. awk '{printf "%-100s\n",$0}' infile > outfile However, there are some records with a special character "�" These records are using 3 characters in place of one and my record...

2. Shell Programming and Scripting

adding delimiter to a fixed width file

Hi , I have a file : CSCH74000.00 CSCH74000.00 CSCH74100.00 CSCH74000.00 CSCH74100.00 CSCH74000.00 CSCH74000.00 CSCH74100.00 CSCH74100.00 CSCH74100.00 I have to put a delimiter( say comma) in between after 6th character: CSCH74,000.00 CSCH74,000.00 CSCH74,100.00

3. Shell Programming and Scripting

Changing particular field in fixed width file

I have a fixed width file and i need to change 36th field to "G" in for about random 20 records? How can I do it?

4. UNIX Desktop Questions & Answers

Help with Fixed width File Parsing

I am trying to parse a Fixed width file with data as below. I am trying to assign column values from each record to variables. When I parse the data, the spaces in all coumns are dropped. I would like to retain the spaces as part of the dat stored in the variables. Any help is appreciated. I...

5. Shell Programming and Scripting

Removing \n within a fixed width record

I am trying to remove a line feed (\n) within a fixed width record. I tried the tr -d �\n' command, but it also removes the record delimiter. Is there a way to remove the line feed without removing the record delimiter?

6. Shell Programming and Scripting

Fixed-Width file from Oracle

Hi All, I have created a script which generates FIXED-WIDTH file by executing Oracle query. SELECT RPAD(NVL(col1,CHR(9)),20)||NVL(col2,CHR(9))||NVL(col3,CHR(9) FROM XYZ It generates the data file with proper alignment. But if same file i transfer to windows server or Mainframe...

7. Shell Programming and Scripting

Comparing two fixed width file

Hi Guys I am checking the treads to get the answer but i am not able to get the answer for my question. I have two files. First file is a pattern file and the second file is the file i want to search in it. Output will be the lines from file2. File1: P2797f12af 44751228...

8. Shell Programming and Scripting

Removing duplicates in fixed width file which has multiple key columns

Hi All , I have a requirement where I need to remove duplicates from a fixed width file which has multiple key columns .Also , need to capture the duplicate records into another file . File has 8 columns. Key columns are col1 and col2. Col1 has the length of 8 col 2 has the length of 3. ...

9. UNIX for Dummies Questions & Answers

Length of a fixed width file

I have a fixed width file of length 53. when is try to get the lengh of the record of that file i get 2 different answers. awk '{print length;exit}' <File_name> The above code gives me length 50. wc -L <File_name> The above code gives me length 53. Please clarify on...

10. Shell Programming and Scripting

Alter Fixed Width File

Thank u so much .Its working fine as expected. ---------- Post updated at 03:41 PM ---------- Previous update was at 01:46 PM ---------- I need one more help. I have another file(fixed length) that will get negative value (ex:-00000000003000) in postion (98 - 112) then i have to...

LEARN ABOUT CENTOS

tcfmgr

TCFMGR(1)							   Tokyo Cabinet							 TCFMGR(1)

NAME

       tcfmgr - the command line utility of the fixed-length database API

DESCRIPTION

       The  command `tcfmgr' is a utility for test and debugging of the fixed-length database API and its applications.  `path' specifies the path
       of a database file.  `width' specifies the width of the value of each record.  `limsiz' specifies the limit  size  of  the  database  file.
       `key' specifies the key of a record.  `value' specifies the value of a record.  `file' specifies the input file.

	      tcfmgr create path [width [limsiz]]
		     Create a database file.
	      tcfmgr inform [-nl|-nb] path
		     Print miscellaneous information to the standard output.
	      tcfmgr put [-nl|-nb] [-sx] [-dk|-dc|-dai|-dad] path key value
		     Store a record.
	      tcfmgr out [-nl|-nb] [-sx] path key
		     Remove a record.
	      tcfmgr get [-nl|-nb] [-sx] [-px] [-pz] path key
		     Print the value of a record.
	      tcfmgr list [-nl|-nb] [-m num] [-pv] [-px] [-rb lkey ukey] [-ri str] path
		     Print keys of all records, separated by line feeds.
	      tcfmgr optimize [-nl|-nb] path [width [limsiz]]
		     Optimize a database file.
	      tcfmgr importtsv [-nl|-nb] [-sc] path [file]
		     Store records of TSV in each line of a file.
	      tcfmgr version
		     Print the version information of Tokyo Cabinet.

       Options feature the following.

	      -nl : enable the option `FDBNOLCK'.
	      -nb : enable the option `FDBLCKNB'.
	      -sx : the input data is evaluated as a hexadecimal data string.
	      -dk : use the function `tcfdbputkeep' instead of `tcfdbput'.
	      -dc : use the function `tcfdbputcat' instead of `tcfdbput'.
	      -dai : use the function `tcfdbaddint' instead of `tcfdbput'.
	      -dad : use the function `tcfdbadddouble' instead of `tcfdbput'.
	      -px : the output data is converted into a hexadecimal data string.
	      -pz : do not append line feed at the end of the output.
	      -m num : specify the maximum number of the output.
	      -pv : print values of records also.
	      -rb lkey ukey : specify the range of keys.
	      -ri str : specify the interval notation of keys.
	      -sc : normalize keys as lower cases.

       This command returns 0 on success, another on failure.

SEE ALSO

       tcftest(1), tcfmttest(1), tcfdb(3), tokyocabinet(3)

Man Page							    2012-08-18								 TCFMGR(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Fixed Width file using AWK

Discussion started by: alok.benjwal

2. Shell Programming and Scripting

adding delimiter to a fixed width file

Discussion started by: sumeet

3. Shell Programming and Scripting

Changing particular field in fixed width file

Discussion started by: dsravan

4. UNIX Desktop Questions & Answers

Help with Fixed width File Parsing

Discussion started by: sate911