Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: cleaning up spaces from fixed width file while converting to csv file
Top Forums UNIX for Dummies Questions & Answers cleaning up spaces from fixed width file while converting to csv file Post 302448644 by svn on Thursday 26th of August 2010 01:54:44 PM
Old 08-26-2010
cleaning up spaces from fixed width file while converting to csv file
Open to a sed/awk/or perl alternative so that i can stick command into my bash script.

This is a problem I resolve using a combination of cut commands - but that is getting convoluted. So would really appreciate it if someone could provide a better solution which basically replaces all spaces before and prior to the | sign while keeping the spaces that is part of the data.

I have fixed width file delimted by |:
Code:
John   | Doe    | 1234 Long Street Name    |NY
Mary   | H      |Short Addr                |CA

(HTML screws this up, so assume that all the pipe's are all lined up and that first name starts on 1st position, last name always starts at the 20th position, address starts at 40, State starts at 80 - sure u guys get the idea).

Since each column have varying spaces before the | delimiter, how can I quickly remove all the unnecessary spaces and make this a normal csv file instead of a fixed width file. What i want to see is:
Code:
John,Doe,1234 Long Street Name,NY
Mary,H,Short Addr,CA

Thanks much ... one of those problems that drive me crazy :-)
Last edited by Scott; 08-26-2010 at 03:01 PM.. Reason: Please use code tags
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Fixed Width file using AWK

I am using the following command at the Unix prompt to make my 'infile' into a fixed width file of 100 characters. awk '{printf "%-100s\n",$0}' infile > outfile However, there are some records with a special character "©" These records are using 3 characters in place of one and my record... (2 Replies)
Discussion started by: alok.benjwal
2 Replies

2. Shell Programming and Scripting

Converting a Delimited File to Fixed width file

Hi, I have a delimited file generated by a database and i need to convert it to fixed width file using the field length of the database. Can any body suggest me how can i proceed with it? :confused: Thanks Raghavan (2 Replies)
Discussion started by: raghavan.aero
2 Replies

3. UNIX for Advanced & Expert Users

Converting field into fixed width csv

Hi I have a file having record as - 1,aaa,a123,a I need this converted to as 2nd col to 5 chars wide & 3rd col to 6chars wide such as - 1,aaa ,a123 ,a How we could achieve this? Thx in advance. (1 Reply)
Discussion started by: videsh77
1 Replies

4. Shell Programming and Scripting

Fixed-Width file from Oracle

Hi All, I have created a script which generates FIXED-WIDTH file by executing Oracle query. SELECT RPAD(NVL(col1,CHR(9)),20)||NVL(col2,CHR(9))||NVL(col3,CHR(9) FROM XYZ It generates the data file with proper alignment. But if same file i transfer to windows server or Mainframe... (5 Replies)
Discussion started by: Amit.Sagpariya
5 Replies

5. Shell Programming and Scripting

Comparing two fixed width file

Hi Guys I am checking the treads to get the answer but i am not able to get the answer for my question. I have two files. First file is a pattern file and the second file is the file i want to search in it. Output will be the lines from file2. File1: P2797f12af 44751228... (10 Replies)
Discussion started by: anshul_er
10 Replies

6. UNIX for Dummies Questions & Answers

Length of a fixed width file

I have a fixed width file of length 53. when is try to get the lengh of the record of that file i get 2 different answers. awk '{print length;exit}' <File_name> The above code gives me length 50. wc -L <File_name> The above code gives me length 53. Please clarify on... (2 Replies)
Discussion started by: Amrutha24
2 Replies

7. Shell Programming and Scripting

Alter Fixed Width File

Thank u so much .Its working fine as expected. ---------- Post updated at 03:41 PM ---------- Previous update was at 01:46 PM ---------- I need one more help. I have another file(fixed length) that will get negative value (ex:-00000000003000) in postion (98 - 112) then i have to... (6 Replies)
Discussion started by: vinus
6 Replies

8. Shell Programming and Scripting

Fixed Width file creation from csv

Hello All, I'm able to achieve my goal of creating a fixed width file from a comma delimited but I know I'm not doing it as efficiently as possible. Original File checksab 004429876883,O,342040,981.98,10232014 004429876883,O,322389,2615.00,10232014... (6 Replies)
Discussion started by: aahlrich
6 Replies

9. Red Hat

Converting fixed width file to pipe delimiter in Linux(red-hat)

Hi, I am facing a typical scenario for AWK command . In HP- UNIX is behave as expected but in red hat linux same awk code is not give the same result. The below code is for convert the fixed width file to pipe delimiter file in HP-unix server. awk code: #!/bin/awk -f NR!=1... (11 Replies)
Discussion started by: brij_abhi
11 Replies

10. UNIX for Beginners Questions & Answers

Convert a fixed width file to a delimited file

Hi - this is a generic question .... is there any utility which can convert a fixed width file format to a delimited file (any given character delimited) ? (5 Replies)
Discussion started by: i4ismail
5 Replies

LEARN ABOUT DEBIAN

x500::dn

DN(3pm) 						User Contributed Perl Documentation						   DN(3pm)

NAME

       X500::DN - handle X.500 DNs (Distinguished Names), parse and format them

SYNOPSIS

	 use X500::DN;

	 my $dn = X500::DN->ParseRFC2253 ('cn=John Doe, o=Acme\, Inc., c=US') or die;
	 print $dn->getRFC2253String(), "
";

	 $dn = new X500::DN (new X500::RDN ('c'=>'US'), new X500::RDN ('cn'=>'John Doe'));
	 my $rdn0 = $dn->getRDN(0);
	 my $c = $rdn0->getAttributeValue ('c');

NOTE

       The RFC 2253 syntax is explicitely backwards in relation to the ASN.1 SEQUENCE.

       So the RFC 2253 string "cn=John Doe, c=US" has the same meaning as the X.500 string "c=US, cn=John Doe".  The X500::DN objects keep the
       RDNs in X.500 order!

DESCRIPTION

       This module handles X.500 DNs (Distinguished Names).  Currently, it parses DN strings formatted according to RFC 2253 syntax into an
       internal format and produces RFC 2253 formatted string from it.

   Methods
       o   $object = new X500::DN (rdn, rdn, ...);

	   Creates a DN object from zero or more arguments of type X500::RDN.

       o   $object = X500::DN->ParseRFC2253 ('cn=John Doe, o=Acme\, Inc., c=US');

	   Creates a DN object from an RFC 2253 formatted DN string notation.

       o   $object->getRFC2253String();

	   Returns the DN as a string formatted according to RFC 2253 syntax.

       o   $object->getOpenSSLString();

	   Returns the DN as a string formatted suitable for "openssl req -subj" and "openssl ca -subj".

       o   $object->getX500String();

	   Returns the DN as a string formatted according to X.500 syntax.  NOTE: This is a hack, there is no definition for a X.500 string
	   syntax!

       o   $object->hasMultivaluedRDNs();

	   Returns whether the DN contains multi-valued RDNs.

       o   $object->getRDN (num);

	   Returns the DN's RDN at position num as an X500::RDN object.  num starts with 0, which will return the first RDN in ASN.1 SEQUENCE
	   order.

       o   $object->getRDNs();

	   Returns the DN's RDNs, a list of objects of type X500::RDN, in ASN.1 SEQUENCE order.

   EXPORT
       None.

BUGS

       o   Due to Parse::RecDescent's greedyness, white space after attribute values gets into the parsed value.  It might be possible to work
	   around this.

AUTHOR

       Robert Joop <yaph-070708@timesink.de>

COPYRIGHT

       Copyright 2002 Robert Joop.  All Rights reserved.  This program is free software; you can redistribute it and/or modify it under the same
       terms as Perl itself.

SEE ALSO

       X500::RDN, perl.

HISTORY

       Early 2002: First idea, discussed on comp.lang.perl.moderated
       April 2002: First public release, 0.15

perl v5.10.0							    2007-07-08								   DN(3pm)
All times are GMT -4. The time now is 06:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy