convert/format a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting convert/format a file
# 1  
Old 08-18-2007
convert/format a file

CSV---- fixed length fiile format

Can any suggest a mechanism for converting a CSV to fixedlength,the file is expected to be of size 50000lines,

Smilie

CSV file contains address feilds of variable length
# 2  
Old 08-18-2007
Quote:
Originally Posted by anumkoshy
CSV---- fixed length fiile format

Can any suggest a mechanism for converting a CSV to fixedlength,the file is expected to be of size 50000lines,

Smilie

CSV file contains address feilds of variable length
Your requirement is not clear.

Please help us to help you ! Smilie

Please post a sample input and output

converting to fixed length ==> should the record length be fixed or the fields in the record be of fixed length.
# 3  
Old 08-19-2007
CSV file
eg :-
20045667886,tamrind,user,india,address1234,love
20045667886,tamrind,user,india,address45,love
20045667886,tamrind,user,india,address333333,love
.
.
.50000records.

this is my input file , lets call it as filename.in

i would like to get a code snippet in shell script.

which can convert it to a fixedlength file which has a fixed layout
like

20045667886tamrinduserindiaaddress1234 love
20045667886tamrinduserindiaaddress45 love
20045667886tamrinduserindiaaddress333333love

ie each coloumn should have a fixed width.
Smilie
# 4  
Old 08-19-2007
Hi.

One solution:
Code:
#!/usr/bin/env sh

# @(#) s1       Demonstrate awk CSV to fixed-field.

set -o nounset
echo

## Define function to list versions.

version()
{
  for command
  do
    if command -v $command >/dev/null 2>&1
    then
      command -p $command --version | head -1
    else
      echo " (Warning -- command \"$command\" not found in PATH.)" >&2
    fi
  done
  return 0
}

## List the version of each command we're using here.

version bash awk

FILE=${1-data1}

echo

# Process the file.  Remove blanks from printf to get fields next
# to each other:
# { printf("%-5s%-6s%-8s%-4s%-15s%-s7\n",$1,$2,$3,$4,$5,$6) }

awk -F, '
        { printf("%-5s %-6s %-8s %-4s %-15s %-s7\n",$1,$2,$3,$4,$5,$6) }
' $FILE

exit 0

producing:
Code:
% ./s1

GNU bash, version 2.05b.0(1)-release (i386-pc-linux-gnu)
GNU Awk 3.1.4

20045667886 tamrind user     india address1234     love7
20045667886 tamrind user     india address45       love7
20045667886 tamrind user     india address333333   love7

cheers, drl
# 5  
Old 08-20-2007
can u make it more clearer

...Smilie

.............


...........
# 6  
Old 08-20-2007
error while handling too lengthy file

awk: string too long near line 1
awk: syntax error near line 1
awk: illegal statement near line 1
# 7  
Old 09-12-2007
some issue

some thing more

eg:

20045667886,tamrind,user,india,address1234,love
20045667886,tamrind,user,india,address45,love
20045667886,tamrind,user,india,address333333,love



if there is a value in the file which should only be of a fixed size..

consider example

if 'tamrind' is 'tamrindqiww' i want it as only tamrind in the fixed length file
can we use awk.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help Badly to convert file format!

Can anyone provide me a unix script to convert file formats. Input and desired output is attached. (10 Replies)
Discussion started by: Ravi S M
10 Replies

2. Shell Programming and Scripting

Convert the below file to csv format

Hi , i want to change this question, i will post soon.. (6 Replies)
Discussion started by: srikanth2567
6 Replies

3. Shell Programming and Scripting

Convert UNIX file format to PC format

Hi All, Is there any way to convert a file which is in UNIX format to a PC format.... Flip command can be used , apart form this command can we have any other way.... like usinf "awk" etc ..... main purpose of not using flip is that my Kshell doesnot support this comamnd.... (2 Replies)
Discussion started by: Samtel
2 Replies

4. UNIX for Dummies Questions & Answers

Convert UNIX file format to PC format

Hi All, Is there any way to convert a file which is in UNIX format to a PC format.... Flip command can be used , apart form this command can we have any other way.... like usinf "awk" etc ..... main purpose of not using flip is that my Kshell doesnot support this comamnd.... (1 Reply)
Discussion started by: Samtel
1 Replies

5. Shell Programming and Scripting

convert date format to mysql date format in log file

I have a comma delimited log file which has the date as MM/DD/YY in the 2nd column, and HH:MM:SS in the 3rd column. I need to change the date format to YYYY-MM-DD and merge it with the the time HH:MM:SS. How will I got about this? Sample input 02/27/09,23:52:31 02/27/09,23:52:52... (3 Replies)
Discussion started by: hazno
3 Replies

6. Shell Programming and Scripting

Convert Epoch time format to normal date time format in the same file

I have a file named "suspected" with series of line like these : {'protocol': 17, 'service': 'BitTorrent KRPC', 'server': '219.78.120.166', 'client_port': 52044, 'client': '10.64.68.44', 'server_port': 8291, 'time': 1226506312L, 'serverhostname': ''} {'protocol': 17, 'service': 'BitTorrent... (3 Replies)
Discussion started by: rk4k
3 Replies

7. UNIX for Dummies Questions & Answers

To convert multi format file to a readable ascii format

Hi I have a file which has ascii , binary, binary decimal coded,decimal & hexadecimal data with lot of special characters (like öƒ.ƒ.„İİ¡Š·œƒ.„İİ¡Š· ) in it. I want to standardize the file into ASCII format & later use that as source . Can any one suggest a way a logic to convert such... (5 Replies)
Discussion started by: gaur.deepti
5 Replies

8. UNIX for Dummies Questions & Answers

Convert UTF8 Format file to ANSI format

:confused: Hi i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error Function i used it as $ iconv -f UTF8 -t ANSI filename Error iam getting is NOT Supported UTF8 to ANSI please some help me out on... (9 Replies)
Discussion started by: rajreddy
9 Replies

9. UNIX for Advanced & Expert Users

Convert UTF8 Format file to ANSI format

:) Hi i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error Function i used it as $ iconv -f UTF8 -t ANSI filename Error iam getting is NOT Supported UTF8 to ANSI please some help me out on this.........Let me... (1 Reply)
Discussion started by: rajreddy
1 Replies

10. Shell Programming and Scripting

How to convert file format ?

Hi guys, I have a text file like in following format, IMSI:1 MSISDN:44569098 Data1=prov Data2=yes Data3=not Data4=yes Data5=yes Data6=yes IMSI:2 MSISDN:44569099 Data1=yes Data2=not Data3=prov Data4=prov (3 Replies)
Discussion started by: maheshsri
3 Replies
Login or Register to Ask a Question