text to csv conversion


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting text to csv conversion
# 1  
Old 06-03-2011
text to csv conversion

Thank u every body ......just need a help so that a text file needs to be converted into CSV.............

my log file is as follows

Host scsi3: usb-storage
Vendor: Maxtor
Product: OneTouch III
Serial Number: 044303E5
Protocol: Transparent SCSI
Transport: Bulk
Quirks:
Tue May 31 09:01:21 GMT 2011

Host scsi3: usb-storage
Vendor: Maxtor
Product: OneTouch III
Serial Number: 044303E5
Protocol: Transparent SCSI
Transport: Bulk
Quirks:
Tue May 31 11:22:14 GMT 2011

Host scsi4: usb-storage
Vendor: Maxtor
Product: OneTouch III
Serial Number: 044303E5
Protocol: Transparent SCSI
Transport: Bulk
Quirks:
Tue May 31 11:29:44 GMT 2011




Now how can i convert this to csv file so that i can export it into some database

for example:-

scsi3, vendor, product_name, serial_no, protocol_used, transport, quirks
usb-storage, Maxtor, OneTouchIII, 044303E5, Transparent SCSI, Bulk, Tue May 31 09:01:21 GMT 2011
usb-storage, Maxtor, OneTouchIII, 044303E5, Transparent SCSI, Bulk, Tue May 31 11:22:14 GMT 2011
usb-storage, Maxtor, OneTouchIII, 044303E5, Transparent SCSI, Bulk, Tue May 31 11:29:44 GMT 2011


after some googling i got a clue about getline command with awk....... but dont know how to use;............

any suggestions in this regards greatly appreciated
regards


the orignal file is uploaded for reference...

Last edited by tangotango; 06-03-2011 at 06:30 AM..
# 2  
Old 06-03-2011
This doesn;t print the header, you can hard code it ,
Code:
 awk -F: '{if($0 && ($0!~/GMT 2011/)){printf "%s,",$2}else if($0~/GMT 2011/){printf "%s",$0}else{ printf "\n" }}' test.txt

Output

Code:
 usb-storage, Maxtor, OneTouch III, 044303E5, Transparent SCSI, Bulk,,Tue May 31 09:01:21 GMT 2011
 usb-storage, Maxtor, OneTouch III, 044303E5, Transparent SCSI, Bulk,,Tue May 31 11:22:14 GMT 2011
 usb-storage, Maxtor, OneTouch III, 044303E5, Transparent SCSI, Bulk,,Tue May 31 11:29:44 GMT 2011

# 3  
Old 06-03-2011
Code:
awk -F":" '!/^Quirks/ && NF>1{printf /GMT/?$0"\n":$2","}' filename

# 4  
Old 06-03-2011
Manually write the headers.

Code:
 
perl -00 -F: -lane 'BEGIN{$,=","};$_=~s/\n//g for @F;print @F[1,3,5,7,9]'

# 5  
Old 06-03-2011
I will go with Getmmg:.. headers need to be added ....

Code:
sed '/GMT/!s/^[A-Z].*://g' filename|sed -e :a -e '/GMT/!N;s/\n/,/;ta' -e 's/^,//'

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Conversion of Binary csv file

Hello, I have a binary csv file that was created on 'Red Hat Enterprise Linux Server release 6.6'. Now we have transferred all files on Ubuntu 16.04.2 LTS/xenial On opening the file in Ubuntu, there are special characters ... (8 Replies)
Discussion started by: nans
8 Replies

2. UNIX for Dummies Questions & Answers

.xlxs to .csv conversion

Hi Please let me know the command to convert from .xlsx to .csv so that i will implement the same in the assignment of mine . (5 Replies)
Discussion started by: harry00514
5 Replies

3. Shell Programming and Scripting

perl : number to date conversion in CSV file

I have a CSV file in the below format. while generating CSV file from excel sheet , date in excel sheet(Format :Mon 8/28/2012) got converted into the below format with numbers 41148,41149 so on. Could anyone please let me know how to the convert the numbers(41148,41149 so on.) to its actual... (2 Replies)
Discussion started by: giridhar276
2 Replies

4. Shell Programming and Scripting

html to csv conversion

thanks for allowing me to join your forum i have a html file with three columns ------------Last visit date , URL and link,,,,,,,, how can i convert the same into csv so that i can output into database... the mechine is linux...i made a little googling and got idea that there is ways for... (2 Replies)
Discussion started by: certteam
2 Replies

5. Shell Programming and Scripting

conversion of spaces into CSV format file

INput file attached in thread : Column widths at 24,73,82,87,121 characters (sed 's/./,/24;s/./,/73;s/./,/81;s/./,/87;s/./,/121;s/ *, */,/g' fixedinputfile >output.csv ). The client wants instead of hard coding the column widths as they are not fixed .he has given the hint stating that ( ... (3 Replies)
Discussion started by: sreenath1037
3 Replies

6. Shell Programming and Scripting

Conversion of spaces Text file into CSV format file

Input file (each line is separaed by spaces )given below: Name Domain Contact Phone Email Location ----------------------- ------------------------------------------------ ------- -----... (18 Replies)
Discussion started by: sreenath1037
18 Replies

7. Shell Programming and Scripting

Shell script for CSV conversion

thanks for allowing me join your forum i have an output of linux command "who" which provides following details..... CURRENT USER/ACCT INFO 17:31:36 up 4:49, 4 users, load average: 0.03, 0.04, 0.00 USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT root :0 - 12:59 ?xdm? 4:54 0.02s /bin/sh /usr/bi... (1 Reply)
Discussion started by: ayyappancheta
1 Replies

8. Shell Programming and Scripting

Flat file to csv conversion

Hi Guy's can someone help me in converting the following I have a flat text file which has several thousand lines which I need to convert to a csv it's got a consistent format but basically want every time it hit's txt to create a new line with the subsequent lines comma delimited for example ... (6 Replies)
Discussion started by: p1_ben
6 Replies

9. Shell Programming and Scripting

.xls to .csv conversion

Hi Please can someone tell me how i can convert .xls file into .csv on both platforms, windows and unix. many thanks, neil (4 Replies)
Discussion started by: neil546
4 Replies
Login or Register to Ask a Question