Sponsored Content
Full Discussion: TEXT to CSV using Perl
Top Forums Shell Programming and Scripting TEXT to CSV using Perl Post 302713877 by DGPickett on Thursday 11th of October 2012 11:23:55 AM
Old 10-11-2012
CSV has just a few rules:
  1. Separate columns with commas.
  2. Separate rows with ^M^J (carriage-return + line-feed)
  3. For any " in a column, expand to two: ""
  4. For any column containing a comma, carriage-return or line-feed, enclose in ". (Other columns can be " enclosed if desired.)
So, CSV columns can contain any character! Of course, if you are going to have utf-8 multibyte characters, you need a tool that knows and respects that!

You need to parse your file, store each column value after detecting and compensating for embedded metacharacters: ',', '"', carriage-return and line feed, detect row boundaries at new cake number or end of file, and spit out your columns in the desired order with commas between and the row separator after.

You can write it in any language, but I would prefer C or PERL. I am not sure which of the PERL functions encodes data into CSV, as opposed to decodimg from. Like many tools, you can play with it and see what results. Some options for data typing, white space interpretation and binary are only relevant to some receiving systems.

Last edited by DGPickett; 10-11-2012 at 02:20 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replacing text in a .csv file using Perl

I have played with this for some time but i dont seem like i am getting it right. I am trying to change the delimiters on a file so i can import it into a database. this file has rows of data separated by enter Right now the delimiters are represented by tabs and " ". e.g. "dlfkldfs... (9 Replies)
Discussion started by: salemh
9 Replies

2. Shell Programming and Scripting

Text to csv

Hi, I have a document with a lot of data, it is structured like this, UNIQUESTRING To be acquited of a crime is to be deemed to be innocent of the charges after a court hearing. This is different from a <a href=lawglos_Discharge.html>Discharge</a>, where the case is never heard. In... (1 Reply)
Discussion started by: lawstudent
1 Replies

3. Shell Programming and Scripting

Text to CSV

Hi, My access log looks like this... 192.168.50.184 - - "GET /ATIM_LATEST/ABC/ HTTP/1.1" 200 522 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.13) Gecko/2009073022 Firefox/3.0.13" 192.168.50.184 - - "GET /ATIM_LATEST/ABC/ATIM/syncdepot.php HTTP/1.1" 200 1463... (5 Replies)
Discussion started by: shantanuo
5 Replies

4. Shell Programming and Scripting

Format text to bold from perl script to csv

Hi everyone, is there any way in perl using which we can print the selective words in bold when we write the output to a csv file? Please find the example below 1. Filename: A 2. name age 12 3. city add 23 Line1 should only be bold. Outputs from other files being read in the... (2 Replies)
Discussion started by: ramakanth_burra
2 Replies

5. Shell Programming and Scripting

Perl program to convert PDF to text/CSV

Please suggest ways to easily convert pdf to text in perl only on windows (no other tools can be downloaded) Here is what I have been doing : using a module CAM::PDF to extract data. But it shows everything in messy format :wall: But this module is the only one working with the pdf... (0 Replies)
Discussion started by: chakrapani
0 Replies

6. Shell Programming and Scripting

text to csv conversion

Thank u every body ......just need a help so that a text file needs to be converted into CSV............. my log file is as follows Host scsi3: usb-storage Vendor: Maxtor Product: OneTouch III Serial Number: 044303E5 Protocol: Transparent SCSI Transport: Bulk ... (4 Replies)
Discussion started by: tangotango
4 Replies

7. Shell Programming and Scripting

Perl search csv fileA where two strings exist on another csv fileB

Hi I have two csv files, with the following formats: FileA.log: Application, This occured blah Application, That occured blah Application, Also this AnotherLog, Bob did this AnotherLog, Dave did that FileB.log: Uk, London, Application, datetime, LaterDateTime, Today it had'nt... (8 Replies)
Discussion started by: PerlNewbRP
8 Replies

8. Shell Programming and Scripting

Convert text to CSV

Hi Gurus I need urgent help to convert a flat log file into csv format to load into database. Log looks like: a=1 b=2 c=3 a=4 b=5 c=6 Only the values at right side of = will come into csv and it should create a new line once it receives "a" field. (8 Replies)
Discussion started by: sandipjee
8 Replies

9. Shell Programming and Scripting

*log to *.csv in perl

I want to convert the log files to xls. by bash script I converted it to csv, but I need to make some changes in some of them. please dont ask why xls and not csv. I need xls and this is to be a automated process. I am new to linux, bash and NULL in Perl. That would be nice if someone help me to... (6 Replies)
Discussion started by: frhling
6 Replies

10. Shell Programming and Scripting

CSV from Text file

Gents, Attached there is a input.txt and code.txt file. I use that code to create a csv file from txt file. Is there the possibility to generate other code more faster to generate the CVS file using the input file. I have deleted many data in the input file to avoid load a lot data. ... (10 Replies)
Discussion started by: jiam912
10 Replies
DROP TEXT SEARCH 
DICTIONARY(7) SQL Commands DROP TEXT SEARCH DICTIONARY(7) NAME
DROP TEXT SEARCH DICTIONARY - remove a text search dictionary SYNOPSIS
DROP TEXT SEARCH DICTIONARY [ IF EXISTS ] name [ CASCADE | RESTRICT ] DESCRIPTION
DROP TEXT SEARCH DICTIONARY drops an existing text search dictionary. To execute this command you must be the owner of the dictionary. PARAMETERS
IF EXISTS Do not throw an error if the text search dictionary does not exist. A notice is issued in this case. name The name (optionally schema-qualified) of an existing text search dictionary. CASCADE Automatically drop objects that depend on the text search dictionary. RESTRICT Refuse to drop the text search dictionary if any objects depend on it. This is the default. EXAMPLES
Remove the text search dictionary english: DROP TEXT SEARCH DICTIONARY english; This command will not succeed if there are any existing text search configurations that use the dictionary. Add CASCADE to drop such con- figurations along with the dictionary. COMPATIBILITY
There is no DROP TEXT SEARCH DICTIONARY statement in the SQL standard. SEE ALSO
ALTER TEXT SEARCH DICTIONARY [alter_text_search_dictionary(7)], CREATE TEXT SEARCH DICTIONARY [create_text_search_dictionary(7)] SQL - Language Statements 2010-05-14 DROP TEXT SEARCH DICTIONARY(7)
All times are GMT -4. The time now is 09:39 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy