10-11-2012
CSV has just a few rules:
- Separate columns with commas.
- Separate rows with ^M^J (carriage-return + line-feed)
- For any " in a column, expand to two: ""
- For any column containing a comma, carriage-return or line-feed, enclose in ". (Other columns can be " enclosed if desired.)
So, CSV columns can contain any character! Of course, if you are going to have utf-8 multibyte characters, you need a tool that knows and respects that!
You need to parse your file, store each column value after detecting and compensating for embedded metacharacters: ',', '"', carriage-return and line feed, detect row boundaries at new cake number or end of file, and spit out your columns in the desired order with commas between and the row separator after.
You can write it in any language, but I would prefer C or PERL. I am not sure which of the PERL functions encodes data into CSV, as opposed to decodimg from. Like many tools, you can play with it and see what results. Some options for data typing, white space interpretation and binary are only relevant to some receiving systems.
Last edited by DGPickett; 10-11-2012 at 02:20 PM..
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have played with this for some time but i dont seem like i am getting it right. I am trying to change the delimiters on a file so i can import it into a database. this file has rows of data separated by enter
Right now the delimiters are represented by tabs and " ".
e.g.
"dlfkldfs... (9 Replies)
Discussion started by: salemh
9 Replies
2. Shell Programming and Scripting
Hi,
I have a document with a lot of data, it is structured like this,
UNIQUESTRING
To be acquited of a crime is to be deemed to be innocent of
the charges after a court hearing. This is different from a
<a href=lawglos_Discharge.html>Discharge</a>, where the case is never heard. In... (1 Reply)
Discussion started by: lawstudent
1 Replies
3. Shell Programming and Scripting
Hi,
My access log looks like this...
192.168.50.184 - - "GET /ATIM_LATEST/ABC/ HTTP/1.1" 200 522 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.13) Gecko/2009073022 Firefox/3.0.13"
192.168.50.184 - - "GET /ATIM_LATEST/ABC/ATIM/syncdepot.php HTTP/1.1" 200 1463... (5 Replies)
Discussion started by: shantanuo
5 Replies
4. Shell Programming and Scripting
Hi everyone, is there any way in perl using which we can print the selective words in bold when we write the output to a csv file?
Please find the example below
1. Filename: A
2. name age 12
3. city add 23
Line1 should only be bold. Outputs from other files being read in the... (2 Replies)
Discussion started by: ramakanth_burra
2 Replies
5. Shell Programming and Scripting
Please suggest ways to easily convert pdf to text in perl only on windows (no other tools can be downloaded)
Here is what I have been doing :
using a module CAM::PDF to extract data. But it shows everything in messy format :wall:
But this module is the only one working with the pdf... (0 Replies)
Discussion started by: chakrapani
0 Replies
6. Shell Programming and Scripting
Thank u every body ......just need a help so that a text file needs to be converted into CSV.............
my log file is as follows
Host scsi3: usb-storage
Vendor: Maxtor
Product: OneTouch III
Serial Number: 044303E5
Protocol: Transparent SCSI
Transport: Bulk
... (4 Replies)
Discussion started by: tangotango
4 Replies
7. Shell Programming and Scripting
Hi
I have two csv files, with the following formats:
FileA.log:
Application, This occured blah
Application, That occured blah
Application, Also this
AnotherLog, Bob did this
AnotherLog, Dave did that
FileB.log:
Uk, London, Application, datetime, LaterDateTime, Today it had'nt... (8 Replies)
Discussion started by: PerlNewbRP
8 Replies
8. Shell Programming and Scripting
Hi Gurus
I need urgent help to convert a flat log file into csv format to load into database.
Log looks like:
a=1
b=2
c=3
a=4
b=5
c=6
Only the values at right side of = will come into csv and it should create a new line once it receives "a" field. (8 Replies)
Discussion started by: sandipjee
8 Replies
9. Shell Programming and Scripting
I want to convert the log files to xls. by bash script I converted it to csv, but I need to make some changes in some of them. please dont ask why xls and not csv. I need xls and this is to be a automated process.
I am new to linux, bash and NULL in Perl.
That would be nice if someone help me to... (6 Replies)
Discussion started by: frhling
6 Replies
10. Shell Programming and Scripting
Gents,
Attached there is a input.txt and code.txt file.
I use that code to create a csv file from txt file.
Is there the possibility to generate other code more faster to generate the CVS file using the input file.
I have deleted many data in the input file to avoid load a lot data.
... (10 Replies)
Discussion started by: jiam912
10 Replies
LEARN ABOUT SUSE
drop_text_search_dictionary
DROP TEXT SEARCH
DICTIONARY(7) SQL Commands DROP TEXT SEARCH DICTIONARY(7)
NAME
DROP TEXT SEARCH DICTIONARY - remove a text search dictionary
SYNOPSIS
DROP TEXT SEARCH DICTIONARY [ IF EXISTS ] name [ CASCADE | RESTRICT ]
DESCRIPTION
DROP TEXT SEARCH DICTIONARY drops an existing text search dictionary. To execute this command you must be the owner of the dictionary.
PARAMETERS
IF EXISTS
Do not throw an error if the text search dictionary does not exist. A notice is issued in this case.
name The name (optionally schema-qualified) of an existing text search dictionary.
CASCADE
Automatically drop objects that depend on the text search dictionary.
RESTRICT
Refuse to drop the text search dictionary if any objects depend on it. This is the default.
EXAMPLES
Remove the text search dictionary english:
DROP TEXT SEARCH DICTIONARY english;
This command will not succeed if there are any existing text search configurations that use the dictionary. Add CASCADE to drop such con-
figurations along with the dictionary.
COMPATIBILITY
There is no DROP TEXT SEARCH DICTIONARY statement in the SQL standard.
SEE ALSO
ALTER TEXT SEARCH DICTIONARY [alter_text_search_dictionary(7)], CREATE TEXT SEARCH DICTIONARY [create_text_search_dictionary(7)]
SQL - Language Statements 2010-05-14 DROP TEXT SEARCH DICTIONARY(7)