Sponsored Content
Top Forums Shell Programming and Scripting shell script to remove extra commas from CSV outp file Post 302518406 by DGPickett on Friday 29th of April 2011 02:11:27 PM
Old 04-29-2011
Code:
sed 's/,,*/,/g'

but the commas are column separators, even if the columns are mainly null, so it is better to select out the columns you want with:
Code:
cut -d, -f1,3,7-11

which works as long as there are no quoted commas in fields: "... , ...". BTW, in proper CSV, literal double quotes are doubled, e.g.,
Code:
,,,"He said, ""Drop the gun, stupid!"" in a shout.",,,,

Old Access did not honor double quotes, being "Johhny bought lately", but Excel was the mother of CSV. You can always select out the good columns using s CSV friendly JDBC/unixODBC driver and jisql(xigole)/isql in SQL.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

exporting number into .csv file in text form (no other extra charc) from shell script

I have written a k shell program which is executing a sql and exporting data in numeric form like 0412323444 into .csv file. the problem i am facing is that , the data is coming in excel formatted in scientific form like 4.1+E08,while my requirement is to store data as such 0412323444 in excel ( no... (5 Replies)
Discussion started by: Deepak_Rastogi
5 Replies

2. Shell Programming and Scripting

Remove duplicate commas after exporting excel file to csv

Hello everyone I'm new here and this is my first post so first of all I want to say that this is a great forum and I have managed to found most of my answers in these forums : ) So with that I ask you my first question: I have an excel file which I saved as a csv. However the excel file... (3 Replies)
Discussion started by: Spunkerspawn
3 Replies

3. Shell Programming and Scripting

CSV with commas in field values, remove duplicates, cut columns

Hi Description of input file I have: ------------------------- 1) CSV with double quotes for string fields. 2) Some string fields have Comma as part of field value. 3) Have Duplicate lines 4) Have 200 columns/fields 5) File size is more than 10GB Description of output file I need:... (4 Replies)
Discussion started by: krishnix
4 Replies

4. Shell Programming and Scripting

Remove line breaks in csv file using shell script

Hi All, I've a csv file in which the record is getting break into 1 line or more than one line. I want to combine those splits into one line and remove the unwanted character existing in the record i.e. double quote symbol ("). The line gets break only when the record contains double... (4 Replies)
Discussion started by: rajak.net
4 Replies

5. Shell Programming and Scripting

Adding Extra Commas to a CSV file

Trying in this forum. Not sure if it is permitted.... but in need of help. Please find the requirements in the below link. https://www.unix.com/unix-dummies-questions-answers/191503-add-extra-commas-csv-file-2.html#post302665179 Thanks in Advance. (1 Reply)
Discussion started by: chillblue
1 Replies

6. UNIX for Dummies Questions & Answers

To Add extra commas to a CSV file using 2 files...

Hi , Based on my previous requirement the code works fine for comma as delimiter. Now my Req is widened up a bit .. There will be two set of files .. one with comma as delimiter and other with semi-colon ; as delimiter. Second Sample file. With Double Quotes (Semi-Colon... (1 Reply)
Discussion started by: chillblue
1 Replies

7. UNIX for Dummies Questions & Answers

To Add extra commas to a CSV file.

Hi All, I got this requirement to process a complex CSV file. Eg File. Line 1: Name:,XYz Line 2: Age:,15 Line 3: Grade:,7 Line 4: Line 5: English, Maths, Science,Spanish Line 6:10,11,13,14 As you can see the maximum column is 4 . The file i need to make is Line 1: Name:,XYz,,... (12 Replies)
Discussion started by: chillblue
12 Replies

8. Shell Programming and Scripting

Shell script that should remove unnecessary commas between double quotes in CSV file

i have data as below 123,"paul phiri",paul@yahoo.com,"po.box 23, BT","Eco Bank,Blantyre,Malawi" i need an output to be 123,"paul phiri",paul@yahoo.com,"po.box 23 BT","Eco Bank Blantyre Malawi" (5 Replies)
Discussion started by: mathias23
5 Replies

9. Shell Programming and Scripting

How to remove unwanted commas from a .csv file?

how to remove unwanted commas from a .csv file Input file format "Server1","server-PRI-Windows","PRI-VC01","Microsoft Windows Server 2012, (64-bit)","Powered On","1,696.12","server-GEN-SFCHT2-VMS-R013,server-GEN-SFCHT2-VMS-R031,server-GEN-SFCHT2-VMS-R023"... (5 Replies)
Discussion started by: ranjancom2000
5 Replies

10. Shell Programming and Scripting

Is there a way to handle commas inside the data when generating a csv file from shell script?

I am extracting data via sql query and some of the data has commas. Output File must be csv and I cannot update the data in the db (as it is used by other application). Example table FavoriteThings Person VARCHAR2(25), Favorite VARCHAR2(100) Sample Data Greta rain drop on... (12 Replies)
Discussion started by: patk625
12 Replies
HOTSWAPRC(5)							File Formats Manual						      HOTSWAPRC(5)

NAME
hotswaprc - configuration file for hotswap DESCRIPTION
/etc/hotswaprc is the global configuration file for the hotswap utility. It allows system administrators to specify arbitrary shell scripts to be run after a device is inserted, as well as before and after it is removed. Scripts are selected according to the model name retrieved from the device. This is particularly helpful for automatic configura- tion of CD-RW drives, which require SCSI emulation and bypass normal access via the IDE subsystem. hotswaprc is implemented as an Extensible Mark-up Language (XML) application. XML documents are structured using elements of the form <tag-name> content <tag-name>. A Document Type Definition (DTD) describes the possible content of each element. Please refer to the XML specification for more information. The hotswap distribution also contains an example file, doc/hotswaprc.example, which includes the DTD for the configuration file format. ELEMENTS
<hotswap> This is the root element of the document. Each valid hotswaprc must contain exactly one <hotswap> element. The <hotswap> element may contain an arbitrary number of <device> elements. <device> The configuration file contains one <device> element for every device for which scripts are defined. The <device> element is com- posed of the following elements in this order: <name>, <post-insert>, <pre-remove>, <post-remove>. All but <name> are optional. <name> The content of this element is the model identification string of the IDE device the current <device> element refers to. <post-insert> Contains the shell script that is to be executed after the device has been inserted and registered with the kernel. <pre-remove> Contains the shell script that is to be run before hotswap attempts to unregister the device. <post-remove> Contains the shell script that is to be run after the device had been unregistered. REPORT BUGS
Report bugs to t.stadelmann1@physics.ox.ac.uk. AUTHOR
Written by Tim Stadelmann. SEE ALSO
hotswap(1), xhotswap(1). COPYRIGHT
Copyright (c) 2002-2003 Tim Stadelmann. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU General Public License (GPL), Version 2 or any later version published by the Free Software Foundation. 26th November 2002 HOTSWAPRC(5)
All times are GMT -4. The time now is 11:43 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy