Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help to parse csv file with shell script
Top Forums UNIX for Dummies Questions & Answers Help to parse csv file with shell script Post 302591036 by Grhyll on Wednesday 18th of January 2012 09:47:15 AM
Old 01-18-2012
[Solved] Help to parse csv file with shell script
Hello !

I am very aware that this is not the first time this question is asked here, because I have already read a lot of previous answers, but none of them worked, so...
As said in the title, I want to read a csv file with a bash script.

Here is a sample of the file:

Code:
steev	YES	RGBA8888	0.55	2	2	2	2048
vahine	YES	RGBA8888	0.55	2	2	2	2048
winnick	YES	RGBA8888	0.55	2	2	2	2048

(Copied and pasted from Excel for Mac, but there should be ";")

And here is the simplified code I am trying to make work:

Code:
export IFS=";"

    file="Test.csv"
    more $file | while read name
    do
        echo $name
    done

And... it won't work. Nothing comes out.
If I just do "more $file", then I have a beautiful output:
Code:
vahine;YES;RGBA8888;0.55;2;2;2;2048^Mwinnick;YES;RGBA8888;0.55;2;2;2;2048^Mvenus;YES;RGBA8888;0.55;1;2;1;2048^Mvesper;YES;RGBA8888;0.55;1;2;1;2048

(I could not reproduce it here, but the "^M" are written in white on a black background.)

I have tried using cat or echo instead of more, without success, I have even tried sed and awk with some of the many solutions given on the internet, but they did not work neither, and I would prefer not to use awk if possible, since I do not really understand it yet.

Another strange thing is that if I do:
Code:
    fileContent=$(more $file)
    echo $fileContent

Then I have as output only the last line of the file and not the others...

I am kind of stuck here, without any additionnal idea.
I don't even absolutely want to use csv files, it is just that this format is convenient if many people have to change the source file, so if you have in mind a format easier to read with bash, let me know.

I hope I've given all the needed information and that one of you will have an idea...
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parse a string in XML file using shell script

Hi! I'm just new here and don't know much about shell scripting. I just want to ask for help in creating a shell script that will parse a string or value of the status in the xml file. Please sample xml file below. Can you please help me create a simple script to get the value of status? Also it... (46 Replies)
Discussion started by: ayhanne
46 Replies

2. Shell Programming and Scripting

Unix Script to parse a CSV

I am writing a unix script that will parse a CSV and edit the values. My CSV looks like this 0,0,0,0,1,0,1,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,2,0,0,0,0,0,0 10,11,7,0,4,12,2,3,7,0,11,3,12,4,0,5,5,4,5,0,8,6,12,0,9,3,3,0,2,7,8... (16 Replies)
Discussion started by: RJ17
16 Replies

3. Shell Programming and Scripting

Help!!! Shell script to parse data file.

I am faced with a :confused: tricky problem to parse a data file ( May not be a tricky problem to the scripting guru's ). Here is what I am faced with. I have a file with multiple rows of data and the rows are not of fixed length. "|" is used as a delimiters for individual columns and each row... (3 Replies)
Discussion started by: yajaykumar
3 Replies

4. Shell Programming and Scripting

Parse XML file into CSV with shell?

Hi, It's been a few years since college when I did stuff like this all the time. Can someone help me figure out how to best tackle this problem? I need to parse a file full of entries that look like this: <eq action="A" sectyType="0" symbol="PGR" exch="CA" curr="VEF" sess="NORM"... (7 Replies)
Discussion started by: Pcushing
7 Replies

5. UNIX for Advanced & Expert Users

shell script to parse html file

hi all, i have a html file something similar to this. <tr class="evenrow"> <td class="data">added</td><td class="data">xyz@abc.com</td> <td class="data">filename.sql</td><td class="modifications-data">08/25/2009 07:58:40</td><td class="data">Added TK prof script</td> </tr> <tr... (1 Reply)
Discussion started by: sais
1 Replies

6. Shell Programming and Scripting

Parse XML file in shell script

Hi Everybody, I have an XML file containing some data and i want to extract it, but the specific issue in my file is that the data is repeated some times like the following example : <section1> <subsection1> X=... Y=... Z=... <\subsection1> <subsection2> X=... Y=... Z=...... (2 Replies)
Discussion started by: yassine
2 Replies

7. Shell Programming and Scripting

Parse file from 2nd line in shell script

Hi, I need to parse input file from 2nd line. Input file contents are, ABC123;20100913115432;2000000;NO; 04;AAA;09;DDD;601020304;AAAA;1;OPTA1;OPTA2;;; 04;BBB;09;BBB;601020304;BBBB;0;OPTB1;OPTB2;OPTB3;OPTB4;OPTB5; 04;CCC;09;DDD;601020304;CCCC;1;;;;; For each line, 1] I need to check... (17 Replies)
Discussion started by: Poonamol
17 Replies

8. Shell Programming and Scripting

Bash Shell Script to parse file

Raw Results: results|192.168.2|192.168.2.1|general/udp|10287|Security Note|For your information, here is the traceroute from 192.168.2.24 to 192.168.2.1 : \n192.168.2.24\n192.168.2.1\n\n results|192.168.2|192.168.2.1|ssh (22/tcp)|22964|Security Note|An SSH server is running on this port.\n... (2 Replies)
Discussion started by: jroberson
2 Replies

9. Shell Programming and Scripting

Korn shell program to parse CSV text file and insert values into Oracle database

Enclosed is comma separated text file. I need to write a korn shell program that will parse the text file and insert the values into Oracle database. I need to write the korn shell program on Red Hat Enterprise Linux server. Oracle database is 10g. (15 Replies)
Discussion started by: shellguy
15 Replies

10. Shell Programming and Scripting

Help with Shell Scrip in Masking particular columns in .csv file or .txt file using shell script

Hello Unix Shell Script Experts, I have a script that would mask the columns in .csv file or .txt file. First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder. Two parameters are passed ... (5 Replies)
Discussion started by: Mahesh G
5 Replies

LEARN ABOUT DEBIAN

bb-csvinfo.cgi

BB-CSVINFO.CGI(1)					      General Commands Manual						 BB-CSVINFO.CGI(1)

NAME

       bb-csvinfo.cgi - CGI program to show host information from a CSV file

SYNOPSIS

       bb-csvinfo.cgi

DESCRIPTION

       bb-csvinfo.cgi  is  invoked  as	a CGI script via the bb-csvinfo.sh CGI wrapper.  Based on the parameters it receives, it searches a comma-
       separated file for the matching host, and presents the information found as a table.

       bb-csvinfo.cgi is passed a QUERY_STRING environment variable with the following parameters:

	  key (string to search for, typically hostname)
	  column (columnnumber to search - default 0)
	  db  (name of the CSV database file in $BBHOME/etc/, default hostinfo.csv)
	  delimiter (delimiter character for columns, default semi-colon)

       CSV files are easily created from e.g. spreadsheets, by exporting them in CSV format. You should have one host per  line,  with	the  first
       line  containing  the  column headings. Despite their name, the default delimiter for CSV files is the semi-colon - if you need a different
       delimiter, invoke bb-csvinfo.cgi with the "delimiter=<character>" in the query string.

Example usage
       This example shows how you can use the bb-csvinfo CGI. It assumes you have a CSV-formatted file with information about the hosts stored	as
       $BBHOME/etc/hostinfo.csv, and the hostname is in the first column of the file.

       Use with the bbgen --docurl
	      The  --docurl  option to bbgen(1) sets up all of the hostnames on your Xymon webpages to act as links to a CGI script. To invoke the
	      bb-csvinfo CGI script, run bbgen with the option

		 --docurl=/cgi-bin/bb-csvinfo.sh?db=hostinfo.csv&key=%s

SEE ALSO

       bb-hosts(5), hobbitserver.cfg(5), bbgen(1)

Xymon							    Version 4.2.3:  4 Feb 2009						 BB-CSVINFO.CGI(1)
All times are GMT -4. The time now is 08:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy