Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Read data from .csv file through shell script & modify
Top Forums Shell Programming and Scripting Read data from .csv file through shell script & modify Post 302506570 by durden_tyler on Monday 21st of March 2011 08:32:49 AM
Old 03-21-2011
Quote:
Originally Posted by raj100
...
File test.csv :
----------------------------------------------------------------
name price descriptor
Car 50 Mustang
Car_ 70 Audi A5
Bike 30 BMW)
SUV@ 80 Fortuner+_
Car 75 Sierra
--------------------------------
...
"csv" means "comma separated values". There are no commas in your "test.csv" file, so I'll assume your file looks like the one in the following excerpt -

Code:
$
$
$ # show the content of the csv file "f3"
$
$ cat f3
name,price,descriptor
Car,50,Mustang
Car_,70,Audi A5
Bike,30,BMW)
SUV@,80,Fortuner+_
Car,75,Sierra
$
$ # run the awk one-liner to process "f3"
$
$ awk -F, 'NR>1 {if ($1 !~ /^[a-zA-Z0-9 ]+$/ || $3 !~ /^[a-zA-Z0-9 ]+$/){print $0 >"f3.err"} else {print $0 >"f3.tmp"}}' f3 ; mv f3.tmp f3
$
$ # show the content of the error file "f3.err"
$
$ cat f3.err
Car_,70,Audi A5
Bike,30,BMW)
SUV@,80,Fortuner+_
$
$ # show the content of the updated csv file "f3"
$
$ cat f3
Car,50,Mustang
Car,75,Sierra
$
$

tyler_durden
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Korn Shell Script - Read File & Search On Values

I am attempting to itterate through a file that has multiple lines and for each one read the entire line and use the value then to search in other files. The problem is that instead of an entire line I am getting each word in the file set as the value I am searching for. For example in File 1... (2 Replies)
Discussion started by: run_unx_novice
2 Replies

2. Shell Programming and Scripting

Shell Script to Load data into the database using a .csv file and .ctl file

Since i'm new to scripting i'm findind it difficult to code a script. The script has to be an executable with 2 paramters passed to it.The Parameters are 1. The Control file name(.ctl file) 2. The Data file name(.csv file) Does anybody have an idea about it? :confused: (3 Replies)
Discussion started by: Csmani
3 Replies

3. Shell Programming and Scripting

Exporting data as a CSV file from Unix shell script

Friends...This is the first time i am trying the report generation using shell script... any suggestions are welcome. Is there a way to set the font size & color when i am exporting the data from unix shell script as a CSV file ? The following sample data is saved as a .csv file in the... (2 Replies)
Discussion started by: appu2176
2 Replies

4. Shell Programming and Scripting

Calling Pl/sql function in shell script to modify csv

I need to 1.Open a csv 2.Process the csv i.e. Modify 2 column in the csv. To modify the column the value needs to be passed to a pl/sql function and the return value should be updated For eg: If column 2 E,then E will be passed in database function which will return Employee. 3. Write a... (5 Replies)
Discussion started by: Chinky23
5 Replies

5. UNIX for Dummies Questions & Answers

Shell script to extract data from csv file based on certain conditions

Hi Guys, I am new to shell script.I need your help to write a shell script. I need to write a shell script to extract data from a .csv file where columns are ',' separated. The file has 5 columns having values say column 1,column 2.....column 5 as below along with their valuesm.... (1 Reply)
Discussion started by: Vivekit82
1 Replies

6. UNIX for Dummies Questions & Answers

Shell script to extract data from csv file

Hi Guys, I am new to shell script.I need your help to write a shell script. I need to write a shell script to extract data from a .csv file where columns are ',' separated. The file has 7 columns having values say column 1,column 2.....column 7 as below along with their values. Name, Address,... (7 Replies)
Discussion started by: Vivekit82
7 Replies

7. Shell Programming and Scripting

Shell script to extract data from csv file

Hi everyone, I have a csv file which has data with different heading and column names as below. Static Data Ingested ,,,,,,,,,,,,Known Explained Rejections Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies

8. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

9. Shell Programming and Scripting

Read csv file, convert the data and make one text file in UNIX shell scripting

I have input data looks like this which is a part of a csv file 7,1265,76548,"0102:04" 8,1266,76545,"0112:04" I need to make the output data should look like this and the output data will be part of text file: 7|1265000 |7654899 |A| 8|12660000 |76545999 |B| The logic behind the... (6 Replies)
Discussion started by: RJG
6 Replies

10. Shell Programming and Scripting

Is there a way to handle commas inside the data when generating a csv file from shell script?

I am extracting data via sql query and some of the data has commas. Output File must be csv and I cannot update the data in the db (as it is used by other application). Example table FavoriteThings Person VARCHAR2(25), Favorite VARCHAR2(100) Sample Data Greta rain drop on... (12 Replies)
Discussion started by: patk625
12 Replies

LEARN ABOUT DEBIAN

nwdiag

NWDIAG(1)						      General Commands Manual							 NWDIAG(1)

NAME

       nwdiag - generate network-diagram image file from spec-text file.

SYNOPSIS

       nwdiag [options] files

DESCRIPTION

       This manual page documents briefly the nwdiag commands.

       nwdiag is generate sequence-diagram image file from spec-text file.

OPTIONS

       These  programs	follow	the  usual  GNU  command  line	syntax, with long options starting with two dashes (`-').  A summary of options is
       included below.	For a complete description, see the Info files.

       -h, --help
	      show this help message and exit.

       --version
	      show program's version number and exit.

       -a, --antialias
	      Pass diagram image to anti-alias filter.

       -c FILE, --config=FILE
	      read configurations from FILE.

       -o FILE
	      write diagram to FILE.

       -f FONT, --font=FONT
	      use FONT to draw diagram.

       -T TYPE
	      Output diagram as TYPE format.

SEE ALSO

       The programs are documented fully by
       http://blockdiag.com/en/nwdiag/

AUTHOR

       nwdiag was written by Takeshi Komiya <i.tkomiya@gmail.com>

       This manual page was written by Kouhei Maeda <mkouhei@palmtb.net>, for the Debian project (and may be used by others).

								   June 11, 2011							 NWDIAG(1)
All times are GMT -4. The time now is 05:46 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy