Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Unix Script to parse a CSV
Top Forums Shell Programming and Scripting Unix Script to parse a CSV Post 302234894 by RJ17 on Wednesday 10th of September 2008 05:09:38 PM
Old 09-10-2008
Here is what I have so far. The problem is I can't get the square root. Also none of my math functions give me floating point numbers but that is a secondary problem.

Code:
 
for i in `cat file.csv ` 
do
     x1=0
     x2=0
     sigma=0
     IFS=, 
     for f in $i 
          do  
          let x1=$x1+$f
          let x2=$f*$f+$x2
     done 
     let x1=$x1/30
     let x2=$x2/30
     let sigma=sqrt($x2-$x1*$x1)
     echo "Mean = " $x1
     echo "Standard Deviation = " $sigma
done

Last edited by RJ17; 09-10-2008 at 06:15 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

How to Parse a CSV file into a Different Format

Hi I have a CSV file with me in this format Currency, USD, EUR, USD, 1.00, 1.32, EUR, 0.66, 1.00, How do I transpose the file to get to the format below. currency, currency, rate USD, USD, 1.00 USD, EUR, 1.32 EUR, USD, 0.66 EUR, EUR, 1.00 Thanks for your help We are using... (2 Replies)
Discussion started by: cdesiks
2 Replies

2. Shell Programming and Scripting

CSV File parse help in Perl

Folks, I have a bit of an issue trying to obtain some data from a csv file using PERL. I can sort the file and remove any duplicates leaving only 4 or 5 rows containing data. My problem is that the data contained in the original file contains a lot more columns and when I try ro run this script... (13 Replies)
Discussion started by: lodey
13 Replies

3. Shell Programming and Scripting

Unix shell script to parse the contents of comma-separated file

Dear All, I have a comma-separated file. 1. The first line of the file(header) should have 4 commas(5 fields). 2. The last line of the file should have 1 comma(2 fields). Pls help me in checking this condition in a shell script. And the number of lines between the first line and last... (11 Replies)
Discussion started by: KrishnaSaran
11 Replies

4. Shell Programming and Scripting

Need help in creating a Unix Script to parse xml file

Hi All, My requirement is create an unix script to parse the xml file and display the values of the Elements/value between the tags on console. Like say, I would like to fetch the value of errorCode from the below xml which is 'U007' and display it. Can we use SED command for this? I have tried... (10 Replies)
Discussion started by: Anil.Wmg
10 Replies

5. Shell Programming and Scripting

Parse csv file

Hi, Our requirement is to parse the input file(.csv format). The each column in the file is delimited with comma. We need to take each column and apply some business validation rule. If data itself contains comma, then those fields are enclosed with double quotes ("). We can see this double... (7 Replies)
Discussion started by: vfrg
7 Replies

6. Shell Programming and Scripting

How to parse csv format?

Hi, I have a file with 3 fields in csv format: /tmp/foo/,MODIFY,bar/toto "/tmp/foo, bar/","ATTRIB,ISDIR","toto, tata/foobar"I would like to split fields in order to obtain the following: Line1: /tmp/foo/ MODIFY bar/totoLine2: /tmp/foo, bar/ ATTRIB,ISDIR toto, tata/foobarCan't find my way... (11 Replies)
Discussion started by: chebarbudo
11 Replies

7. UNIX for Dummies Questions & Answers

Help to parse csv file with shell script

Hello ! I am very aware that this is not the first time this question is asked here, because I have already read a lot of previous answers, but none of them worked, so... As said in the title, I want to read a csv file with a bash script. Here is a sample of the file: ... (4 Replies)
Discussion started by: Grhyll
4 Replies

8. Shell Programming and Scripting

BASH script to parse XML and generate CSV

Hi All, Hope all you are doing good! Need your help. I have an XML file which needs to be converted CSV file. I am not an expert of awk/sed so your help is highly appreciated!! XML file looks like this: <l:event dateTime="2013-03-13 07:15:54.713" layerName="OSB" processName="ABC"... (2 Replies)
Discussion started by: bhaskar_m
2 Replies

9. Shell Programming and Scripting

Parse csv files by their names

HI all I have multiple csv files with the names VAR1_VAR2_VAR3_VAR4.csv All the files have the same structure inside just values change. I am trying to retrieve data from those files by fixing at each time one or more VAR. I tried to write a script but I have 2 problems: 2-... (1 Reply)
Discussion started by: Jhon.c
1 Replies

10. Shell Programming and Scripting

Need a script to parse data and output to csv

I am not too savvy with arrays and am assuming that what I am looking for needs arrays. This is my requirement. So I have the raw data that gets updated to a log as shown below StudentInfo: FullInfo = { Address = Newark Age = 20 Name= John } StudentInfo:... (2 Replies)
Discussion started by: sidnow
2 Replies

LEARN ABOUT DEBIAN

math

math(3tcl)							 Tcl Math Library							math(3tcl)

__________________________________________________________________________________________________________________________________________________

NAME

       math - Tcl Math Library

SYNOPSIS

       package require Tcl  8.2

       package require math  ?1.2.5?

       ::math::cov value value ?value ...?

       ::math::integrate list of xy value pairs

       ::math::fibonacci n

       ::math::max value ?value ...?

       ::math::mean value ?value ...?

       ::math::min value ?value ...?

       ::math::product value ?value ...?

       ::math::random ?value1? ?value2?

       ::math::sigma value value ?value ...?

       ::math::stats value value ?value ...?

       ::math::sum value ?value ...?

_________________________________________________________________

DESCRIPTION

       The math package provides utility math functions.

       Besides a set of basic commands, available via the package math, there are more specialised packages:

       o      math::bigfloat - Arbitrary-precision floating-point arithmetic

       o      math::bignum - Arbitrary-precision integer arithmetic

       o      math::calculus::romberg - Robust integration methods for functions of one variable, using Romberg integration

       o      math::calculus - Integration of functions, solving ordinary differential equations

       o      math::combinatorics - Procedures for various combinatorial functions (for instance the Gamma function and "k out of n")

       o      math::complexnumbers - Complex number arithmetic

       o      math::constants - A set of well-known mathematical constants, such as Pi, E, and the golden ratio

       o      math::fourier - Discrete Fourier transforms

       o      math::fuzzy - Fuzzy comparisons of floating-point numbers

       o      math::geometry - 2D geometrical computations

       o      math::interpolate - Various interpolation methods

       o      math::linearalgebra - Linear algebra package

       o      math::optimize - Optimization methods

       o      math::polynomials - Polynomial arithmetic (includes families of classical polynomials)

       o      math::rationalfunctions - Arithmetic of rational functions

       o      math::roman - Manipulation (including arithmetic) of Roman numerals

       o      math::special - Approximations of special functions from mathematical physics

       o      math::statistics - Statistical operations and tests

BASIC COMMANDS

       ::math::cov value value ?value ...?
	      Return the coefficient of variation expressed as percent of two or more numeric values.

       ::math::integrate list of xy value pairs
	      Return the area under a "curve" defined by a set of x,y pairs and the error bound as a list.

       ::math::fibonacci n
	      Return the n'th Fibonacci number.

       ::math::max value ?value ...?
	      Return the maximum of one or more numeric values.

       ::math::mean value ?value ...?
	      Return the mean, or "average" of one or more numeric values.

       ::math::min value ?value ...?
	      Return the minimum of one or more numeric values.

       ::math::product value ?value ...?
	      Return the product of one or more numeric values.

       ::math::random ?value1? ?value2?
	      Return a random number.  If no arguments are given, the number is a floating point value between 0 and 1.  If one argument is given,
	      the number is an integer value between 0 and value1.  If two arguments are given, the number is an integer value between value1  and
	      value2.

       ::math::sigma value value ?value ...?
	      Return the population standard deviation of two or more numeric values.

       ::math::stats value value ?value ...?
	      Return the mean, standard deviation, and coefficient of variation (as percent) as a list.

       ::math::sum value ?value ...?
	      Return the sum of one or more numeric values.

BUGS, IDEAS, FEEDBACK
       This  document, and the package it describes, will undoubtedly contain bugs and other problems.	Please report such in the category math of
       the Tcllib SF Trackers [http://sourceforge.net/tracker/?group_id=12883].  Please also report any ideas for enhancements you  may  have  for
       either package and/or documentation.

KEYWORDS

       math, statistics

CATEGORY

       Mathematics

math								       1.2.5								math(3tcl)
All times are GMT -4. The time now is 04:16 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy