awk on csv files Post: 303034113

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

csv files (with quoted commas) and awk

I have a file as follows: 1,"This is field 2",3,4,5 2,"This is field 2 it can contain one , comma",3,4,5 3,"This is field 2 it also, can, contain, more",3,4,5 4,"This is field 2 without extra commas",3,4,5 and i pass this through to awk: awk -F, ' { if (...

2. Shell Programming and Scripting

validation of data using filter (awk or other that works...) in csv files

Hello People I have the following file.csv: date,string,float,number,boolean 20080303,abc,1.5,123,Y 20080304,abc,1.2,345,N 20080229,nvh,1.4,098,Y 20080319,ugy,1.9,586,N 20080315,gyh,2.4,345,Y 20080316,erf,3.1,932,N I need to filter the date field where I have a data bigger than I...

3. UNIX for Dummies Questions & Answers

Writing awk script to read csv files and split them

Hi Here is my script that calls my awk script #!/bin/bash set -x dir="/var/local/dsx/csv" testfile="$testfile" while getopts " f: " option do case $option in f ) testfile="$OPTARG";; esac; done ./scriptFile --testfile=$testfile >> $dir/$testfile.csv It calls my awk...

4. Shell Programming and Scripting

how to give multiple csv files as input in awk

Hi All, I am new to shell scripting..My problem is i want to give multiple csv files as input to awk script and process the data into one file.. My input file is File1 File2 File3 Product Location Period SalesPrice A x 8/11/2010 ...

5. Shell Programming and Scripting

Merge 2 csv files with awk

I have 2 files pipe delimted and want to merge them based on a key e.g file 1 123$aaa$yyy$zzz 345$xab$yzy$zyz 456$sss$ttt$foo 799$aaa$ggg$dee file 2 123$hhh 345$ddd 456$xxx 888$zzz so if the key is the first field, and the result should be the common key between file 1 and 2

6. Shell Programming and Scripting

Using AWK to match CSV files with duplicate patterns

Dear awk users, I am trying to use awk to match records across two moderately large CSV files. File1 is a pattern file with 173,200 lines, many of which are repeated. The order in which these lines are displayed is important, and I would like to preserve it. File2 is a data file with 456,000...

7. Shell Programming and Scripting

awk script to perform an action similar to vlookup between two csv files in UNIX

Hi, I am new to awk/unix and am trying to put together an awk script to perform an action similar to vlookup between the two csv files. Here are the contents of the two files: File 1: Date,ParentID,Number,Area,Volume,Dimensions 2014-01-01,ABC,247,83430.33,857.84,8110.76...

8. Shell Programming and Scripting

Filter using awk in CSV files

Hello Gentlemen, Finding difficulties to play with my Input files:confused: . Your guidance will certainly help as always. After converting to csv file from XLSM file, I am getting some extra ""(double quote) characters which I want to terminate inside shell script and process it further. ...

9. UNIX for Beginners Questions & Answers

awk assistance - Comparing 2 csv files

Hello all, I have searched high and low for a solution to this, many have come really close but not quite what I'm after. I have 2 files. One contains GUID's, for example: 8121E002-96FE-4C9C-BC5A-6AFF20DACECD 84468F30-F3B7-418B-81F0-0908E80792BF A second file, contains a path to the...

10. Shell Programming and Scripting

Modify csv-files with awk

Hello everyone! I have thousands of csv files I have to import into a Database table. As usually the files aren't perfect. For example they have a different number of columns and some weird columns. The second problem is, that I have to add 3 parts of the filename into 3 rows in the...

LEARN ABOUT DEBIAN

pocount

pocount(1)						      Translate Toolkit 1.3.0							pocount(1)

NAME

       pocount - Produces word counts and other statistics from a PO file.

SYNOPSIS

       pocount [--csv] [directory|file(s)]

DESCRIPTION

       pocount will count the number of strings and words in a PO file.

       If  no  files  or directories argument are provided, pocount will recurse through all files from the current directory.	Otherwise, it will
       recurse and count all files in the specified directory or in the specified PO files.

OPTIONS

       --csv  changes the output format to CSV (Comma Seperated Values) for import into a spreadsheet.

OUTPUT

       In normal mode the following output is given:

	avmedia/source/viewer.po
	type	       strings words (source) words (translation)
	translated:	  1	     3		     3
	fuzzy:		  0	     0		   n/a
	untranslated:	  4	    22		   n/a
	Total:		  5	    25		     3
	review		  1	     3		   n/a

       In CSV mode the following outut is shown:

	Filename, Translated Messages, Translated Source Words, Translated Target Words, Fuzzy Messages, Fuzzy	Source	Words,	Untranslated  Mes-
       sages, Untranslated Source Words, Review Messages, Review Source Words
	avmedia/source/viewer.po,  1, 3, 3, 0, 0, 4, 22, 1, 3

       Totals are not provided in CSV mode. In normal mode a grand total and file count is provided if the number of files is greater than one.

BUGS

       There are some miscounts related to word breaks.

							      Translate Toolkit 1.3.0							pocount(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

csv files (with quoted commas) and awk

Discussion started by: Cranie

2. Shell Programming and Scripting

validation of data using filter (awk or other that works...) in csv files

Discussion started by: Rafael.Buria

3. UNIX for Dummies Questions & Answers

Writing awk script to read csv files and split them

Discussion started by: ladyAnne

4. Shell Programming and Scripting

how to give multiple csv files as input in awk

Discussion started by: kvth