Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Unix Script to parse a CSV
Top Forums Shell Programming and Scripting Unix Script to parse a CSV Post 302234817 by RJ17 on Wednesday 10th of September 2008 11:43:05 AM
Old 09-10-2008
Here is a copy paste of my putty session. It isn't working like yours and I dont know why. Maybe you can see something. I am unable to check the versions on the server. What about using the append option of sed to add the value to the end of the line. I am new to sed and still learning.
Code:
 
210> cat file
0,0,0,0,1,0,1,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,2,0,0,0,0,0,0
10,11,7,0,4,12,2,3,7,0,11,3,12,4,0,5,5,4,5,0,8,6,12,0,9,3,3,0,2,7,8
19,11,7,0,4,14,16,10,8,2,13,7,15,6,0,76,6,4,10,0,18,10,17,1,11,3,3,0,9,9,8
22,11,13,1,5,14,16,10,9,10,13,7,16,6,0,59,6,4,10,0,18,13,17,1,11,3,3,0,12,9,10
22,11,13,1,5,14,16,10,9,10,13,7,16,6,22,90,6,4,10,0,18,13,17,1,11,3,4,0,12,9,10
41,18,27,9,27,41,59,20,27,54,63,34,28,43,40,131,7,8,19,0,62,16,30,23,25,3,4,9,24,12,19
42,18,27,9,27,41,59,20,27,55,68,36,28,46,41,132,7,8,19,13,64,16,31,25,25,3,4,9,24,12,19
125,124,78,62,97,87,145,70,87,119,150,124,99,95,41,175,85,58,57,88,142,83,92,102,107,80,45,64,64,94,89
125,126,78,62,99,87,145,70,87,119,161,124,99,95,41,175,85,58,58,88,142,84,112,103,108,80,68,64,65,98,89
189,254,164,153,192,153,230,132,188,163,210,210,167,198,93,235,146,110,97,130,211,107,181,140,151,119,105,105,178,126,165
189,324,168,192,194,159,233,132,192,169,244,210,167,201,103,235,147,152,180,181,213,107,192,190,212,119,119,126,195,126,166
189,324,168,255,194,225,233,141,192,230,244,260,167,201,172,283,181,206,217,216,261,107,192,235,212,119,169,197,264,189,229
366,438,315,319,382,287,398,320,416,382,407,397,342,448,276,392,297,368,237,347,336,332,384,405,412,284,329,350,396,326,356
 
211> sed -e '1s/^[^,]*,//' -e '1s/$/,10/' file
,10,0,1,0,1,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,2,0,0,0,0,0,0
10,11,7,0,4,12,2,3,7,0,11,3,12,4,0,5,5,4,5,0,8,6,12,0,9,3,3,0,2,7,8
19,11,7,0,4,14,16,10,8,2,13,7,15,6,0,76,6,4,10,0,18,10,17,1,11,3,3,0,9,9,8
22,11,13,1,5,14,16,10,9,10,13,7,16,6,0,59,6,4,10,0,18,13,17,1,11,3,3,0,12,9,10
22,11,13,1,5,14,16,10,9,10,13,7,16,6,22,90,6,4,10,0,18,13,17,1,11,3,4,0,12,9,10
41,18,27,9,27,41,59,20,27,54,63,34,28,43,40,131,7,8,19,0,62,16,30,23,25,3,4,9,24,12,19
42,18,27,9,27,41,59,20,27,55,68,36,28,46,41,132,7,8,19,13,64,16,31,25,25,3,4,9,24,12,19
125,124,78,62,97,87,145,70,87,119,150,124,99,95,41,175,85,58,57,88,142,83,92,102,107,80,45,64,64,94,89
125,126,78,62,99,87,145,70,87,119,161,124,99,95,41,175,85,58,58,88,142,84,112,103,108,80,68,64,65,98,89
189,254,164,153,192,153,230,132,188,163,210,210,167,198,93,235,146,110,97,130,211,107,181,140,151,119,105,105,178,126,165
189,324,168,192,194,159,233,132,192,169,244,210,167,201,103,235,147,152,180,181,213,107,192,190,212,119,119,126,195,126,166
189,324,168,255,194,225,233,141,192,230,244,260,167,201,172,283,181,206,217,216,261,107,192,235,212,119,169,197,264,189,229

 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

How to Parse a CSV file into a Different Format

Hi I have a CSV file with me in this format Currency, USD, EUR, USD, 1.00, 1.32, EUR, 0.66, 1.00, How do I transpose the file to get to the format below. currency, currency, rate USD, USD, 1.00 USD, EUR, 1.32 EUR, USD, 0.66 EUR, EUR, 1.00 Thanks for your help We are using... (2 Replies)
Discussion started by: cdesiks
2 Replies

2. Shell Programming and Scripting

CSV File parse help in Perl

Folks, I have a bit of an issue trying to obtain some data from a csv file using PERL. I can sort the file and remove any duplicates leaving only 4 or 5 rows containing data. My problem is that the data contained in the original file contains a lot more columns and when I try ro run this script... (13 Replies)
Discussion started by: lodey
13 Replies

3. Shell Programming and Scripting

Unix shell script to parse the contents of comma-separated file

Dear All, I have a comma-separated file. 1. The first line of the file(header) should have 4 commas(5 fields). 2. The last line of the file should have 1 comma(2 fields). Pls help me in checking this condition in a shell script. And the number of lines between the first line and last... (11 Replies)
Discussion started by: KrishnaSaran
11 Replies

4. Shell Programming and Scripting

Need help in creating a Unix Script to parse xml file

Hi All, My requirement is create an unix script to parse the xml file and display the values of the Elements/value between the tags on console. Like say, I would like to fetch the value of errorCode from the below xml which is 'U007' and display it. Can we use SED command for this? I have tried... (10 Replies)
Discussion started by: Anil.Wmg
10 Replies

5. Shell Programming and Scripting

Parse csv file

Hi, Our requirement is to parse the input file(.csv format). The each column in the file is delimited with comma. We need to take each column and apply some business validation rule. If data itself contains comma, then those fields are enclosed with double quotes ("). We can see this double... (7 Replies)
Discussion started by: vfrg
7 Replies

6. Shell Programming and Scripting

How to parse csv format?

Hi, I have a file with 3 fields in csv format: /tmp/foo/,MODIFY,bar/toto "/tmp/foo, bar/","ATTRIB,ISDIR","toto, tata/foobar"I would like to split fields in order to obtain the following: Line1: /tmp/foo/ MODIFY bar/totoLine2: /tmp/foo, bar/ ATTRIB,ISDIR toto, tata/foobarCan't find my way... (11 Replies)
Discussion started by: chebarbudo
11 Replies

7. UNIX for Dummies Questions & Answers

Help to parse csv file with shell script

Hello ! I am very aware that this is not the first time this question is asked here, because I have already read a lot of previous answers, but none of them worked, so... As said in the title, I want to read a csv file with a bash script. Here is a sample of the file: ... (4 Replies)
Discussion started by: Grhyll
4 Replies

8. Shell Programming and Scripting

BASH script to parse XML and generate CSV

Hi All, Hope all you are doing good! Need your help. I have an XML file which needs to be converted CSV file. I am not an expert of awk/sed so your help is highly appreciated!! XML file looks like this: <l:event dateTime="2013-03-13 07:15:54.713" layerName="OSB" processName="ABC"... (2 Replies)
Discussion started by: bhaskar_m
2 Replies

9. Shell Programming and Scripting

Parse csv files by their names

HI all I have multiple csv files with the names VAR1_VAR2_VAR3_VAR4.csv All the files have the same structure inside just values change. I am trying to retrieve data from those files by fixing at each time one or more VAR. I tried to write a script but I have 2 problems: 2-... (1 Reply)
Discussion started by: Jhon.c
1 Replies

10. Shell Programming and Scripting

Need a script to parse data and output to csv

I am not too savvy with arrays and am assuming that what I am looking for needs arrays. This is my requirement. So I have the raw data that gets updated to a log as shown below StudentInfo: FullInfo = { Address = Newark Age = 20 Name= John } StudentInfo:... (2 Replies)
Discussion started by: sidnow
2 Replies

LEARN ABOUT OPENDARWIN

koi8-r

KOI8-R(7)						     Linux Programmer's Manual							 KOI8-R(7)

NAME

       koi8-r - Russian character set encoded in octal, decimal, and hexadecimal

DESCRIPTION

       RFC 1489 defines an 8-bit character set, KOI8-R.  KOI8-R encodes the characters used in Russian.

   KOI8-R characters
       The following table displays the characters in KOI8-R that are printable and unlisted in the ascii(7) manual page.

       Oct   Dec   Hex	 Char	Description
       ------------------------------------------------------------------------
       200   128   80		BOX DRAWINGS LIGHT HORIZONTAL
       201   129   81	  |	BOX DRAWINGS LIGHT VERTICAL
       202   130   82		BOX DRAWINGS LIGHT DOWN AND RIGHT
       203   131   83		BOX DRAWINGS LIGHT DOWN AND LEFT
       204   132   84		BOX DRAWINGS LIGHT UP AND RIGHT
       205   133   85		BOX DRAWINGS LIGHT UP AND LEFT
       206   134   86		BOX DRAWINGS LIGHT VERTICAL AND RIGHT
       207   135   87		BOX DRAWINGS LIGHT VERTICAL AND LEFT
       210   136   88		BOX DRAWINGS LIGHT DOWN AND HORIZONTAL
       211   137   89		BOX DRAWINGS LIGHT UP AND HORIZONTAL
       212   138   8A		BOX DRAWINGS LIGHT VERTICAL AND HORIZONTAL
       213   139   8B		UPPER HALF BLOCK
       214   140   8C		LOWER HALF BLOCK
       215   141   8D		FULL BLOCK
       216   142   8E		LEFT HALF BLOCK
       217   143   8F		RIGHT HALF BLOCK
       220   144   90		LIGHT SHADE
       221   145   91		MEDIUM SHADE
       222   146   92		DARK SHADE
       223   147   93		TOP HALF INTEGRAL
       224   148   94		BLACK SQUARE
       225   149   95		BULLET OPERATOR
       226   150   96	  /	SQUARE ROOT
       227   151   97	  ~~	ALMOST EQUAL TO
       230   152   98	  <=	LESS-THAN OR EQUAL TO
       231   153   99	  >=	GREATER-THAN OR EQUAL TO
       232   154   9A		NO-BREAK SPACE
       233   155   9B		BOTTOM HALF INTEGRAL
       234   156   9C	  o	DEGREE SIGN
       235   157   9D	  2	SUPERSCRIPT TWO
       236   158   9E	  .	MIDDLE DOT
       237   159   9F	 -:-	DIVISION SIGN
       240   160   A0		BOX DRAWINGS DOUBLE HORIZONTAL
       241   161   A1		BOX DRAWINGS DOUBLE VERTICAL
       242   162   A2		BOX DRAWINGS DOWN SINGLE AND RIGHT DOUBLE
       243   163   A3		CYRILLIC SMALL LETTER IO
       244   164   A4		BOX DRAWINGS DOWN DOUBLE AND RIGHT SINGLE
       245   165   A5		BOX DRAWINGS DOUBLE DOWN AND RIGHT
       246   166   A6		BOX DRAWINGS DOWN SINGLE AND LEFT DOUBLE
       247   167   A7		BOX DRAWINGS DOWN DOUBLE AND LEFT SINGLE
       250   168   A8		BOX DRAWINGS DOUBLE DOWN AND LEFT
       251   169   A9		BOX DRAWINGS UP SINGLE AND RIGHT DOUBLE
       252   170   AA		BOX DRAWINGS UP DOUBLE AND RIGHT SINGLE
       253   171   AB		BOX DRAWINGS DOUBLE UP AND RIGHT
       254   172   AC		BOX DRAWINGS UP SINGLE AND LEFT DOUBLE
       255   173   AD		BOX DRAWINGS UP DOUBLE AND LEFT SINGLE
       256   174   AE		BOX DRAWINGS DOUBLE UP AND LEFT
       257   175   AF		BOX DRAWINGS VERTICAL SINGLE AND RIGHT DOUBLE
       260   176   B0		BOX DRAWINGS VERTICAL DOUBLE AND RIGHT SINGLE
       261   177   B1		BOX DRAWINGS DOUBLE VERTICAL AND RIGHT

       262   178   B2		BOX DRAWINGS VERTICAL SINGLE AND LEFT DOUBLE
       263   179   B3		CYRILLIC CAPITAL LETTER IO
       264   180   B4		BOX DRAWINGS VERTICAL DOUBLE AND LEFT SINGLE
       265   181   B5		BOX DRAWINGS DOUBLE VERTICAL AND LEFT
       266   182   B6		BOX DRAWINGS DOWN SINGLE AND HORIZONTAL DOUBLE
       267   183   B7		BOX DRAWINGS DOWN DOUBLE AND HORIZONTAL SINGLE
       270   184   B8		BOX DRAWINGS DOUBLE DOWN AND HORIZONTAL
       271   185   B9		BOX DRAWINGS UP SINGLE AND HORIZONTAL DOUBLE
       272   186   BA		BOX DRAWINGS UP DOUBLE AND HORIZONTAL SINGLE
       273   187   BB		BOX DRAWINGS DOUBLE UP AND HORIZONTAL
       274   188   BC		BOX DRAWINGS VERTICAL SINGLE
				AND HORIZONTAL DOUBLE
       275   189   BD		BOX DRAWINGS VERTICAL DOUBLE
				AND HORIZONTAL SINGLE
       276   190   BE		BOX DRAWINGS DOUBLE VERTICAL AND HORIZONTAL
       277   191   BF	 (C)	COPYRIGHT SIGN
       300   192   C0		CYRILLIC SMALL LETTER YU
       301   193   C1		CYRILLIC SMALL LETTER A
       302   194   C2		CYRILLIC SMALL LETTER BE
       303   195   C3		CYRILLIC SMALL LETTER TSE
       304   196   C4		CYRILLIC SMALL LETTER DE
       305   197   C5		CYRILLIC SMALL LETTER IE
       306   198   C6		CYRILLIC SMALL LETTER EF
       307   199   C7		CYRILLIC SMALL LETTER GHE
       310   200   C8		CYRILLIC SMALL LETTER HA
       311   201   C9		CYRILLIC SMALL LETTER I
       312   202   CA		CYRILLIC SMALL LETTER SHORT I
       313   203   CB		CYRILLIC SMALL LETTER KA
       314   204   CC		CYRILLIC SMALL LETTER EL
       315   205   CD		CYRILLIC SMALL LETTER EM
       316   206   CE		CYRILLIC SMALL LETTER EN
       317   207   CF		CYRILLIC SMALL LETTER O
       320   208   D0		CYRILLIC SMALL LETTER PE
       321   209   D1		CYRILLIC SMALL LETTER YA
       322   210   D2		CYRILLIC SMALL LETTER ER
       323   211   D3		CYRILLIC SMALL LETTER ES
       324   212   D4		CYRILLIC SMALL LETTER TE
       325   213   D5		CYRILLIC SMALL LETTER U
       326   214   D6		CYRILLIC SMALL LETTER ZHE
       327   215   D7		CYRILLIC SMALL LETTER VE
       330   216   D8		CYRILLIC SMALL LETTER SOFT SIGN
       331   217   D9		CYRILLIC SMALL LETTER YERU
       332   218   DA		CYRILLIC SMALL LETTER ZE
       333   219   DB		CYRILLIC SMALL LETTER SHA
       334   220   DC		CYRILLIC SMALL LETTER E
       335   221   DD		CYRILLIC SMALL LETTER SHCHA
       336   222   DE		CYRILLIC SMALL LETTER CHE
       337   223   DF		CYRILLIC SMALL LETTER HARD SIGN
       340   224   E0		CYRILLIC CAPITAL LETTER YU
       341   225   E1		CYRILLIC CAPITAL LETTER A
       342   226   E2		CYRILLIC CAPITAL LETTER BE
       343   227   E3		CYRILLIC CAPITAL LETTER TSE
       344   228   E4		CYRILLIC CAPITAL LETTER DE
       345   229   E5		CYRILLIC CAPITAL LETTER IE
       346   230   E6		CYRILLIC CAPITAL LETTER EF
       347   231   E7		CYRILLIC CAPITAL LETTER GHE
       350   232   E8		CYRILLIC CAPITAL LETTER HA
       351   233   E9		CYRILLIC CAPITAL LETTER I
       352   234   EA		CYRILLIC CAPITAL LETTER SHORT I
       353   235   EB		CYRILLIC CAPITAL LETTER KA
       354   236   EC		CYRILLIC CAPITAL LETTER EL
       355   237   ED		CYRILLIC CAPITAL LETTER EM
       356   238   EE		CYRILLIC CAPITAL LETTER EN
       357   239   EF		CYRILLIC CAPITAL LETTER O
       360   240   F0		CYRILLIC CAPITAL LETTER PE

       361   241   F1		CYRILLIC CAPITAL LETTER YA
       362   242   F2		CYRILLIC CAPITAL LETTER ER
       363   243   F3		CYRILLIC CAPITAL LETTER ES
       364   244   F4		CYRILLIC CAPITAL LETTER TE
       365   245   F5		CYRILLIC CAPITAL LETTER U
       366   246   F6		CYRILLIC CAPITAL LETTER ZHE
       367   247   F7		CYRILLIC CAPITAL LETTER VE
       370   248   F8		CYRILLIC CAPITAL LETTER SOFT SIGN
       371   249   F9		CYRILLIC CAPITAL LETTER YERU
       372   250   FA		CYRILLIC CAPITAL LETTER ZE
       373   251   FB		CYRILLIC CAPITAL LETTER SHA
       374   252   FC		CYRILLIC CAPITAL LETTER E
       375   253   FD		CYRILLIC CAPITAL LETTER SHCHA
       376   254   FE		CYRILLIC CAPITAL LETTER CHE
       377   255   FF		CYRILLIC CAPITAL LETTER HARD SIGN

NOTES

       The differences with KOI8-U are in the hex positions A4, A6, A7, AD, B4, B6, B7, and BD.

SEE ALSO

       ascii(7), charsets(7), cp1251(7), iso_8859-5(7), koi8-u(7), utf-8(7)

COLOPHON

       This  page is part of release 4.15 of the Linux man-pages project.  A description of the project, information about reporting bugs, and the
       latest version of this page, can be found at https://www.kernel.org/doc/man-pages/.

Linux								    2016-07-17								 KOI8-R(7)
All times are GMT -4. The time now is 04:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy