Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How do I extract specific column in multiple csv files?
Top Forums UNIX for Beginners Questions & Answers How do I extract specific column in multiple csv files? Post 303035874 by RudiC on Thursday 6th of June 2019 05:23:17 AM
Old 06-06-2019
Try
Code:
awk -F, '
NR == 1         {for (i=1; i<=NF; i++) if ($i == SRCH) COL=i
                 HD = $1
                }
FNR == 1        {FCNT++
                 HD = HD OFS SRCH
                 next
                }
! EX[$1]++      {NM[++ROWCNT] = $1
                }
                {T[$1,FCNT] = $COL
                }
END             {print HD
                 for (i=1; i<=ROWCNT; i++)      {TMP = NM[i]
                                                 printf "%s", TMP
                                                 for (j=1; j<=FCNT; j++) printf ",%s", T[TMP,j]?T[TMP,j]:"NA" 
                                                 printf RS
                                                }
                }
' SRCH="Curr ART" OFS=, file[1-3]
Name,Curr ART,Curr ART,Curr ART
GETHome,47,33,40
GETregistry,13,22,NA
GEThomeLayout,17,NA,251
GETPublish,NA,110,144

This User Gave Thanks to RudiC For This Post:
Raghuram717
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

extract csv based on column value

Hi I have a csv file which is below A,5 B,6 C,10 D,7 I want the values who's second column is greater than 7 say C,10 D,7 Help me please... Thanks, Maruth (3 Replies)
Discussion started by: maruthavanan
3 Replies

2. UNIX for Dummies Questions & Answers

How to extract one column from csv file in perl?

Hi everyone, i am new to perl programming, i have a problem in extracting single column from csv file. the column is the 20th column, please help me.. at present i use this code #!C:/perl/bin use warnings; use strict; my $file1 = $ARGV; open FILE1, "<$file1" or die "Can't... (13 Replies)
Discussion started by: kvth
13 Replies

3. Shell Programming and Scripting

Combine Multiple text or csv files column-wise

Hi All I am trying to combine columns from multiple text files into a single file using paste command but the record length being unequal in the different files the data is running over to the closest empty cell on the left. Please see below. What can i do to resolve this ? File 1 File... (15 Replies)
Discussion started by: venky_ibm
15 Replies

4. Shell Programming and Scripting

averaging specific column of multiple files

Hi all, I'm needing help again on scripting. I have weekly files with 3 columns, and I need to do monthly averaging on the values on column 3, the file naming convention is as follows: 20000105.u- 2000:year 01:month 05:day 20000112.u 20000119.u 20000126.u 20000202.u 20020209.u I need to... (15 Replies)
Discussion started by: ida1215
15 Replies

5. Shell Programming and Scripting

Converting Single Column into Multiple rows, but with strings to specific tab column

Dear fellows, I need your help. I'm trying to write a script to convert a single column into multiple rows. But it need to recognize the beginning of the string and set it to its specific Column number. Each Line (loop) begins with digit (RANGE). At this moment it's kind of working, but it... (6 Replies)
Discussion started by: AK47
6 Replies

6. Shell Programming and Scripting

Insterting column in csv from multiple files

Hello, I have a spec file that contains a lot of strings that looks like this: PC DELL OptiPlex 3010MT i3 3220/2GB/500GB/DVD-RW/FREE DOS / 5Y NBD Intel i3 3220 (Dual Core, 3.30GHz, 3MB, w/ HD2500 Graphics), 2GB (1x2GB) DDR3 PC3-1600MHz, 500GB HDD SATA III 7200rpm, DVD+/-RW (16x),... (9 Replies)
Discussion started by: g9100
9 Replies

7. Shell Programming and Scripting

How to print multiple specific column after a specific word?

Hello.... Pls help me (and sorry my english) :) So I have a file (test.txt) with 1 long line.... for example: isgc jsfh udgf osff 8462 error iwzr 653 idchisfb isfbisfb sihfjfeb isfhsi gcz eifh How to print after the "error" word the 2nd 4th 5th and 7th word?? output well be: 653 isfbisfb... (2 Replies)
Discussion started by: marvinandco
2 Replies

8. Shell Programming and Scripting

Sum values of specific column in multiple files, considering ranges defined in another file

I have a file (let say file B) like this: File B: A1 3 5 A1 7 9 A2 2 5 A3 1 3 The first column defines a filename and the other two define a range in that specific file. In the same directory, I have also three more files (File A1, A2 and A3). Here is 10 sample lines... (3 Replies)
Discussion started by: Bastami
3 Replies

9. Shell Programming and Scripting

Extracting data from specific rows and columns from multiple csv files

I have a series of csv files in the following format eg file1 Experiment Name,XYZ_07/28/15, Specimen Name,Specimen_001, Tube Name, Control, Record Date,7/28/2015 14:50, $OP,XYZYZ, GUID,abc, Population,#Events,%Parent All Events,10500, P1,10071,95.9 Early Apoptosis,1113,11.1 Late... (6 Replies)
Discussion started by: pawannoel
6 Replies

10. Shell Programming and Scripting

Row bind multiple csv files having different column headers

All, I guess by this time someone asked this kind of question, but sorry I am unable to find after a deep search. Here is my request I have many files out of which 2 sample files provided below. File-1 (with A,B as column headers) A,B 1,2 File-2 (with C, D as column headers) C,D 4,5 I... (7 Replies)
Discussion started by: ks_reddy
7 Replies

LEARN ABOUT DEBIAN

bb-csvinfo.cgi

BB-CSVINFO.CGI(1)					      General Commands Manual						 BB-CSVINFO.CGI(1)

NAME

       bb-csvinfo.cgi - CGI program to show host information from a CSV file

SYNOPSIS

       bb-csvinfo.cgi

DESCRIPTION

       bb-csvinfo.cgi  is  invoked  as	a CGI script via the bb-csvinfo.sh CGI wrapper.  Based on the parameters it receives, it searches a comma-
       separated file for the matching host, and presents the information found as a table.

       bb-csvinfo.cgi is passed a QUERY_STRING environment variable with the following parameters:

	  key (string to search for, typically hostname)
	  column (columnnumber to search - default 0)
	  db  (name of the CSV database file in $BBHOME/etc/, default hostinfo.csv)
	  delimiter (delimiter character for columns, default semi-colon)

       CSV files are easily created from e.g. spreadsheets, by exporting them in CSV format. You should have one host per  line,  with	the  first
       line  containing  the  column headings. Despite their name, the default delimiter for CSV files is the semi-colon - if you need a different
       delimiter, invoke bb-csvinfo.cgi with the "delimiter=<character>" in the query string.

Example usage
       This example shows how you can use the bb-csvinfo CGI. It assumes you have a CSV-formatted file with information about the hosts stored	as
       $BBHOME/etc/hostinfo.csv, and the hostname is in the first column of the file.

       Use with the bbgen --docurl
	      The  --docurl  option to bbgen(1) sets up all of the hostnames on your Xymon webpages to act as links to a CGI script. To invoke the
	      bb-csvinfo CGI script, run bbgen with the option

		 --docurl=/cgi-bin/bb-csvinfo.sh?db=hostinfo.csv&key=%s

SEE ALSO

       bb-hosts(5), hobbitserver.cfg(5), bbgen(1)

Xymon							    Version 4.2.3:  4 Feb 2009						 BB-CSVINFO.CGI(1)
All times are GMT -4. The time now is 07:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy