Visit Our UNIX and Linux User Community


Perl code to grep a particular column in CSV format


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Perl code to grep a particular column in CSV format
# 1  
Old 10-21-2012
Perl code to grep a particular column in CSV format

Hi

I want to grep a column 6 & column 7 from a CSV Format file & then i have to find the difference between these columns as these both columns contains date & time in 7/7/2012 9:20 this format . So kindly help me out ASAP.
But please kindly dis xls has to be converted in csv format as may data will be in csv format.
# 2  
Old 10-21-2012
The file you uploaded is an XLS file, not a CSV file.

Please upload a CSV file that everyone can open.
# 3  
Old 10-21-2012
Script (without Perl):-

Code:
cat new.csv | awk -F, ' { print $7 "," $8 } ' | egrep -v "unix|Event" | while IFS="," read event_date create_date
do
 dt_diff=$(( $(date -d "$create_date" +%s) - $(date -d "$event_date" +%s) ))
 echo -e "${event_date}, ${create_date}, \c"
 printf "%02d:%02d:%02d\n", $(($dt_diff/3600)) $(($dt_diff%3600/60)) $(($dt_diff%60))
done

For perl example you can refer here

Last edited by Yoda; 10-21-2012 at 02:09 PM..
# 4  
Old 10-21-2012
awk can open file/s on its own. You don't need cat there. And egrep after the awk is overkill.
# 5  
Old 10-21-2012
elixir_sinari, I really appreciate your suggestion.

Correction:-

Code:
awk -F, '!/unix/ && !/Event/  { print $7 "," $8 } ' new.csv | while IFS="," read event_date create_date


Last edited by Yoda; 10-21-2012 at 03:21 PM..
# 6  
Old 10-22-2012
perl code to grep a particular coulumn in CSV format

hey hi

I have already tried to attach this csv file but as it is mentioned in the options for attachment i am unable to upload an csv file ,as its not mentioned in the options.
It supports many other formats but does'nt allow to attach a csv file it gives an error invalid file error.

Previous Thread | Next Thread
Test Your Knowledge in Computers #686
Difficulty: Medium
In reverse Polish notation, the operators follow their operands; for instance, to add 3 and 4, one would write 3 4 + rather than 3 + 4.
True or False?

10 More Discussions You Might Find Interesting

1. Programming

Python or Shell script to Grep strings from input file and output in csv format

Hi Experts, I am writing a python script to grep string from file and display output in csv file as in attached screenshot https://drive.google.com/file/d/1gfUUdfmQma33tz65NskThYDhkZUGQO0H/view Input file(result_EPFT_config_device) Below is the python script i have prepared as of... (1 Reply)
Discussion started by: as7951
1 Replies

2. Shell Programming and Scripting

Need perl or shell script to sort vertical lines to horizontal line in csv format

Need perl or shell script to sort vertical lines to horizontal line in csv format My file like below ------------------------- ================================================================================ PATH PINKY1000#I1-1-ZENTA1000-2#I7-1-ASON-SBR-UP-943113845 ... (4 Replies)
Discussion started by: sreedhargouda.h
4 Replies

3. Shell Programming and Scripting

3 column .csv --> correlation matrix; awk, perl?

Greetings, salutations. I have a 3 column csv file with ~13 million rows and I would like to generate a correlation matrix. Interestingly, you all previously provided a solution to the inverse of this problem. Thread title: "awk? adjacency matrix to adjacency list / correlation matrix to list"... (6 Replies)
Discussion started by: R3353
6 Replies

4. Shell Programming and Scripting

Script to Grep column 3 from csv file generated yesterday

Hello, Can any one please assist how to scirpt it: Every day a new log file is create and I want to process only the one generated yesterday and get the data of column 3 and 6. For example today's date is 24 then I want to get the data of log file created on 23rd. Log Files in... (7 Replies)
Discussion started by: sureshcisco
7 Replies

5. UNIX for Dummies Questions & Answers

How to extract one column from csv file in perl?

Hi everyone, i am new to perl programming, i have a problem in extracting single column from csv file. the column is the 20th column, please help me.. at present i use this code #!C:/perl/bin use warnings; use strict; my $file1 = $ARGV; open FILE1, "<$file1" or die "Can't... (13 Replies)
Discussion started by: kvth
13 Replies

6. Shell Programming and Scripting

Format text to bold from perl script to csv

Hi everyone, is there any way in perl using which we can print the selective words in bold when we write the output to a csv file? Please find the example below 1. Filename: A 2. name age 12 3. city add 23 Line1 should only be bold. Outputs from other files being read in the... (2 Replies)
Discussion started by: ramakanth_burra
2 Replies

7. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Hi all, I have a huge csv file with the following format of data, Num SNPs, 549997 Total SNPs,555352 Num Samples, 157 SNP, SampleID, Allele1, Allele2 A001,AB1,A,A A002,AB1,A,A A003,AB1,A,A ... ... ... I would like to write out a list of unique SNP (column 1). Could you... (3 Replies)
Discussion started by: phoeberunner
3 Replies

8. UNIX for Dummies Questions & Answers

Option in sql script to include column headers when spooling file to .csv format

Can anyone help me how to include COLUMN HEADER when spooling file to .CSV format through SQL statement. Thanks, Akbar (4 Replies)
Discussion started by: s1a2m3
4 Replies

9. Shell Programming and Scripting

convert files into csv format using perl

Hi all perl gurus, I need your help to get the desired output in perl. I have a file which has text in it in the format Connection request start timestamp = 12/08/2008 00:58:36.956700 Connect request completion timestamp = 12/08/2008 00:58:36.959729 Application idle time ... (10 Replies)
Discussion started by: azs0309
10 Replies

10. Shell Programming and Scripting

AWK CSV to TXT format, TXT file not in a correct column format

HI guys, I have created a script to read 1 column in a csv file and then place it in text file. However, when i checked out the text file, it is not in a column format... Example: CSV file contains name,age aa,11 bb,22 cc,33 After using awk to get first column TXT file... (1 Reply)
Discussion started by: mdap
1 Replies

Featured Tech Videos