Sorting the csv file in Perl


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Sorting the csv file in Perl
# 1  
Old 12-27-2012
Sorting the csv file in Perl

Hi All
How all are doing today. Just struck in an issue in Perl
I have a csv file which contain 32 column, I want to make sorting in that csv file with respect to 26th column.
Is it possible to do so without any module being added?

Regards
Aditya

---------- Post updated at 10:02 AM ---------- Previous update was at 09:55 AM ----------

FYI I am usinf windows Perl
# 2  
Old 12-27-2012
You could install cygwin to get the nicer sort. A CSV file with commas in the data is particularly hard to sort, even for the unix sort. I would just read the CSV with PERL libraries and put every row into a sorted container like a tree (not a hash), so I can fetch them in order.
http://perl.plover.com/BTree/ http://search.cpan.org/~bryce/Sort-T...pm#DESCRIPTION
http://search.cpan.org/~rsavage/Tree...pm#DESCRIPTION
Many Perl containers can be sorted: http://search.cpan.org/~chthorman/Da...ble.pm#SORTING
http://search.cpan.org/~uri/Sort-Mak...pm#DESCRIPTION

Wading through all this, first you have to avoid one dimensional sorts unless you want to reorder your csv lines with the key first, or copy the key first as N bytes left justified so you can easily remove it. You do not need manually managed parent-child trees. Hash containers have their own hash based sort order, so when they say hash tree, the mean hash map, not tree map. I read an echo of my words here: http://www.perlmonks.org/index.pl?node_id=599204

Last edited by DGPickett; 12-27-2012 at 02:44 PM..
# 3  
Old 12-27-2012
Code:
use warnings;
use strict;

my (%hash, @arr);

open FILE, "< c:/path/to/file.csv";
while (<FILE>) {
    chomp;
    @arr = split /,/;
    $hash{$arr[25]} = join(',',@arr[0..24]) . '|' . join(',',@arr[26..$#arr]);
}    
close FILE;

undef @arr;
for (sort keys %hash) {
    @arr = split /\|/, $hash{$_};
    print "$arr[0],$_,$arr[1]\n";
}

# 4  
Old 12-27-2012
Quote:
Originally Posted by adisky123
I have a csv file which contain 32 column, I want to make sorting in that csv file with respect to 26th column.
Check out this info:
http://www.perlmonks.org/?node_id=512942

Last edited by spacebar; 12-27-2012 at 06:05 PM.. Reason: Inorrect link
# 5  
Old 12-27-2012
A CSV file with commas in the data is particularly hard to sort, even for the unix sort, e.g.:
Code:
1,2,3,"A CSV file with commas in the data is particularly hard to sort, even for the unix sort.",5,6\r\n

Luckily, or sadly, many data sets are embedded-comma-free, lulling the unwary into forgetfulness ! Early versions of MS Access had this problem, forcing me to use tab or pipe (|) separated text.
# 6  
Old 12-28-2012
@spacebar
while using sort command I am getting an error.
Code:
syntax error at C:\Users\aditya\Documents\Perl Prgms\compare.pl line 35,
near "3 -t "

---------- Post updated at 01:56 AM ---------- Previous update was at 01:50 AM ----------

@balajesuri
getting an error
Code:
Use of uninitialized value in join or string at C:\Users\aditya\Documents
\Perl Prgms\sort_check.pl line 10, <FILE> line 476.


Last edited by Franklin52; 12-28-2012 at 09:09 AM.. Reason: Please use code tags for data end code samples
# 7  
Old 12-28-2012
Well, the link is showing shell (executable /bin/sort), not perl sort() built-in, and seems to have lost some line breaks in the data, too.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Convert CSV file to nested XML file using UNIX/PERL?

we have a CSV which i need to convert to XML using Perl or Unix shell scripting. I was able to build this XML in oracle database. However, SQL/XML query is running for long time. Hence, I'm considering to write a Perl or shell script to generate this XML file. Basically need to build this XML... (3 Replies)
Discussion started by: laknar
3 Replies

2. Shell Programming and Scripting

Sorting a CSV file by DOB

I have absolutaly no idea how to get this script to sort the info in Birthdays.csv by date of birth. I know the sort -n command, however i wish to sort the file birthdays.csv by DOB. How would i go about doing this? The below script gets user info and date of birth and then puts these info a... (3 Replies)
Discussion started by: redshine6
3 Replies

3. Shell Programming and Scripting

CSV Sorting on only particular columns

Hello! So ive been presented with this comma-delimited file: I need a print to look as below " lastname, phone_number, zip for every person with a last name starting with the letter H, I only with a 650-area code phone number. output should be sorted by reverse ZIP code " I only have... (5 Replies)
Discussion started by: strangemachine
5 Replies

4. Shell Programming and Scripting

Sorting a .csv using awk or other

Hello all, I am new here and *relatively* new to Unix. I have a bit of an emergency. I have a three column file that I need to sort: sample name, miRNA, reads per million (RPM) There are multiple samples, and for each sample name there are multiple miRNAs and associated RPMs. Some of these... (6 Replies)
Discussion started by: dunnybocter
6 Replies

5. Shell Programming and Scripting

Need help in writing a routine for sorting a CSV file

Hi, I have a CSV file in following manner: server1,env1,patch1 server1,env1,patch2 server1,env1,patch3 server1,env2,patch1 server1,env2,patch3 server2,env3,patch1 server2,env3,patch5 server2,env4,patch1 server3,env6,patch1 server3,env7,patch2 server3,env7,patch3 I want to... (6 Replies)
Discussion started by: avikaljain
6 Replies

6. UNIX for Dummies Questions & Answers

How to extract one column from csv file in perl?

Hi everyone, i am new to perl programming, i have a problem in extracting single column from csv file. the column is the 20th column, please help me.. at present i use this code #!C:/perl/bin use warnings; use strict; my $file1 = $ARGV; open FILE1, "<$file1" or die "Can't... (13 Replies)
Discussion started by: kvth
13 Replies

7. UNIX and Linux Applications

UNIX sorting - csv file

Hi, Please help me to solve sorting in CSV file. I have 25 columns in my CSV. (Delimiter is ",") Summary columns are from 10 to 13 which are should not be sorted. From 1-9 and 14-25 should be able to sort in ascending. how should i do this using Sort command in unix. If no simple commands pls... (0 Replies)
Discussion started by: rajani_p
0 Replies

8. Shell Programming and Scripting

sorting csv file based on column selected

Hi all, in my csv file it'll look like this, and of course it may have more columns US to UK;abc-hq-jcl;multimedia UK to CN;def-ny-jkl;standard DE to DM;abc-ab-klm;critical FD to YM;la-yr-tym;standard HY to MC;la-yr-ytm;multimedia GT to KJ;def-ny-jrt;critical I would like to group... (4 Replies)
Discussion started by: tententen
4 Replies

9. Shell Programming and Scripting

Help sorting .csv file

Hi, I have a .csv file which contains script names, subjects and email_addresses The first two colums are always script name and subject, the next 20 colums are email address.. What i want to do is sort the email address in alphabetical order for each row and there's around 1200 rows. So... (3 Replies)
Discussion started by: Jazmania
3 Replies

10. Shell Programming and Scripting

CSV File parse help in Perl

Folks, I have a bit of an issue trying to obtain some data from a csv file using PERL. I can sort the file and remove any duplicates leaving only 4 or 5 rows containing data. My problem is that the data contained in the original file contains a lot more columns and when I try ro run this script... (13 Replies)
Discussion started by: lodey
13 Replies
Login or Register to Ask a Question