How to do this in perl?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to do this in perl?
# 1  
Old 03-01-2013
How to do this in perl?

I have a csv input file that looks like this

zipcode city

for example
Code:
33331  Fort Lauderdale, FL
33331  Lakes of Lauderdale
33331  Sunrise, FL

What I need is the following output

zipcode number of cities in that zipcode, list of cities in that zipcode, for example
Code:
33331 "3,Fort Lauderdale,Lakes of Lauderdale,Sunrise"

I am completely new to perl (this is my first work related assignment). We are converting this process from a IBM mainframe done in Rexx to perl on Linux as the mainframe is going away by the end of the year.

Any help would be appreciated.

Last edited by Franklin52; 03-01-2013 at 11:03 AM.. Reason: Please use code tags for data and code samples
# 2  
Old 03-01-2013
try awk:
Code:
awk '{z[$1]++; w=$1; sub(",.*",""); sub("[^ \t]*[ \t]*","") ; a[w]=a[w]","$0} END {for (i in a) print i, "\"" z[i] a[i] "\""}' infile

# 3  
Old 03-01-2013
Quote:
Originally Posted by Michael Gould
I have a csv input file that looks like this

zipcode city

for example
Code:
33331  Fort Lauderdale, FL
33331  Lakes of Lauderdale
33331  Sunrise, FL

...
The sample data seems to be incorrect for a csv file.
If "zipcode" and "city" are the two columns in the csv file, then there should be a comma between them.
Since the city name is actually a city name followed by the state code and therefore it may contain a comma, a more general format of your csv file might be like so -

Code:
33331,"Fort Lauderdale, FL"
33331,"Lakes of Lauderdale"
33331,"Sunrise, FL"
12345,"Las Vegas, NV"
67890,"Detroit, MI"
67890,Lansing

The following Perl script works on the generalized csv file shown here.

Code:
$
$ cat cities.csv
33331,"Fort Lauderdale, FL"
33331,"Lakes of Lauderdale"
33331,"Sunrise, FL"
12345,"Las Vegas, NV"
67890,"Detroit, MI"
67890,Lansing
$
$
$ perl -lne '($zip, $name) = m/^(\d+),"?(.*?)(,.*?)?"?$/;
             if ($zip == $prevzip) {
               $x[$#x]->[1] += 1;
               $x[$#x]->[2] .= ",$name"
             } else {
               $count = 1;
               push @x, [ ($zip, $count, $name) ]
             }
             $prevzip = $zip;
             END {
               foreach $i (@x) { print "$i->[0] \"$i->[1],$i->[2]\"" }
             }
            ' cities.csv
33331 "3,Fort Lauderdale,Lakes of Lauderdale,Sunrise"
12345 "1,Las Vegas"
67890 "2,Detroit,Lansing"
$
$

Do chip in if there's something amiss.
This User Gave Thanks to durden_tyler For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Programming

PERL: In a perl-scripttTrying to execute another perl-script that SETS SOME VARIABLES !

I have reviewed many examples on-line about running another process (either PERL or shell command or a program), but do not find any usefull for my needs way. (Reviewed and not useful the system(), 'back ticks', exec() and open()) I would like to run another PERL-script from first one, not... (1 Reply)
Discussion started by: alex_5161
1 Replies

2. Programming

Perl: restrict perl from automaticaly creating a hash branches on check

My issue is that the perl script (as I have done it so far) created empty branches when I try to check some branches on existence. I am using multydimentional hashes: found it as the best way for information that I need to handle. Saing multidimentional I means hash of hashes ... So, I have ... (2 Replies)
Discussion started by: alex_5161
2 Replies

3. Shell Programming and Scripting

Perl :: reading values from Data Dumper reference in Perl

Hi all, I have written a perl code and stored the data into Data structure using Data::Dumper module. But not sure how to retreive the data from the Data::Dumper. Eg. Based on the key value( Here CRYPTO-6-IKMP_MODE_FAILURE I should be able to access the internal hash elements(keys) ... (1 Reply)
Discussion started by: scriptscript
1 Replies

4. UNIX for Advanced & Expert Users

perl and HP-UX : instmodsh in combination with software depot : update inventory for installed Perl

we create a HP-UX software depot with a new perl-modul. after installation of the software depot, the perl module i can't find with instmodsh in the inventory for installed Perl modules. - i have learned of using instmodsh command : i find out what modules are already installed on my system. ... (0 Replies)
Discussion started by: bora99
0 Replies

5. Shell Programming and Scripting

HELP on Perl array / sorting - trying to convert Korn Shell Script to Perl

Hi all, Not sure if this should be in the programming forum, but I believe it will get more response under the Shell Programming and Scripting FORUM. Am trying to write a customized df script in Perl and need some help with regards to using arrays and file handlers. At the moment am... (3 Replies)
Discussion started by: newbie_01
3 Replies

6. Shell Programming and Scripting

Hidden Characters in Regular Expression Matching Perl - Perl Newbie

I am completely new to perl programming. My father is helping me learn said programming language. However, I am stuck on one of the assignments he has given me, and I can't find very much help with it via google, either because I have a tiny attention span, or because I can be very very dense. ... (4 Replies)
Discussion started by: kittyluva2
4 Replies

7. Shell Programming and Scripting

Perl :How to print the o/p of a Perl script on console and redirecting same in log file @ same time.

How can i print the output of a perl script on a unix console and redirect the same in a log file under same directory simultaneously ? Like in Shell script, we use tee, is there anything in Perl or any other option ? (2 Replies)
Discussion started by: butterfly20
2 Replies

8. Shell Programming and Scripting

perl/unix: script in command line works but not in perl

so in unix this command works works and shows me a list of directories find . -name \*.xls -exec dirname {} \; | sort -u | > list.txt but when i try running a perl script to run this command my $query = 'find . -name \*.xls -exec dirname {} \; | sort -u | > list.txt';... (2 Replies)
Discussion started by: kpddong
2 Replies

9. Shell Programming and Scripting

Passing date formats in Perl: i.e. Jul/10/2007 -> 20070710 (yyyymmdd) - Perl

Hi , This script working for fine if pass script-name.sh Jul/10/2007 ,I want to pass 20070710(yyyymmdd) .Please any help it should be appereciated. use Time::Local; my $d = $ARGV; my $t = $ARGV; my $m = ""; @d = split /\//, $d; @t = split /:/, $t; if ( $d eq "Jan" ) { $m = 0 }... (7 Replies)
Discussion started by: akil
7 Replies

10. Shell Programming and Scripting

[Perl] Accessing array elements within a sed command in Perl script

I am trying to use a script to replace the header of each file, whose filename are stored within the array $test, using the sed command within a Perl script as follows: $count = 0; while ( $count < $#test ) { `sed -e 's/BIOGRF 321/BIOGRF 332/g' ${test} > 0`; `cat 0 >... (2 Replies)
Discussion started by: userix
2 Replies
Login or Register to Ask a Question