Full Discussion: awk and perl grouping.
Top Forums Shell Programming and Scripting awk and perl grouping. Post 302672489 by alister on Monday 16th of July 2012 12:04:17 PM
Old 07-16-2012
You could try using the a2p (awk to perl) tool. Its output may help you in your learning with this and other problems.

If I'm not mistaken, there's also a sed to perl translator, s2p.


10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grouping using sed/awk ?

I run awk cat $1|awk '{print $6}' and get a lot of results and I want results to group them. For example my result is (o/p is unknown to user) xyz xyz abc pqr xyz pqr etc I wanna group them as xyz=total found 7 abc=total .... pqr= Thank (3 Replies)
Discussion started by: pujansrt
3 Replies

2. Shell Programming and Scripting

awk grouping by name script

Hello I am trying to figure out a script which could group a log file by user names. I worked with awk command and I could trim the log file to: <USER: John Frisbie > /* Thu Aug 06 2009 15:11:45.7974 */ FLOAT GRANT WRITE John Frisbie (500 of 3005 write) <USER: Shawn Sanders > /* Thu Aug 06... (2 Replies)
Discussion started by: Avto
2 Replies

3. Shell Programming and Scripting

PERL : SQL array bind issue while grouping

Hi, I have an array of strings. Each string has 4 comma separated values. I am binding this array to a SQL where I am required to do an INSERT after grouping. The binding is done as : $insertADWSth->bind_param_array(1,A_CONSTANT_STRING);... (1 Reply)
Discussion started by: sinpeak
1 Replies

4. Shell Programming and Scripting

AWK script to create max value of 3rd column, grouping by first column

Hi, I need an awk script (or whatever shell-construct) that would take data like below and get the max value of 3 column, when grouping by the 1st column. clientname,day-of-month,max-users ----------------------------------- client1,20120610,5 client2,20120610,2 client3,20120610,7... (3 Replies)
Discussion started by: ckmehta
3 Replies

5. Shell Programming and Scripting

grouping using sed or awk

I have below inside a file. user1 user2 I need this manipulated as alias server1.domain.com='ssh user1@' alias server2.domain.com='ssh user2@' (3 Replies)
Discussion started by: anil510
3 Replies

6. Shell Programming and Scripting


Hi all, I am using following command: perl program.pl input.txt output.txt CUTOFF 3 > groups_3.txt containing program.pl, two files (input.txt, output.txt) and getting output in groups_3.txt: But, I wish to have 30 files corresponding to each CUTOFF ranging from 0 to 30 using the same... (1 Reply)
Discussion started by: bioinfo
1 Replies

7. UNIX for Dummies Questions & Answers

awk Grouping and Subgrouping with Counts

So I have a ton of files, lines in excess of 3 MIL per file. I need to find a solution to find the top 3 products, and then get the top 5 skews with a count of how many times that skew was viewed. This is a sample file, shortened it for readability. Each ROW is counted as view. Here's the... (10 Replies)
Discussion started by: JoshCrosby
10 Replies

8. Shell Programming and Scripting

UNIX grouping

Hi guys, I am a complete newbie to unix and have been tasked with creating a script to group the following data (file) by hourly slots so that I can count the transactions completed within the peak hour. I am not sure how to group data like this in unix. Can anyone please help? Here is an... (1 Reply)
Discussion started by: MrMidas
1 Replies

9. Shell Programming and Scripting

Name grouping

awk 'FNR==NR {a; next} $NF in a' genes.txt refseq_exons.txt > output.txt I can not figure out how to group the same name in $4 together. Basically, all the SKI together in separate rows and all the TGFB2. Thank you :). chr1 2160133 2161174 SKI chr1 218518675 218520389 TGFB2... (1 Reply)
Discussion started by: cmccabe
1 Replies

10. Shell Programming and Scripting

Grouping and Subgrouping using awk

I have a data which looks like 1440993600|L|ABCDEF 1440993600|L|ABCD 1440993601|L|ABCDEF 1440993602|L|ABC 1440993603|L|ABCDE . . . 1441015200|L|AB 1441015200|L|ABC 1441015200|L|ABCDEF So basically, the $1 is epoch date, $2 and $3 is some application data From one if the... (5 Replies)
Discussion started by: hemanty4u
5 Replies
PERLUTIL(1)						 Perl Programmers Reference Guide					       PERLUTIL(1)

perlutil - utilities packaged with the Perl distribution DESCRIPTION
Along with the Perl interpreter itself, the Perl distribution installs a range of utilities on your system. There are also several utilities which are used by the Perl distribution itself as part of the install process. This document exists to list all of these utilities, explain what they are for and provide pointers to each module's documentation, if appropriate. LIST OF UTILITIES
Documentation perldoc The main interface to Perl's documentation is "perldoc", although if you're reading this, it's more than likely that you've already found it. perldoc will extract and format the documentation from any file in the current directory, any Perl module installed on the system, or any of the standard documentation pages, such as this one. Use "perldoc <name>" to get information on any of the utilities described in this document. pod2man and pod2text If it's run from a terminal, perldoc will usually call pod2man to translate POD (Plain Old Documentation - see perlpod for an explanation) into a manpage, and then run man to display it; if man isn't available, pod2text will be used instead and the output piped through your favourite pager. pod2html and pod2latex As well as these two, there are two other converters: pod2html will produce HTML pages from POD, and pod2latex, which produces LaTeX files. pod2usage If you just want to know how to use the utilities described here, pod2usage will just extract the "USAGE" section; some of the utilities will automatically call pod2usage on themselves when you call them with "-help". podselect pod2usage is a special case of podselect, a utility to extract named sections from documents written in POD. For instance, while utilities have "USAGE" sections, Perl modules usually have "SYNOPSIS" sections: "podselect -s "SYNOPSIS" ..." will extract this section for a given file. podchecker If you're writing your own documentation in POD, the podchecker utility will look for errors in your markup. splain splain is an interface to perldiag - paste in your error message to it, and it'll explain it for you. roffitall The "roffitall" utility is not installed on your system but lives in the pod/ directory of your Perl source kit; it converts all the documentation from the distribution to *roff format, and produces a typeset PostScript or text file of the whole lot. Converters To help you convert legacy programs to Perl, we've included three conversion filters: a2p a2p converts awk scripts to Perl programs; for example, "a2p -F:" on the simple awk script "{print $2}" will produce a Perl program based around this code: while (<>) { ($Fld1,$Fld2) = split(/[: ]/, $_, -1); print $Fld2; } s2p and psed Similarly, s2p converts sed scripts to Perl programs. s2p run on "s/foo/bar" will produce a Perl program based around this: while (<>) { chomp; s/foo/bar/g; print if $printit; } When invoked as psed, it behaves as a sed implementation, written in Perl. find2perl Finally, find2perl translates "find" commands to Perl equivalents which use the File::Find module. As an example, "find2perl . -user root -perm 4000 -print" produces the following callback subroutine for "File::Find": sub wanted { my ($dev,$ino,$mode,$nlink,$uid,$gid); (($dev,$ino,$mode,$nlink,$uid,$gid) = lstat($_)) && $uid == $uid{'root'}) && (($mode & 0777) == 04000); print("$name "); } As well as these filters for converting other languages, the pl2pm utility will help you convert old-style Perl 4 libraries to new-style Perl5 modules. Administration config_data Query or change configuration of Perl modules that use Module::Build-based configuration files for features and config data. libnetcfg To display and change the libnet configuration run the libnetcfg command. perlivp The perlivp program is set up at Perl source code build time to test the Perl version it was built under. It can be used after running "make install" (or your platform's equivalent procedure) to verify that perl and its libraries have been installed correctly. Development There are a set of utilities which help you in developing Perl programs, and in particular, extending Perl with C. perlbug perlbug is the recommended way to report bugs in the perl interpreter itself or any of the standard library modules back to the developers; please read through the documentation for perlbug thoroughly before using it to submit a bug report. perlthanks This program provides an easy way to send a thank-you message back to the authors and maintainers of perl. It's just perlbug installed under another name. h2ph Back before Perl had the XS system for connecting with C libraries, programmers used to get library constants by reading through the C header files. You may still see "require 'syscall.ph'" or similar around - the .ph file should be created by running h2ph on the corresponding .h file. See the h2ph documentation for more on how to convert a whole bunch of header files at once. c2ph and pstruct c2ph and pstruct, which are actually the same program but behave differently depending on how they are called, provide another way of getting at C with Perl - they'll convert C structures and union declarations to Perl code. This is deprecated in favour of h2xs these days. h2xs h2xs converts C header files into XS modules, and will try and write as much glue between C libraries and Perl modules as it can. It's also very useful for creating skeletons of pure Perl modules. enc2xs enc2xs builds a Perl extension for use by Encode from either Unicode Character Mapping files (.ucm) or Tcl Encoding Files (.enc). Besides being used internally during the build process of the Encode module, you can use enc2xs to add your own encoding to perl. No knowledge of XS is necessary. xsubpp xsubpp is a compiler to convert Perl XS code into C code. It is typically run by the makefiles created by ExtUtils::MakeMaker. xsubpp will compile XS code into C code by embedding the constructs necessary to let C functions manipulate Perl values and creates the glue necessary to let Perl access those functions. dprofpp Perl comes with a profiler, the Devel::DProf module. The dprofpp utility analyzes the output of this profiler and tells you which subroutines are taking up the most run time. See Devel::DProf for more information. prove prove is a command-line interface to the test-running functionality of Test::Harness. It's an alternative to "make test". corelist A command-line front-end to "Module::CoreList", to query what modules were shipped with given versions of perl. General tools A few general-purpose tools are shipped with perl, mostly because they came along modules included in the perl distribution. piconv piconv is a Perl version of iconv, a character encoding converter widely available for various Unixen today. This script was primarily a technology demonstrator for Perl 5.8.0, but you can use piconv in the place of iconv for virtually any case. ptar ptar is a tar-like program, written in pure Perl. ptardiff ptardiff is a small utility that produces a diff between an extracted archive and an unextracted one. (Note that this utility requires the "Text::Diff" module to function properly; this module isn't distributed with perl, but is available from the CPAN.) ptargrep ptargrep is a utility to apply pattern matching to the contents of files in a tar archive. shasum This utility, that comes with the "Digest::SHA" module, is used to print or verify SHA checksums. Installation These utilities help manage extra Perl modules that don't come with the perl distribution. cpan cpan is a command-line interface to CPAN.pm. It allows you to install modules or distributions from CPAN, or just get information about them, and a lot more. It is similar to the command line mode of the CPAN module, perl -MCPAN -e shell cpanp cpanp is, like cpan, a command-line interface to the CPAN, using the "CPANPLUS" module as a back-end. It can be used interactively or imperatively. cpan2dist cpan2dist is a tool to create distributions (or packages) from CPAN modules, then suitable for your package manager of choice. Support for specific formats are available from CPAN as "CPANPLUS::Dist::*" modules. instmodsh A little interface to ExtUtils::Installed to examine installed modules, validate your packlists and even create a tarball from an installed module. SEE ALSO
perldoc, pod2man, perlpod, pod2html, pod2usage, podselect, podchecker, splain, perldiag, roffitall, a2p, s2p, find2perl, File::Find, pl2pm, perlbug, h2ph, c2ph, h2xs, dprofpp, Devel::DProf, enc2xs, xsubpp, cpan, cpanp, cpan2dist, instmodsh, piconv, prove, corelist, ptar, ptardiff, shasum perl v5.14.2 2011-09-26 PERLUTIL(1)

Featured Tech Videos

All times are GMT -4. The time now is 05:02 AM.
Unix & Linux Forums Content Copyright 1993-2021. All Rights Reserved.
Privacy Policy