Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Compare within same group
Top Forums UNIX for Dummies Questions & Answers Compare within same group Post 302921176 by Aia on Wednesday 15th of October 2014 01:27:28 PM
Old 10-15-2014
Sorting is expensive.
The issue here is that a state must be kept until all the data is read and that is a lot of memory.
Sorting might help reducing the memory if in the loop, the lines for the same group can be processed, printed and the hash reset. But we might be just trading some burden for another.

Here's a version that reduces the memory footprint, by eliminating the second hash, eliminates the regex search and does not automatically reassign the value if different at each iteration.

Hopefully, that would help

Code:
#!/usr/bin/perl

use strict;
use warnings;

my %records;

while(<>) {
    chomp;
    
    my ($id, $group, $value) = split;
    
    if ( not exists $records{$group} ) {
        $records{$group} = [$id, $group, $value];
        next;
    }
    next if $records{$group}->[2] eq "missing";
    if ($records{$group}->[2] ne $value) {
        $records{$group}->[2] = "missing"} 
}

$,="\t";
for my $group (keys %records) {
    print "@{$records{$group}}\n"; 
}

Last edited by Aia; 10-15-2014 at 07:47 PM.. Reason: grammar
This User Gave Thanks to Aia For This Post:
senhia83
 

9 More Discussions You Might Find Interesting

1. Solaris

entry in /etc/group too long - problem using sudo with %group

hi folks, I've been googling for quite some time, but still can't find anything near it...my problem is the following: for useradministration in our company we are using ssh/sudo, now whenever I try to add users (we have quite a number of users) with useradd -G groupname for secondary group I... (4 Replies)
Discussion started by: poli
4 Replies

2. UNIX for Advanced & Expert Users

retrieving all group names with a given group number

hi, which Unix/C function can i use to retrieve all group names with a particular group id? The following C code prints out the group id number of a particular group name: ------------------------------------------------------------------------ #include <stdio.h> #include <grp.h> int... (3 Replies)
Discussion started by: Andrewkl
3 Replies

3. Shell Programming and Scripting

KSH to group records in a file and compare it with another file

Hi, I've a file like below: DeptFile.csv DeptID EmpID ------- ------ Dep01 Emp01 Dep01 Emp02 Dep01 Emp03 Dep02 Emp04 Dep02 Emp05 I've another file which has EmpFile.csv EmpID Salary ------ ------ (3 Replies)
Discussion started by: Matrix2682
3 Replies

4. Shell Programming and Scripting

Merge group numbers and add a column containing group names

I have a file in the following format. Groups of data merge together and the group number is indicated above each group. 1 adrf dfgr dfg 2 dfgr dfgr 3 dfef dfr fd 4 fgrt fgr fgg 5 fgrt fgr (3 Replies)
Discussion started by: Lucky Ali
3 Replies

5. Shell Programming and Scripting

Merge group numbers and add a column containing group names

Hi All I do have a file like this with 6 columns. Groups of data merge together and the group number is indicated above each group. 1 1 12 26 289 3.2e-027 GCGTATGGCGGC 2 12 26 215 6.7e+006 TTCCACCTTTTG 3 9 26 175 ... (1 Reply)
Discussion started by: Lucky Ali
1 Replies

6. Shell Programming and Scripting

Sort the file contents in each group....print the group title as well

I've this file and need to sort the data in each group File would look like this ... cat file1.txt Reason : ABC 12345-0023 32123-5400 32442-5333 Reason : DEF 42523-3453 23345-3311 Reason : HIJ 454553-0001 I would like to sort each group on the last 4 fileds and print them... (11 Replies)
Discussion started by: prash184u
11 Replies

7. AIX

Adding a Volume Group to an HACMP Resource Group?

Hi, I have a 2 node Cluster. Which is working in active/passive mode (i.e Node#1 is running and when it goes down the Node#2 takes over) Now there's this requirement that we need a mount point say /test that should be available in active node #1 and when node #1 goes down and node#2 takes... (6 Replies)
Discussion started by: aixromeo
6 Replies

8. Shell Programming and Scripting

need a one liner to grep a group info from /etc/group and use that result to search passwd file

/etc/group tiadm::345:mk789,po312,jo343,ju454,ko453,yx879,iy345,hn453 bin::2:root,daemon sys::3:root,bin,adm adm::4:root,daemon uucp::5:root /etc/passwd mk789:x:234:1::/export/home/dummy:/bin/sh po312:x:234:1::/export/home/dummy:/bin/sh ju454:x:234:1::/export/home/dummy:/bin/sh... (6 Replies)
Discussion started by: chidori
6 Replies

9. Programming

Sql ORA-00937: not a single-group group function

I'm trying to return only one row with the highest value for PCT_MAX_USED. Any suggestions? When I add this code, I get the ORA-00937 error. trunc(max(decode( kbytes_max, 0, 0, (kbytes_alloc/kbytes_max)*100))) pct_max_used This is the original and returns all rows. select (select... (3 Replies)
Discussion started by: progkcp
3 Replies

LEARN ABOUT NETBSD

group

GROUP(8)						    BSD System Manager's Manual 						  GROUP(8)

NAME

     group -- manage group information on the system

SYNOPSIS

     group add [options] group
     group del [options] group
     group info [options] group
     group mod [options] group

DESCRIPTION

     The group utility acts as a frontend to the groupadd(8), groupmod(8), groupinfo(8), and groupdel(8) commands.  The utilities by default are
     built with EXTENSIONS.  This allows for further functionality.

     For a full explanation of the options available, please see the relevant manual page.

EXIT STATUS

     The group utility exits 0 on success, and >0 if an error occurs.

SEE ALSO

     group(5), groupadd(8), groupdel(8), groupinfo(8), groupmod(8)

HISTORY

     The group utility first appeared in NetBSD 1.5.  It is based on the addnerd package by the same author.

AUTHORS

     The group utility was written by Alistair G. Crooks <agc@NetBSD.org>.

BSD
								 November 7, 2005							       BSD
All times are GMT -4. The time now is 11:07 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy