comparing Huge Files - Performance is very bad Post: 302092526

9 More Discussions You Might Find Interesting

1. AIX

Bad performance when log in with putty

Hello guys! I'm n00b in AIX and I'm sticked in a problem. (my English is poor enough, but I hope you can understand me :P). So.. I'm trying to connect to an AIX machine with putty, and .. 'using username xxx' appears after 2 sec (OK), but 'xxx@ip's password' appears after 1:15 min. After...

2. Shell Programming and Scripting

Comparing two huge files

Hi, I have two files file A and File B. File A is a error file and File B is source file. In the error file. First line is the actual error and second line gives the information about the record (client ID) that throws error. I need to compare the first field (which doesnt start with '//') of...

3. HP-UX

Bad performance but Low CPU loading?

There might be some problem with my server, because every morning at 7, it's performance become bad with no DB extra deadlock. But I just couldn't figure it out. Please give me some advise, thanks a lot... According to the CPU performace chart, Daily CPU loading Maximum: 42 %, Average:36%. ...

4. Shell Programming and Scripting

Comparing two huge files on field basis.

Hi all, I have two large files and i want a field by field comparison for each record in it. All fields are tab seperated. file1: Email SELVAKUMAR RAMACHANDRAN Email SHILPA SAHU Web NIYATI SONI Web NIYATI SONI Email VIINII DOSHI Web RAJNISH KUMAR Web ...

5. Shell Programming and Scripting

Comparing 2 huge text files

I have this 2 files: k5login sanwar@systems.nyfix.com jjamnik@systems.nyfix.com nisha@SYSTEMS.NYFIX.COM rdpena@SYSTEMS.NYFIX.COM service/backups-ora@SYSTEMS.NYFIX.COM ivanr@SYSTEMS.NYFIX.COM nasapova@SYSTEMS.NYFIX.COM tpulay@SYSTEMS.NYFIX.COM rsueno@SYSTEMS.NYFIX.COM...

6. Solaris

Performance (iops) becomes bad, what is the reason?

I have written a virtual HBA driver named "xmp_vhba". A scsi disk is attached on it. as shown below: xmp_vhba, instance #0 disk, instance #11 But the performance became very bad when we read/write the scsi disk using the vdbench(a read/write io tool). What is the reason? ...

7. HP-UX

Performance issue with 'grep' command for huge file size

I have 2 files; one file (say, details.txt) contains the details of employees and another file (say, emp.txt) has some selected employee names. I am extracting employee details from details.txt by using emp.txt and the corresponding code is: while read line do emp_name=`echo $line` grep -e...

8. Shell Programming and Scripting

Perl: Need help comparing huge files

What do i need to do have the below perl program load 205 million record files into the hash. It currently works on smaller files, but not working on huge files. Any idea what i need to do to modify to make it work with huge files: #!/usr/bin/perl $ot1=$ARGV; $ot2=$ARGV; open(mfileot1,...

9. UNIX for Advanced & Expert Users

Performance problem with removing duplicates in a huge file (50+ GB)

I'm trying to remove duplicate data from an input file with unsorted data which is of size >50GB and write the unique records to a new file. I'm trying and already tried out a variety of options posted in similar threads/forums. But no luck so far.. Any suggestions please ? Thanks !!

LEARN ABOUT DEBIAN

debian::copyright::stanza::files

Debian::Copyright::Stanza::Files(3pm)			User Contributed Perl Documentation		     Debian::Copyright::Stanza::Files(3pm)

NAME

       Debian::Copyright::Stanza::Files - Files stanza of Debian copyright file

VERSION

       This document describes Debian::Copyright::Stanza::Files version 0.1 .

SYNOPSIS

	   my $copy = Debian::Copyright::Stanza::Files->new(\%data);
	   print $copy; 			# auto-stringification

DESCRIPTION

       Debian::Copyright::Stanza::Files can be used for representation and manipulation of a "Files:" stanza of Debian copyright files in an
       object-oriented way. Converts itself to a textual representation in string context.

FIELDS

       The supported fields for Files stanzas are listed below.

       Note that real copyright fields may contain dashes in their names. These are replaced with underscores.

       Files
       License
       Copyright
       X_Comment

CONSTRUCTOR

   new( { field => value, ... } )
       Creates a new Debian::Copyright::Stanza::Files object and optionally initialises it with the supplied data.

METHODS

   is_or_separated($field)
       Returns true for the "License" field.

SEE ALSO

       Debian::Copyright::Stanza::Files inherits most of its functionality from Debian::Copyright::Stanza

COPYRIGHT &; LICENSE
       Copyright (C) 2011 Nicholas Bamber nicholas@periapt.co.uk

       This module is substantially based upon Debian::Control::Stanza::Source.  Copyright (C) 2009 Damyan Ivanov dmn@debian.org

       This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License version 2 as
       published by the Free Software Foundation.

       This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
       MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

perl v5.12.4							    2011-08-27				     Debian::Copyright::Stanza::Files(3pm)