04-18-2005
the Pollock method
The following will give you a flat file list of files over two gig; maybe you can incorporate them into a find script or something.
ls -As1 anydir > dir.lst
sed '/total/d' dir.lst > dirmod.lst
awk -F " " '$1 >= 4194304 {print $2}' dirmod.lst > monstoruslyhugefatfiles.lst
hope it at least gives you something to chew on.
10 More Discussions You Might Find Interesting
1. HP-UX
Hi All,
Can anyone please clarify me the following questions:
1. Is there any file size limitation in HP-UX 11i, that I can able to create upto certain size of file (say 2 GB) and not more then that????
2. At max. how many files we can able to keep inside a folder????
3. How many... (2 Replies)
Discussion started by: sundeep_mohanty
2 Replies
2. Shell Programming and Scripting
Hi,
Iam using an alias to get the file count from one directory using normal ls command like ls file*|wc -l.If my file increases more than 35,000 ,my alias is not working.It shows that arg list too long.
is that can be limitation of ls or problem in alias?
I would appreciate if anyone can... (2 Replies)
Discussion started by: cskumar
2 Replies
3. Shell Programming and Scripting
Hi,
I'm having a problem with a while loop syntax that doesn't seem to loop correctly.
TODAY=`date +%d%m%Y`
while read hostname
#for hostname in $(cat $CONFIG)
do
OUTFILE=/tmp/health_check.$hostname.$TODAY
if
then
touch $OUTFILE
func_header
else
rm $OUTFILE
... (2 Replies)
Discussion started by: gilberteu
2 Replies
4. Shell Programming and Scripting
Hi All,
I have an awk code below.
I have an input file which has a line which has a last field with about 4000 characters and it pop up an error stated below. It is too much for awk to take ?
Awk Code:
{if( $NF == "2007" && $1 == "**" ) LINE = $0;}
END{printf("%20s\n",LINE); }
Error:... (28 Replies)
Discussion started by: Raynon
28 Replies
5. UNIX for Dummies Questions & Answers
Hello,
I am looking for a way to get around an issue, as I am using the grep command in a very common situation:
grep ^50 File.*.txt | "some awk process"
My problem is that bash throws me an error on the grep command if the directory in question contains several thousands files.
... (6 Replies)
Discussion started by: Indalecio
6 Replies
6. UNIX for Advanced & Expert Users
Hi All,
I ran code in test environment to find the files more than 1TB given below is a snippet from code:
FILE_SYSTEM=/home/arun
MAX_FILE_LIMIT=1099511627776
find $FILE_SYSTEM -type f -size +"$MAX_FILE_LIMIT"c -ls -xdev 2>/dev/null |
while read fname
do
echo "File larger than... (3 Replies)
Discussion started by: Arunprasad
3 Replies
7. HP-UX
Is there a size limit when passing an argument using wildcards? I.E. when I pass an argument in the form (like) "ftp_auto *.txt" - is there a limitation on the size of UNIX expanding "*.txt" ? (1 Reply)
Discussion started by: vslewis
1 Replies
8. Shell Programming and Scripting
Hi all,
does any one know ,if there is any limitation on rm command
limitation referes here as a size .
Ex:when my script try to rum rm command which have size of nearly 20-22 GB ..CPU load gets high ?
if anyone know the relation of CPU load and limitation of rm command . (8 Replies)
Discussion started by: niteshagrawal06
8 Replies
9. UNIX for Dummies Questions & Answers
whats wrong with this addition?
Whats the maximum number of digits can be handled?
pandeeswaran@ubuntu:~/Downloads$ const=201234454654768979799999
pandeeswaran@ubuntu:~/Downloads$ let new+=const
pandeeswaran@ubuntu:~/Downloads$ echo $new
-2152890657037557890
pandeeswaran@ubuntu:~/Downloads$ (4 Replies)
Discussion started by: pandeesh
4 Replies
10. AIX
Hi All,
i got few questions...
1) What is the maximum number of files that we can save under a single directory in AIX ? (* we have enough storage/disk space)
2) And what is the maximum number of sub - directories in side a directory?
I know that...every directory is a (special)... (11 Replies)
Discussion started by: System Admin 77
11 Replies
LEARN ABOUT DEBIAN
chi::driver::rawmemory
CHI::Driver::RawMemory(3pm) User Contributed Perl Documentation CHI::Driver::RawMemory(3pm)
NAME
CHI::Driver::RawMemory - In-process memory cache that stores direct references
VERSION
version 0.54
SYNOPSIS
use CHI;
my $hash = {};
my $cache = CHI->new( driver => 'RawMemory', datastore => $hash );
my $cache = CHI->new( driver => 'RawMemory', global => 1 );
DESCRIPTION
This is a subclass of CHI::Driver::Memory that stores references to data structures directly instead of serializing / deserializing. This
makes the cache faster at getting and setting complex data structures, but unlike most drivers, modifications to the original data
structure will affect the data structure stored in the cache, and vica versa. e.g.
my $cache = CHI->new( driver => 'Memory', global => 1 );
my $lst = ['foo'];
$cache->set('key' => $lst); # serializes $lst before storing
$cache->get('key'); # returns ['foo']
$lst->[0] = 'bar';
$cache->get('key'); # returns ['foo']
my $cache = CHI->new( driver => 'RawMemory', global => 1 );
my $lst = ['foo'];
$cache->set('key' => $lst); # stores $lst directly
$cache->get('key'); # returns ['foo']
$lst->[0] = 'bar';
$cache->get('key'); # returns ['bar']!
CONSTRUCTOR OPTIONS
Same as CHI::Driver::Memory.
SIZE AWARENESS
For the purpose of size-awareness, all items count as size 1 for this driver. (Because data structures are not serialized, there's no good
way to determine their size.)
# Keep a maximum of 10 items in cache
#
my $cache = CHI->new( driver => 'RawMemory', datastore => {}, max_size => 10 );
ACKNOWLEDGEMENTS
Thanks to Yuval Kogman whose Cache::Ref inspired me to do this.
SEE ALSO
CHI::Driver::Memory, CHI
AUTHOR
Jonathan Swartz <swartz@pobox.com>
COPYRIGHT AND LICENSE
This software is copyright (c) 2011 by Jonathan Swartz.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
perl v5.14.2 2012-05-30 CHI::Driver::RawMemory(3pm)