Sponsored Content
Top Forums Shell Programming and Scripting Very Challenging Problem. Please read fully. Post 302216482 by danmero on Saturday 19th of July 2008 12:00:16 PM
Old 07-19-2008
@RRVARMA
Your script give me
real 0m2.997s
user 0m0.980s
sys 0m1.624s

Replace
Code:
	field7=`echo $j|cut -d "|" -f7`
	field13=`echo $j|cut -d "|" -f13`
	field14=`echo $j|cut -d "|" -f14`
        if [ "${i}" == "${field7}|${field13}|${field14}" ]

by:
Code:
 if [ "${i}" == "$(echo $j | awk 'BEGIN{FS=OFS="|"}{print $7, $13, $14}')" ]

and you will save %43 procesing time using the same resources.
real 0m1.683s
user 0m0.612s
sys 0m0.888s


@cooldude solution demands more memory but is faster.
real 0m0.211s
user 0m0.036s
sys 0m0.004s


@Franklin52 awk solution is the best, but uses a significant amount of memory
real 0m0.005s
user 0m0.000s
sys 0m0.004s
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Very Challenging Question! Need help bad!

I am in desperate need of an answer to this question. I have looked everywhere (even the man pages) and found very little. Solaris has the concept of "plumbing" a network interface. What does this mean? I would be really greatful to whoever could help me answer this question. I am so... (1 Reply)
Discussion started by: Sparticus007
1 Replies

2. UNIX for Dummies Questions & Answers

A Challenging Situation : i hope the moderators will respond to this problem..

I have the following situation : i have 4 Unix Sco servers, one Windows 2000 server, and an ADSL internet connection. All the servers, that is the 4 unix and the windows server have real static IPs supplied by my ISP. the servers are connected to a Switch , the switch is connected to an... (2 Replies)
Discussion started by: BAM
2 Replies

3. UNIX for Dummies Questions & Answers

A Challenging situation for the MODERATORS

Well, I hope this way you will respond to my inquiries. I have 4 unix servers,with static ips (though i dont think this is an issue)....i can telnet and rlogin from one to the other....if i FTP from on et othe other and try to execute : cd /user return /user : no such file or... (1 Reply)
Discussion started by: BAM
1 Replies

4. Shell Programming and Scripting

Challenging!! Help needed

Hi, I have a script xyz.ksh which accpets two parameters the format of first one is :X_TABLENAME_Y and second one is a digit. I can extract a table name from that parameter and store it in a variable var_tblnm, so if i pass a parameter X_TABLE1_Y the value in var_tblenm is "TABLE1" now i have... (1 Reply)
Discussion started by: hcdiss
1 Replies

5. Solaris

Hostname not fully qualified..

Hi Friends.. I have a small problem with the hostname of my system.I had installed Solaris 10 X86 on Vmware in my windows 2000 system.After booting of my solaris system,if i give check-hostname command it says ,, hostname is not fully qualified ,,change the hostname to hostname.xxx.xxxxxx.com... (3 Replies)
Discussion started by: sdspawankumar
3 Replies

6. Programming

A challenging problem involving symbolic links.

Hello, I'm working on an application that bridges together several applications involved in creating a video workflow for editing with digital cinema cameras. The main platform is MacOSX. Because of the nature of some of the utilities for working with this video footage I must spoof filenames... (2 Replies)
Discussion started by: ibloom
2 Replies

7. Shell Programming and Scripting

Need help with this challenging code....

Hello All, I am new to this forum, and the reason I came here is to seek solution from the experts. I have written following wrapper script, it was running fine from past couple of months, until last week. When one of the function in the script which suppose to login through ssh to the... (2 Replies)
Discussion started by: tajdar
2 Replies

8. Shell Programming and Scripting

Challenging Awk array problem

Hi, I rather have a very complicated awk problem here, at least to me. I have two files. File 1: 607 687 174 0 0 chr1 3000001 3000156 -194195276 - L1_Mur2 LINE L1 -4310 1567 1413 1 607 917 214 114 45 chr1 3000237 ... (19 Replies)
Discussion started by: polsum
19 Replies

9. Shell Programming and Scripting

simple but challenging ignore case

Folks - I found this code on the forums to extract a paragraph for a matching pattern but I don't know how to make it ignore case. grep "-ip" is not an option for me as I am on SUSE LINUX. Thanks for ur help. I run this script as below: grep_para.ksh sqlstate < logfile "The end result... (2 Replies)
Discussion started by: beowulfkid
2 Replies

10. Shell Programming and Scripting

Challenging scenario

Hi, My input file contains 1,2 2,4 3,6 4,9 9,10 My expected output is 1,10 2,10 3,6 4,1 9,10 (6 Replies)
Discussion started by: pandeesh
6 Replies
File::Path::Tiny(3pm)					User Contributed Perl Documentation				     File::Path::Tiny(3pm)

NAME
File::Path::Tiny - recursive versions of mkdir() and rmdir() without as much overhead as File::Path VERSION
This document describes File::Path::Tiny version 0.3 SYNOPSIS
use File::Path::Tiny; if(!File::Path::Tiny::mk($path)) { die "Could not make path '$path': $!"; } if(!File::Path::Tiny::rm($path)) { die "Could not remove path '$path': $!"; } DESCRIPTION
The goal here is simply to provide recursive versions of mkdir() and rmdir() with as little code and overhead as possible. This module is in no way meant to derogate File::Path and is in no way an endorsement to go out and replace all use of File::Path with File::Path::Tiny. File::Path is very good at what it does but there's simply a lot happening that we can do without much of the time. Here are some things File::Path has/does that this module attempts to do without: o multiple interfaces Backwards compatibility brings in a lot of code and logic that we don't need from here on out. o chdir's It does a ton of chdir's which could leave you somewhere you're not planning on being and requires much more overhead to do. o can croak not allowing you to detect and handle failure Just let me handle errors how I want. Don't make my entire app die or have to wrap it in an eval o A well intentioned output system Just let me do the output how I want. (Nothing, As HTML, print to a filehandle, etc...) o A well intentioned and experimental (IE subject to change) error handling system. Just keep it simple and detect failure via a boolean check and do what I want with the error. See "How can I make/remove multiple paths?" o According to its POD, removing a tree is apparently not safe unless you tell it to be with the 'safe' or 'keep_root' attributes. Seems like that should just happen, I don't want to worry about accidentally removing / when I pass it /tmp INTERFACE
Nothing in exported or exportable, that helps keep it '::Tiny'. File::Path::Tiny::mk() Takes a single path (like mkdir()) to recursively create and, optionally, a mask (like mkdir()) for all subsequent mkdir() calls. Mask defaults to 0700 (also like mkdir()) Returns false if it could not be made, true otherwise (returns '2' if it is -d already) It is recursive in the sense that given foo/bar/baz as the path to create all 3 will be created if necessary. File::Path::Tiny::rm() Takes a single path (like rmdir()) to recursively empty and remove. Returns false if it could not be emptied or removed, true otherwise. (returns '2' if it is !-d already) It is recursive in the sense that given /foo/bar/baz as the path to remove it will recursively empty 'baz' and then remove it from /foo/bar. Its parents, /, /foo, and /foo/bar are *not* touched. File::Path::Tiny::empty_dir() Takes a single path to recursively empty but not remove. Returns false when there is a problem. DIAGNOSTICS
Throws no warnings or errors of its own If the functions ever return false, $! will have been set either explicitly or by the mkdir(), rmdir(), unlink(), or opendir() that ultimately returned false. MISC
How can I make/remove multiple paths? For simplicity sake && ::Tiny status this module must be very very very simple. That said it is also very simple to do muliple paths: for my $path (@paths) { File::Path::Tiny::::mk($path) or _my_handle_failed_mk($path, $!); } for my $path (@paths) { File::Path::Tiny::::rm($path) or _my_handle_failed_rm($path, $!); } That also lets you keep going or short circuit it or handle errors however you like: PATH: for my $path qw(foo/bar bar/rat) { if (!File::Path::Tiny::mk($path)) { print "problem unlinking '$path': $! "; last PATH; } else { print "No error encountered with '$path' " } } About the '::Tiny' status See Acme::Tiny for information on the ::Tiny suffix. #3 is almost there (< 1/5th +/-), a bit more trimming and I think we'll have it! #8 is N/A since part of the "sub set" is to do single paths like their non-recursive core counterparts and there are so many ways to invoke it with different consequences [ -- RSS Memory -- ] Baseline perl 1168 File::Path 1808 (+640) File::Path::Tiny 1288 (+120) Even though "time" isn't really a ::Tiny factor, it does improve loading a bit: [ -- time -- ] Baseline perl real 0m0.007s user 0m0.002s sys 0m0.004s File::Path real 0m0.017s user 0m0.011s sys 0m0.005s File::Path::Tiny real 0m0.007s user 0m0.003s sys 0m0.004s As time allows and more tests are added I'll try to include more comprehensive benchmark results. How do I make sure the path is safe to create or remove? Of course the answer depends on what you mean by "safe". This module makes no assumptions on interpreting the "safeness" of a path, just like mkdir() and rmdir(). Also like mkdir() and rmdir() typically you'll find that filesystem permissions are a pretty reliable tool (of course if the code will be run as root you would want to setuid first...) You might use Cwd::abs_path() to sanitize a path before sending it to be made or removed. Even after that it might not be "safe" so you'll need to discern what your particular definition of "safe" is and take appropriate action. DEPENDENCIES
File::Spec of course but its only loaded if needed INCOMPATIBILITIES
None reported. BUGS AND LIMITATIONS
No bugs have been reported. Please report any bugs or feature requests to "bug-file-path-tiny@rt.cpan.org", or through the web interface at <http://rt.cpan.org>. AUTHOR
Daniel Muey "<http://drmuey.com/cpan_contact.pl>" LICENCE AND COPYRIGHT
Copyright (c) 2008, Daniel Muey "<http://drmuey.com/cpan_contact.pl>". All rights reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic. DISCLAIMER OF WARRANTY
BECAUSE THIS SOFTWARE IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE SOFTWARE, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE SOFTWARE IS WITH YOU. SHOULD THE SOFTWARE PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR, OR CORRECTION. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE SOFTWARE AS PERMITTED BY THE ABOVE LICENCE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE SOFTWARE TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. perl v5.14.2 2012-04-04 File::Path::Tiny(3pm)
All times are GMT -4. The time now is 11:05 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy