Bash script search, improve performance with large files Post: 303033003

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Improve Performance

hi someone tell me which ways i can improve disk I/O and system process performance.kindly refer some commands so i can do it on my test machine.thanks, Mazhar

2. Shell Programming and Scripting

Any way to improve performance of this script

I have a data file of 2 gig I need to do all these, but its taking hours, any where i can improve performance, thanks a lot #!/usr/bin/ksh echo TIMESTAMP="$(date +'_%y-%m-%d.%H-%M-%S')" function showHelp { cat << EOF >&2 syntax extreme.sh FILENAME Specify filename to parse EOF...

3. Shell Programming and Scripting

Improve the performance of a shell script

Hi Friends, I wrote the below shell script to generate a report on alert messages recieved on a day. But i for processing around 4500 lines (alerts) the script is taking aorund 30 minutes to process. Please help me to make it faster and improve the performace of the script. i would be very...

4. Shell Programming and Scripting

Want to improve the performance of script

Hi All, I have written a script as follows which is taking lot of time in executing/searching only 3500 records taken as input from one file in log file of 12 GB Approximately. Working of script is read the csv file as an input having 2 arguments which are transaction_id,mobile_number and search...

5. Programming

Help with improve the performance of grep

Input file: #content_1 12314345345 242467 #content_14 436677645 576577657 #content_100 3425546 56 #content_12 243254546 1232454 . . Reference file: content_100

6. Shell Programming and Scripting

Performance issue in Grepping large files

I have around 300 files(*.rdf,*.fmb,*.pll,*.ctl,*.sh,*.sql,*.prog) which are of large size. Around 8000 keywords(which will be in the file $keywordfile) needed to be searched inside those files. If a keyword is found in a file..I have to insert the filename,extension,catagoery,keyword,occurrence...

7. UNIX for Dummies Questions & Answers

How to improve the performance of this script?

Hi , i wrote a script to convert dates to the formate i want .it works fine but the conversion is tkaing lot of time . Can some one help me tweek this script #!/bin/bash file=$1 ofile=$2 cp $file $ofile mydates=$(grep -Po '+/+/+' $ofile) # gets 8/1/13 mydates=$(echo "$mydates" | sort |...

8. Shell Programming and Scripting

Copying large files in a bash script stops execution

Hello, I'm new to this forum and like to first of all say hello to everyone. I've got a really annoying problem at the moment. I'm trying to rsync some files (about 200MB with one file of 120MB) from a Raspberry PI with raspbian to a debian server via rsync. This procedure is stored in a...

9. Programming

Improve the performance of my C++ code

Hello, Attached is my very simple C++ code to remove any substrings (DNA sequence) of each other, i.e. any redundant sequence is removed to get unique sequences. Similar to sort | uniq command except there is reverse-complementary for DNA sequence. The program runs well with small dataset, but...

LEARN ABOUT DEBIAN

blaze-edit

BLAZE-EDIT(1)						    BlazeBlogger Documentation						     BLAZE-EDIT(1)

NAME

       blaze-edit - edits a blog post or a page in the BlazeBlogger repository

SYNOPSIS

       blaze-edit [-fpqCPV] [-b directory] [-E editor] id

       blaze-edit -h|-v

DESCRIPTION

       blaze-edit opens an existing blog post or a page with the specified id in an external text editor. Note that there are several special
       forms and placeholders that can be used in the text, and that will be replaced with a proper data when the blog is generated.

   Special Forms
       <!-- break -->
	   A mark to delimit a blog post synopsis.

   Placeholders
       %root%
	   A relative path to the root directory of the blog.

       %home%
	   A relative path to the index page of the blog.

       %page[id]%
	   A relative path to a page with the supplied id.

       %post[id]%
	   A relative path to a blog post with the supplied id.

       %tag[name]%
	   A relative path to a tag with the supplied name.

OPTIONS

       -b directory, --blogdir directory
	   Allows you to specify a directory in which the BlazeBlogger repository is placed. The default option is a current working directory.

       -E editor, --editor editor
	   Allows you to specify an external text editor. When supplied, this option overrides the relevant configuration option.

       -p, --page
	   Tells blaze-edit to edit a page or pages.

       -P, --post
	   Tells blaze-edit to edit a blog post or blog posts. This is the default option.

       -f, --force
	   Tells blaze-edit to create an empty source file in case it does not already exist. If the core.processor option is enabled, this file
	   is used as the input to be processed by the selected application.

       -C, --no-processor
	   Disables processing a blog post or page with an external application.

       -q, --quiet
	   Disables displaying of unnecessary messages.

       -V, --verbose
	   Enables displaying of all messages. This is the default option.

       -h, --help
	   Displays usage information and exits.

       -v, --version
	   Displays version information and exits.

ENVIRONMENT

       EDITOR
	   Unless the core.editor option is set, BlazeBlogger tries to use system-wide settings to decide which editor to use.

EXAMPLE USAGE

       Edit a blog post in an external text editor:

	 ~]$ blaze-edit 10

       Edit a page in an external text editor:

	 ~]$ blaze-edit -p 4

       Edit a page in nano:

	 ~]$ blaze-edit -p 2 -E nano

SEE ALSO

       blaze-config(1), blaze-add(1), blaze-list(1)

BUGS

       To report a bug or to send a patch, please, add a new issue to the bug tracker at <http://code.google.com/p/blazeblogger/issues/>, or visit
       the discussion group at <http://groups.google.com/group/blazeblogger/>.

COPYRIGHT

       Copyright (C) 2008-2011 Jaromir Hradilek

       This program is free software; see the source for copying conditions. It is distributed in the hope that it will be useful, but WITHOUT ANY
       WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Version 1.2.0							    2012-03-05							     BLAZE-EDIT(1)