Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Optimizing find with many replacements
Top Forums Shell Programming and Scripting Optimizing find with many replacements Post 303015926 by f77hack on Monday 16th of April 2018 03:22:15 PM
Old 04-16-2018
Optimizing find with many replacements
Hello,

I'm looking for advice on how to optimize this bash script, currently i use the shotgun approach to avoid file io/buffering problems of forks trying to write simultaneously to the same file. i'd like to keep this as a fairly portable bash script rather than writing a C routine.

in a nutshell, there are many conditions in a file that i'm looking to replace strings. any particular file may have some, none or all of the requirements to replace a string.

currently

Code:
Longstring='lots of stuff'
spushd $HOME/somepath

gfind . -depth -name "somefile" -type f -writable -exec gsed -i '1{/^#./! s/.*/'"$Longstring"'/}' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/ts=4/ts=2/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/sw=4/sw=2/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/tab-width: 4/tab-width: 2/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/mode: tcl/mode: _tcl/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/c-basic-offset: 4/c-basic-offset: 2/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/^\s*(size.*)$/\1/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/^\s*(md.*)$/\1/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/^\s*(rmd.*)$/\1/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/^\s*(sha.*)$/\1/g' {} \;
  gfind . -depth -name "somefile" -type f -writable -exec gsed -i -r 's/^(python.versions.*)$/python.versions 27 36/g' {} \;
  spopd

as you can see, these operations are sequential which can take quite a while.

should i modify the find to do depth first?

can i fork the find and avoid file io problems?

spawn different processes?

thanks
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

optimizing - to find the number of occurrence

Hi, I need to find the number of occurrence of string in a file, for ex: >cat filename abc abc def ghi ghi ghi ghi abc abc >output would be abc 4 def 1 (10 Replies)
Discussion started by: matrixmadhan
10 Replies

2. Shell Programming and Scripting

Conditional replacements

Hi, I have a requirement as below Input Jacuzzi,"Jet Rings, Pillows",Accessory,Optional,,9230917,69094,,P556805,69094,FALSE,1,0,, Jacuzzi,"Jet Rings, Pillows, Skirt/Apron",Accessory,Optional,,9230917,69094,,P556805,69094,FALSE,1,0,, Output Jacuzzi,"Jet Rings!@%... (6 Replies)
Discussion started by: kewk
6 Replies

3. Shell Programming and Scripting

Gen random char then sed replacements

Hey guys, I need to first generate some random characters, which I am already doing perfectly as follows: randomize=`cat /dev/urandom | tr -dc "a-z0-9" | fold -w 6 | head -n 1` This is where I am stuck...I need to sed replace some static values with those random characters, but I need each... (4 Replies)
Discussion started by: holyearth
4 Replies

4. UNIX for Dummies Questions & Answers

How to use sed to do multiple replacements all at once?

I have a text file where I want to use sed to do multiple replacements all at once (i.e. with a single command) . I want to convert all AA's to 0, all AG's to 1 and all GG's to 2. How do I go about doing that? Thanks! (2 Replies)
Discussion started by: evelibertine
2 Replies

5. Shell Programming and Scripting

How to get count of replacements done by sed?

Hi , How can i get count of replacements done by sed in a file. I know grep -c is a method. But say if sed had made 10 replacement in a file, can i get number 10 some how? (8 Replies)
Discussion started by: abhitanshu
8 Replies

6. UNIX for Dummies Questions & Answers

Selective Replacements: Using sed or awk to replace letters with numbers in a very specific way

Hello all. I am a beginner UNIX user who is using UNIX to work on a bioinformatics project for my university. I have a bit of a complicated issue in trying to use sed (or awk) to "find and replace" bases (letters) in a genetics data spreadsheet (converted to a text file, can be either... (3 Replies)
Discussion started by: Mince
3 Replies

7. Shell Programming and Scripting

awk delete newline after other replacements

Dear All, could you please help me to remove \n characters after all other replacements have been done as in the code below: { #remove punctuation and starting whitespaces gsub("]"," "); $1=$1; } { #print lines containing 'whatever' if ($1=="whatever") {print} #print... (3 Replies)
Discussion started by: shivacoder
3 Replies

8. Shell Programming and Scripting

BASH script to read external file to perform text replacements?

Hi all, I have a moderate size (300 lines) BASH Shell script that performs various tasks on different source reports (CSV files). One of the tasks that it performs, is to use SED to replace 'non-conforming' titles with conformant ones. For example "How to format a RAW Report" needs to become... (3 Replies)
Discussion started by: richardsantink
3 Replies

9. Web Development

Optimizing JS and CSS

Yes. Got few suggestions. - How about minifying resources - mod_expires - Service workers setup https://www.unix.com/attachments/web-programming/7709d1550557731-sneak-preview-new-unix-com-usercp-vuejs-demo-screenshot-png (8 Replies)
Discussion started by: Akshay Hegde
8 Replies

10. Shell Programming and Scripting

Help building a variable string from a keyword - character replacements!

Hello scripting geniusii! I come to kneel before the alter of your wisdom! I am looking to take a keyword and replace characters within that keyword and add them to a string variable. I would like this to only go through however many characters the word has, which may vary in size. ... (10 Replies)
Discussion started by: ghaniba
10 Replies

LEARN ABOUT OPENSOLARIS

setlabel

setlabel(1)							   User Commands						       setlabel(1)

NAME

       setlabel - move files to zone with corresponding sensitivity label

SYNOPSIS

       /usr/bin/setlabel newlabel filename...

DESCRIPTION

       setlabel  moves	files  into  the zone whose label corresponds to newlabel. The old file pathname is adjusted so that it is relative to the
       root pathname of the new zone. If the old pathname for a file's parent directory does not exist as a directory in the new zone, the file is
       not moved. Once moved, the file might no longer be accessible in the current zone.

       Unless newlabel and filename have been specified, no labels are set.

       Labels  are  defined  by the security administrator at your site. The system always displays labels in uppercase. Users can enter labels in
       any combination of uppercase and lowercase. Incremental changes to labels are supported.

       Refer to setflabel(3TSOL) for a complete description of the conditions that are required to satisfy this command, and the  privileges  that
       are needed to execute this command.

EXIT STATUS

       setlabel exits with one of the following values:

       0    Successful completion.

       1    Usage error.

       2    Error in getting, setting or translating the label.

USAGE

       On  the	command  line, enclose the label in double quotes unless the label is only one word. Without quotes, a second word or letter sepa-
       rated by a space is interpreted as a second argument.

	 % setlabel SECRET somefile
	 % setlabel "TOP SECRET" somefile

       Use any combination of upper and lowercase letters. You can separate items in a label with blanks, tabs, commas or slashes (/). Do not  use
       any other punctuation.

	 % setlabel "ts a b" somefile
	 % setlabel "ts,a,b" somefile
	 % setlabel "ts/a b" somefile
	 % setlabel " TOP SECRET A B   " somefile

EXAMPLES

       Example 1 Set a Label.

       To set somefile's label to SECRET A:

	 example% setlabel "Secret a" somefile

       Example 2 Turn On a Compartment.

       Plus and minus signs can be used to modify an existing label. A plus sign turns on the specified compartment for somefile's label.

	 example% setlabel +b somefile

       Example 3 Turn Off a Compartment.

       A minus sign turns off the compartments that are associated with a classification. To turn off compartment A in somefile's label:

	 example% setlabel -A somefile

       If an incremental change is being made to an existing label and the first character of the label is a hyphen (-), a preceding double-hyphen
       (--) is required.

       To turn off compartment -A in somefile's label:

	 example% setlabel -- -A somefile

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWtsu			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Committed 		   |
       +-----------------------------+-----------------------------+

SEE ALSO

       setflabel(3TSOL), label_encodings(4), attributes(5)

NOTES

       The functionality described on this manual page is available only if the system is configured with Trusted Extensions.

       This implementation of setting a label is meaningful for the Defense Intelligence Agency (DIA) Mandatory Access Control (MAC)  policy.  For
       more information, see label_encodings(4).

SunOS 5.11							    20 Jul 2007 						       setlabel(1)
All times are GMT -4. The time now is 01:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy