Load find pattern from a file?

Login or Register to Ask a Question and Join Our Community

Load find pattern from a file?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting Load find pattern from a file?

06-04-2015

Registered User

183, 15

Join Date: Jul 2010

Last Activity: 22 June 2015, 3:25 PM EDT

Posts: 183

Thanks Given: 56

Thanked 15 Times in 13 Posts

Load find pattern from a file?

Right now I have a bunch case statement wrapped around multiple groups of patterns. I want to make each pattern end-user definable in files instead. Can the bold parts be imported from a file simply? Code injection attack is not a big concern since there is access control on the share drive but if I have a choice in doing it in a relatively safe way, I'd prefer that.

Code:

find "$dataDir" \(    -iname 'redacted_1' \
                      -o -iname 'redacted_2' \
                      -o -iname 'redacted_3' \
                      -o -iname 'redacted_4' \) |
                           > "$scratchDir"file_list.txt

Mike

Michael Stora

View Public Profile for Michael Stora

Find all posts by Michael Stora

06-05-2015

Registered User

1,416, 266

Join Date: Sep 2013

Last Activity: 13 January 2021, 9:37 AM EST

Location: Swissh

Posts: 1,416

Thanks Given: 328

Thanked 266 Times in 239 Posts

Quote:

Originally Posted by Michael Stora

Can the bold parts be imported from a file simply?

Depends, if there are always 4 values, and i assume its those redacted_{1..4} that would change, then yes its simple.
Handling an unknown is a little more complex.

pattern_file.txt

Code:

redacted_1 redacted_2 redacted_3 redacted_4
redacted_21 redacted_22 redacted_23 redacted_24
redacted_31 redacted_32 redacted_33 redacted_34

(untested)

Code:

while read r1 r2 r3 r4
do 	find "$dataDir" \
		( -iname '$r1' \
                  -o -iname '$r2' \
                  -o -iname '$r3' \
                  -o -iname '$r4' ) |
                  >> "$scratchDir"file_list.txt
done<pattern_file.txt

hth

sea

View Public Profile for sea

Find all posts by sea

06-05-2015

Registered User

183, 15

Join Date: Jul 2010

Last Activity: 22 June 2015, 3:25 PM EDT

Posts: 183

Thanks Given: 56

Thanked 15 Times in 13 Posts

Quote:

Originally Posted by sea

Depends, if there are always 4 values, and i assume its those redacted_{1..4} that would change, then yes its simple.
Handling an unknown is a little more complex.

pattern_file.txt

Code:

redacted_1 redacted_2 redacted_3 redacted_4
redacted_21 redacted_22 redacted_23 redacted_24
redacted_31 redacted_32 redacted_33 redacted_34

(untested)

Code:

while read r1 r2 r3 r4
do     find "$dataDir" \
        ( -iname '$r1' \
                  -o -iname '$r2' \
                  -o -iname '$r3' \
                  -o -iname '$r4' ) |
                  >> "$scratchDir"file_list.txt
done<pattern_file.txt

hth

No, it can be an arbitrary list of filters for find (not necessarily 4 and not necessarily -iname).

Mike

Michael Stora

View Public Profile for Michael Stora

Find all posts by Michael Stora

06-05-2015

Registered User

1,416, 266

Join Date: Sep 2013

Last Activity: 13 January 2021, 9:37 AM EST

Location: Swissh

Posts: 1,416

Thanks Given: 328

Thanked 266 Times in 239 Posts

Wouldnt it then be easier to sum up all filters and then run either run one by one or all at once?

sea

View Public Profile for sea

Find all posts by sea

06-05-2015

Registered User

183, 15

Join Date: Jul 2010

Last Activity: 22 June 2015, 3:25 PM EDT

Posts: 183

Thanks Given: 56

Thanked 15 Times in 13 Posts

I'm not currently doing any iteration, only one find command. I don't particularly want iteration because that might cause duplicate entries. The multiline syntax \) ... )\ is just for human readability and does not change how find parses the filter.

Mike

Last edited by Michael Stora; 06-05-2015 at 03:14 AM..

Michael Stora

View Public Profile for Michael Stora

Find all posts by Michael Stora

06-05-2015

Registered User

1,416, 266

Join Date: Sep 2013

Last Activity: 13 January 2021, 9:37 AM EST

Location: Swissh

Posts: 1,416

Thanks Given: 328

Thanked 266 Times in 239 Posts

Try (untested):

Code:

PATTERN=""
isFirst=true
while read pattern;do 
	$isFirst && \
		PATTERN+=" -iname \"$pattern\"" && \
		isFirst=false || \
		PATTERN+=" -o -iname \"$pattern\""
done<pattern_file.txt

find "$dataDir" $PATTERN >> "$scratchDir"file_list.txt

hth

sea

View Public Profile for sea

Find all posts by sea

06-05-2015

Moderator

1,484, 567

Join Date: Mar 2011

Last Activity: 28 November 2020, 9:34 AM EST

Posts: 1,484

Thanks Given: 68

Thanked 567 Times in 444 Posts

The OP wants a program which will generate find statement(s).

For instance, an awk or shell program (or any other) could generate find statements.
But you need to define proper conditions for it.

Exact conditions like input file format, error handling desired (like possible timeouts,file locking, other processes on files in question etc.), exact find switches you wish you use in what scenario.

Just reading find switches from files does not bode well

Can you post your entire code with a short explanation what you wish to change ?

These 2 Users Gave Thanks to Peasant For This Post:

Peasant

View Public Profile for Peasant

Find all posts by Peasant

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed -- Find pattern -- print remainder -- plus lines up to pattern -- Minus pattern

The intended result should be : PDF converters 'empty line' gpdftext and pdftotext?xml version="1.0"?> xml:space="preserve"><note-content version="0.1" xmlns:/tomboy/link" xmlns:size="http://beatniksoftware.com/tomboy/size">PDF converters gpdftext and pdftotext</note-content>...

2. Shell Programming and Scripting

How to find a file with a specific pattern for current sysdate & upon find email the details?

I need assistance with following requirement, I am new to Unix. I want to do the following task but stuck with file creation date(sysdate) Following is the requirement I need to create a script that will read the abc/xyz/klm folder and look for *.err files for that day’s date and then send an...

3. Shell Programming and Scripting

Find file of particular pattern

Hi All, I have a file PSU_ 20130805_201308041234522 i want to search this file where variable day=20130805 and curday=20130804 after currday date some numbers will be added.how to search this file by using day and curday. Thanks in advance.

4. Shell Programming and Scripting

how to find a pattern from an external file in a directory containing multiple file recursively

Hi, Need your help in this. I have an input file that has multiple enrollment_number, somewhat like 1234567 8901234 9856321 6732187 7623465 Now i have to search and delete these enrollment_number recursively from all the files that are within multiple sub-directories of a...

5. Shell Programming and Scripting

Shell script to find specific file name and load data

I need help as to how to write a script in Unix for the following: We have 3 servers; The mainframe will FTP them to a folder. In that folder we will need the script to look and see if the specific file name is there and load it to the correct table. Can anyone pls help me out with...

6. Shell Programming and Scripting

To find a pattern in file

Hi, I would like to find a pattern in a file as follows: I would like to find "or" "OR" "and" "AND" between two numeric values. I have tried this: grep '**or*' But does not work. Appreciate help on this.

7. Shell Programming and Scripting

How to find pattern in file names?

I have some files, those are abbreviated (ed,ea, and bi) company_ed_20100719.txt company_ea_20100719.txt company_bi_20100719.txt I would like to rename these files by replacing ed with EmployeeDetails ea with EmployeeAddress bi with BankInfomration as company_...

8. Shell Programming and Scripting

Find a pattern in a file at a particular location

Hi all, I have a question on how to search for a pattern in a file and return a value if it is present at that particular location. How to read each line and each character for the pattern in the file of any format. Eg for the file format: attached the file

9. Shell Programming and Scripting

How to find this pattern in a file

hi all i have a file in my box, which is so huge and full file is in a single line. In this file i have to look for a pattern "ABC01234567" In this above mentioned pattern ABC is fixed and number might change . it will a eight digit random number Thanks so much for all you help ...

Login or Register to Ask a Question