BASH: File name part to list reference problem.


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting BASH: File name part to list reference problem.
# 1  
Old 08-01-2010
Question BASH: File name part to list reference problem.

I've made a habit of including a four-letter "tail" on image file names I download from the Web, so I can both match them with IPTC Transmission References of my own making and rename them later using either a GUI renamer or a script I've written myself. Now I want to automate the process of writing the TRs to the files by way of Exiv2, leaving just the renaming stage of my routine before moving on to "filing them away" in categorized subfolders, CDs, etc.

Using OpenOffice Calc, I was able to create a list of these four-letter suffixes and the TRs to which they correspond, sort by the former and output to a text file. I added an extra field of IPTC Categories (also of my own making -- doesn't seem to matter when Categories is in the process of being dropped from the IIM). The script I have works with one file at a time, as my line-by-line command-line tests in a terminal emulator have proven, but something goes haywire when applied (as I have done so) to a whole folder of files and the complete list of suffixes, TRs and categories all at once.

I doubt I'm either using the right loop types to process this data, nor am I at all sure that I have the loops that are there nested correctly in the script. The output I've got so far happens to be the "natural" name of the last suffix in the list. What I want is the "natural" name corresponding to the suffix of the file being "looked at" by the script.

Here's the script as it reads so far:
Code:
for a in $(ls *.jpg); # Find files ending in "jpg" in the current directory
do
	bargirl=$(echo $a)
	while read 'line';
	do
		souse=$(echo $line)
		drunk=${souse%:*}
		verydrunk=$(echo $souse | cut -d":" -f2)
		firstdrink=$(echo $verydrunk | cut -d, -f1)
		seconddrink=$(echo $verydrunk | cut -d, -f2)
		thirddrink=$(echo $verydrunk | cut -d, -f3)
done<downloads-xreference.txt # The text file with the three columns (suffix, natural name and Category). Terminate the 'while read' loop
jackdaniels=$(echo ${bargirl:(-4)}) # Take the ".jpg" off the file name	
singlemalt=$(echo $bargirl | cut -d'.' -f1) # Ditto
puregrain=$(echo ${singlemalt%????}) # Now strip the suffix off -- comes from the renaming script
jimbeam=$(echo ${singlemalt:(-4)}) # "What was that suffix code again?"
if [[ $jimbeam -eq $seconddrink ]]; # Does it exist in column 3 of the text file? Does it match the one on the file we're looking at? 
then
	chaser=$firstdrink # Variable "chaser" should be the matched 4-letter suffix.
	echo $chaser # "Show me the money."
fi
done #Terminates the 'for' loop

BZT
# 2  
Old 08-02-2010
Yes, it looks like some of your problem is your loop structure. The while loop is capturing the last record from your text file and comparing that against the file name component. I would guess that you want the filename, or some part of the filename, compared to the information in each line of the text file until you find a match.

It's not efficient, but the logic below might do what you need.

Code:

for f in $(ls *.jpg)
do
        suss off filename data from f

        while read buf
        do
                if filename data == desired field in buf
                then
                        echo what you need
                        break                   # exit while
                fi
        done <data_file
done

I couldn't tell from your code whether the filenames had the suffix tacked onto the end (picture.jpgxxxx) or picture.xxxx.jpg. The ls command implies the latter, but you seem to be stripping off xxxx as the trailing 4 characters. You might be getting tripped up with this too. If you post a sample of filenames and a sample of your text file, it'd make giving suggestions a bit easier.


Nitpicking now.... the statement

Code:
souse=$(echo $line)

can be written more simply:

Code:
souse="$line"

This is easier to read, and depending on the shell it more efficient. There might also be ways to make sussing the field data from the text file more efficient; using external processes like 'cut' introduce overhead that can eat your lunch as far as performance is concerned.
# 3  
Old 08-02-2010
Quote:
Originally Posted by agama
I couldn't tell from your code whether the filenames had the suffix tacked onto the end (picture.jpgxxxx) or picture.xxxx.jpg. The ls command implies the latter, but you seem to be stripping off xxxx as the trailing 4 characters. You might be getting tripped up with this too. If you post a sample of filenames and a sample of your text file, it'd make giving suggestions a bit easier.
They were more like this (a current example right from the "victim" directory):
Code:
gae72-7201-077-005biki.jpg

My rename script, which I run once these have been annotated according to the four letters preceding the ".", chops off that four-letter substring with what you saw in my script in this thread as the 'puregrain' variable (in the other script, it's an m.)

Quote:
Nitpicking now.... the statement

Code:
souse=$(echo $line)

can be written more simply:

Code:
souse="$line"

This is easier to read, and depending on the shell it more efficient. There might also be ways to make sussing the field data from the text file more efficient; using external processes like 'cut' introduce overhead that can eat your lunch as far as performance is concerned.
I asked about performance and efficiency in simplification on one thread I started over on the LQ forum. The person there who was giving me advice (and has done so, before and since) was rather vague about it. If it's a shell-by-shell or build/version-by-build/version thing, I understand why now. Trial and error -- don't mind it so long as my bash will still fork commands in the morning Smilie

BZT
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Bash compare a list of file

Dear all, I believe this is a Bash basic question... I am bit ashamed for asking actually... I want to create a Bash script that compares 2 different folders: 1) work_folder and 2) work_folder.git #!/bin/bash FOLDER_NAME=`pwd | awk -F/ '{ print $NF }' | awk -F. '{ print $1 }'` ... (6 Replies)
Discussion started by: freddie50
6 Replies

2. Shell Programming and Scripting

Shell Scripting Problem - Invalid Back Reference

Here is the question... Create a new script, sub2, taking three parameters... 1.) the string to be replaced 2.) the string with which to replace it 3.) the name of the file in which to make the substitution ...that treats the string to be replaced as plain text instead of as a regular... (1 Reply)
Discussion started by: johnhisenburg
1 Replies

3. Programming

Passing Pointers by reference in C++ Problem

Hello All, I am having this issue...where I am actually having hard time understanding the problem: The code is as follows: #include<iostream.h> void fxn(char*** var) { int i =4; *var = (char**)malloc(i*sizeof(char*)); for(int j =0; j<4; j++) { *var = "name"; cout<<*var;... (6 Replies)
Discussion started by: mind@work
6 Replies

4. Shell Programming and Scripting

symbol list reference

Can anyone direct me to a page that holds a list of perl's built in symbols? Example: $_ means blah $? means blah2 $! means blah3 (3 Replies)
Discussion started by: mrwatkin
3 Replies

5. Shell Programming and Scripting

Help with rename header content based on reference file problem

I got long list of reference file >data_tmp_number_22 >data_tmp_number_12 >data_tmp_number_20 . . Input file: >sample_data_1 Math, 5, USA, tmp SDFEWRWERWERWRWER FSFDSFSDFSDGSDGSD >sample_data_2 Math, 15, UK, tmp FDSFSDFF >sample_data_3 Math, 50, USA, tmp ARQERREQR . . Desired... (7 Replies)
Discussion started by: perl_beginner
7 Replies

6. Shell Programming and Scripting

Replace character based on reference file problem asking

I got two files right now, input file (target file), reference file 1 (query file) reference file 1 (long list of data) KOLOPWMOPOPO ADASDASD ADSASDASDAD . . target file (one long liner content) ADASDASDTYUKOKOLOPWMOPOPOOPLUAADSASDASDADPOPOUYADADASDASD desired output file content ... (1 Reply)
Discussion started by: patrick87
1 Replies

7. Shell Programming and Scripting

BASH - Reference external variable name dynamically

Hi there, I have included an external properties file into my BASH script via the 'source' command. I am attempting to dynamically assign a variable in the BASH script, that references the variable name within the external properties file i.e. #!/bin/bash pth=${0%/*} source... (3 Replies)
Discussion started by: mjwoodford
3 Replies

8. Shell Programming and Scripting

Array reference problem

i have a variable MYHOST that has my host name.depending on the host i have an array like A_<hostname>.Everytime i need to append the hostname to A_ to get the array.but in the shell script i am nt able to access the members of that array. code of what i hav done: export temp=A_$MYHOST for... (15 Replies)
Discussion started by: niteesh_!7
15 Replies

9. Shell Programming and Scripting

How to select or make reference to, part of a field

For a field format such as AAL1001_MD82, how do I select(and use in if statement) only the last four elements( in this case MD82) or the first three elements (in this case AAL)? For instance, how do I do the following - if first three elements of $x == yyy, then ... (5 Replies)
Discussion started by: akshaykr2
5 Replies

10. Shell Programming and Scripting

BASH: Grepping/sedding/etc out part of a file... (from one word to 'blank' line)

I have a file that lists data about a system. It has a part that can look like: the errors I'm looking for with other errors: Alerts Password Incorrect Login Error Another Error Another Error 2 Other Info or, just the errors I need to parse for: Alerts Password Incorrect ... (9 Replies)
Discussion started by: elinenbe
9 Replies
Login or Register to Ask a Question