parsing filename and grabbing specific string patterns


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting parsing filename and grabbing specific string patterns
# 1  
Old 02-20-2011
parsing filename and grabbing specific string patterns

Hi guys...Wow I just composed a huge post and it got erased as I was logged out automatically
Anyways I hope someone can help me out here.
So the task I'm working on is like this
I have a bunch of files that I care about sitting in a directory say $HOME/files

Now my job is to go and loop over all these files and then grab parts of each filename and check if the parsed string exists in a parameter that is
passed to the script say $4

The filename parsing has the following rules

1: testfile_string1_string2_20100232to201130203.csv
parsed value should be "string1_string2"

2: testfile_string3_string4.csv
parsed value should be "string3_string4.csv"

3: testfile_string5_string6_string7_20113203to20110423.csv
parsed value should be "string5_string6_string7"

So the idea here is to grab the part of the filename after the first "_" upto a digit "20103232" eg 1 , eg3
Or the end of the string in case numeric values aren't there eg 2

I've been trying all day but I'm not able to find an answer for this
I'ld appreciate if one of you experts would help me out.

Thanks
Ruka
# 2  
Old 02-20-2011
Try:
Code:
cd "$HOME/files"
for i in *.csv
do
  i=${i#testfile_}
  i=${i%%_[0-9]*}
  i=${i%.csv}
  case $4 in 
    *$i*) echo "$i"
  esac
done

# 3  
Old 02-20-2011
Code:
$ echo testfile_string1_string2_string3_20100232to201130203.csv |sed 's/^[^_]*_\(.*\)_[^_]*/\1.csv/'

string1_string2_string3.csv

# 4  
Old 02-20-2011
Hi Scrutinizer, rdcwayx

Thanks for the input guys..:-) I really appreciate it

Scrutinizer

I think the way you hacked through the string pattern was awesome...
My only question is the use of case ie the variable $4 is actually the superset of $i so Im not sure how the case $4 check actually works...it does...i tried it but isnt it like checking if a superset is present in its subset? how does that work?
eg $4 = "string1_string2_string3_string4_string5_string6_string7"
and the value of i that is the file names after the parsing are eg
$i = "string1_string2"
or $i= "string3_string4" etc...so how does the case of $4 work ?

Thanks for the solution..It works....Im just trying to understand this

rdcwayx

The solution works for the example you gave but doesnt work for the other cases....Thanks a lot though :-)

You guys are great....
I hope I can help some one like this someday.
Ruk
# 5  
Old 02-20-2011
Quote:
Originally Posted by rukasetsuna

The solution works for the example you gave but doesnt work for the other cases....Thanks a lot though :-)

Ruk
fixed.

Code:
$ echo testfile_string3_string4.csv |sed 's/^[^_]*_//;s/_[0-9][^_]*\./\./'
string3_string4.csv

$ echo testfile_string1_string2_string3_20100232to201130203.csv |sed 's/^[^_]*_//;s/_[0-9][^_]*\./\./'
string1_string2_string3.csv


Last edited by rdcwayx; 02-20-2011 at 09:14 PM..
# 6  
Old 02-21-2011
@rukasetsuna

If $4 matches *string* (any number of characters (*), followed by string and then any number of characters (second *)), then it follows that $4 is a superset of string.
# 7  
Old 02-21-2011
@Scrutinizer

Thanks for explaining.

That made it much simpler...Im used to other programming languages so it felt odd to me :-)

Thanks for your help..

@rdcwayx

Thanks for your help too....
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parsing a file with different patterns

I have a text file like this , where the same set of three lines repeat with different values. INFO: processing now 03/25/2015-00:06:05 03/25/2015-00:16:04 ------Invoking myexe table=table1 INFO 25-03 00:20:26,801 - Finished processing (I=0, O=57, R=57, W=57, U=0, E=0) INFO: processing... (4 Replies)
Discussion started by: Lakshmikumari
4 Replies

2. Shell Programming and Scripting

Specific string parsing in Linux/UNIX

Hi, I have a string which can be completely unstructred. I am looking to parse out values within that String. Here is an example <Random Strings> String1=<some number a> String2=<some number b> String3=<some number c> Satish=<some number d> String4=<some number e> I only want to parse out... (1 Reply)
Discussion started by: satishrao
1 Replies

3. Shell Programming and Scripting

Html parsing - get line after specific string till a point

Hi all :) It sounds complex, for example I want to find the whole html file (there are 5 entries of this string and I need to get all of them) for the string "<td class="contentheading" width="100%">", get the next line from it only till the point that says "</td>", plus removing \t (tabs) ... (6 Replies)
Discussion started by: hakermania
6 Replies

4. Shell Programming and Scripting

Help parsing filename with bash script

Hi all! Looking for some help parsing filenames in bash. I have a directory full of files named "livingroom-110111105637.avi". The format is always date and time (yymmddhhmmss). I'm looking to parse the filenames so they are a little more easily readable. Maybe rename them to... (4 Replies)
Discussion started by: mtehonica
4 Replies

5. UNIX for Dummies Questions & Answers

replace multiple patterns in a string/filename

This should be somewhat simple, but I need some help with this one. I have a bunch of files with tags on the end like so... Filename {tag1}.ext Filename2 {tag1} {tag2}.ext I want to hold in a variable just the filename with all the " {tag}" removed. The tag can be anything so I'm looking... (4 Replies)
Discussion started by: kerppz
4 Replies

6. Shell Programming and Scripting

grabbing filename from text file....should be easy!

Quick question...I'm trying to grab the .tif file name from this output from our fax server. What is the best way i can do this in a bash script? I have been looking at regular expressions with bash or using awk but having some trouble. thanks! The only output i want is... (5 Replies)
Discussion started by: kuliksco
5 Replies

7. Shell Programming and Scripting

grabbing specific column perl

Alright, I'm new to Perl so be gentle. Given the following script: ---- open(file, "<file.txt"); @lines = <file>; close(file); $var = print $lines; ---- So I'm printing line 18 of the file "file.txt". I now want the 5th column, minus the forward slash. The line looks like this: ... (2 Replies)
Discussion started by: wxornot
2 Replies

8. Shell Programming and Scripting

Parsing of file for Report Generation (String parsing and splitting)

Hey guys, I have this file generated by me... i want to create some HTML output from it. The problem is that i am really confused about how do I go about reading the file. The file is in the following format: TID1 Name1 ATime=xx AResult=yyy AExpected=yyy BTime=xx BResult=yyy... (8 Replies)
Discussion started by: umar.shaikh
8 Replies

9. Shell Programming and Scripting

Parsing string using specific delimiter

Hi, I'm wondering what is the best way to parse out a long string that has a specific deliminator and outputting each token between the delim on a newline? i.e. input text1,text2,text3,tex4 i.e. output text1 text2 text3 text4 (8 Replies)
Discussion started by: primp
8 Replies

10. Shell Programming and Scripting

Filename Patterns in mget

I was writing a shell script for FTPing files for a machine. now i am facing a problem in it. The problem is i want to ftp files which do not end with a particular pattern. The pattern is file should not end with .dd ( d=digit ) for eg: say i have files file file.01 file.02 ... (0 Replies)
Discussion started by: dipendra_g
0 Replies
Login or Register to Ask a Question