Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

File search variables

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting File search variables
# 15  
Old 12-19-2007
Quote:
Originally Posted by vgersh99
one lil change:
Code:
ftp -nv <<EOF
open ftpserver.com
user username password
mls "Daily_Generated_File_*" Filelisting.txt
get $(nawk -F_ -f bbb.awk Filelisting.txt | sort -k1n | cut -f2- | tail -1)
EOF

you want the wild-card expansion to happen on the REMOTE machine - not in the current working directory on the LOCAL machine.

Thanks for the update. Here's another change: Apparently the files that are generated are a day behind, so today's file 12-19-07 won't be available until 12-20-07. The script you so graciously gave me, will only look for today's file. How can the script be edited to look for yesterdays file? I'm assuming it would be in the

"get $(nawk -F_ -f bbb.awk Filelisting.txt | sort -k1n | cut -f2- | tail -1)"

That would have to change.

Thanks again.
# 16  
Old 12-20-2007
sort
Hi,
This one is a little difficult. But should work for you.

1> find . -name Daily_Generated_File_\*
---> find all the related file in current directory
2> sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'
---> since the file is in MM-DD-YY format, change it to YY-MM-DD format
3> sort -t -
---> sort the result with '-' as delimite
4> tail -1
---> get the last one which is the latest according to the date
5> sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'
---> change from 'YY-MM-DD' back to 'MM-DD-YY'

code:
Code:
find . -name Daily_Generated_File_\* |sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/' |sort -t - | tail -1 |sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'

# 17  
Old 12-20-2007
Quote:
Originally Posted by bbbngowc
Thanks for the update. Here's another change: Apparently the files that are generated are a day behind, so today's file 12-19-07 won't be available until 12-20-07. The script you so graciously gave me, will only look for today's file. How can the script be edited to look for yesterdays file? I'm assuming it would be in the

"get $(nawk -F_ -f bbb.awk Filelisting.txt | sort -k1n | cut -f2- | tail -1)"

That would have to change.

Thanks again.
The script 'gets' the LAST file (sorted by 'date'). If your file generation lags a day, then the 'last' available file will from yesterday (assuming files are generated on the daily bases with no gaps).
Unless I'm missing something obvious.....
Last edited by vgersh99; 12-20-2007 at 10:49 AM..
# 18  
Old 12-20-2007
Quote:
Originally Posted by vgersh99
The script 'gets' the LAST file (sorted by 'date'). If your file generation lags a day, then the 'last' available file will from yesterday (assuming files are generated on the daily bases with no gaps).
Unless I'm missing something obvious.....

You're right. But when I ran the script, it kept coming back with nothing found. Then it hit me "duh! if it's looking for today's file then..." so i changed the date on one of the files in the dir to todays file and ran the script again with the "echo" and it spit out the file with today's date.
# 19  
Old 12-20-2007
Hm..... I'm not sure if it's good or bad.....
There's nothing in the script that deals with either today OR yesterday.
As I said previously - the script gets the LAST file it finds (sorted by the 'date').
Not sure if everything is kosher now or not.........
# 20  
Old 01-23-2008
Quote:
Originally Posted by summer_cherry
Hi,
This one is a little difficult. But should work for you.

1> find . -name Daily_Generated_File_\*
---> find all the related file in current directory
2> sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'
---> since the file is in MM-DD-YY format, change it to YY-MM-DD format
3> sort -t -
---> sort the result with '-' as delimite
4> tail -1
---> get the last one which is the latest according to the date
5> sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'
---> change from 'YY-MM-DD' back to 'MM-DD-YY'

code:
Code:
find . -name Daily_Generated_File_\* |sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/' |sort -t - | tail -1 |sed 's/\(Daily_Generated_File_\)\([0-9][0-9]\)\(-[0-9][0-9]-\)\([0-9][0-9]\)\(.txt\)/\1\4\3\2\5/'



How does this work for me? This searches the current directory. I need something that will search a remote FTP Server. Not the local server.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read in search strings from text file, search for string in second text file and output to CSV

Hi guys, I have a text file named file1.txt that is formatted like this: 001 , ID , 20000 002 , Name , Brandon 003 , Phone_Number , 616-234-1999 004 , SSNumber , 234-23-234 005 , Model , Toyota 007 , Engine ,V8 008 , GPS , OFF and I have file2.txt formatted like this: ... (2 Replies)
Discussion started by: An0mander
2 Replies

2. Shell Programming and Scripting

Retrieving the relevant search from search file in the main file

I have two files: file 1: hello.com neo.com,japan.com,example.com news.net xyz.com, telecom.net, highlands.net, software.com example2.com earth.net, abc.gov.uk file 2: neo.com example.com abc.gov.uk file 2 are the search keys to search in file 1 if any of the search... (7 Replies)
Discussion started by: csim_mohan
7 Replies

3. Shell Programming and Scripting

Perl - use search keywords from array and search a file and print 3rd field when matched

Hi , I have been trying to write a perl script to do this job. But i am not able to achieve the desired result. Below is my code. my $current_value=12345; my @users=("bob","ben","tom","harry"); open DBLIST,"<","/var/tmp/DBinfo"; my @input = <DBLIST>; foreach (@users) { my... (11 Replies)
Discussion started by: chidori
11 Replies

4. Shell Programming and Scripting

awk search/replace specific field, using variables for regexp & subsitution then overwrite file

Hello, I'm trying the solve the following problem. I have a file which I intend to use as a csv called master.csv The columns are separated by commas. I want to change the text on a specific row in either column 3,4,5 or 6 from xxx to yyy depending upon if column 1 matches a specified pattern.... (3 Replies)
Discussion started by: cyphex
3 Replies

5. Shell Programming and Scripting

awk - ignore metacharacters, search shell variables

Can I use awk to search for a string, passed from the shell, that might include metacharacters? File1 entries: Bob Marley Jammin (Bonus Track).mp3 File2 entries: Bob Marley Jammin (Bonus Track).mp3 32000 /Music/Bob Marley/ Jammin (Bonus Track).mp3 So far, I have this; $ sed -e... (9 Replies)
Discussion started by: DSommers
9 Replies

6. UNIX for Advanced & Expert Users

use of variables in awk to search for pattern from a file

Hi, I need to extract all the content between two strings stored in two variables "startstring" and "endstring" startstring=hello enstring=world #notworking awk '/$startstring/, $NF ~ /$endstring/ ' file > file2 The above code is not working with variables. It works when actual string... (2 Replies)
Discussion started by: jeanjkj
2 Replies

7. Shell Programming and Scripting

Search between 2 variables

Hi Guys... can you tell me how to search between 2 variables ?... Im looking for a script that will move the data between varying words to separate files. I dont have my data on which I need to work right now... but it looks something like this.. start name1 data(a) data(b) stop name1 ... (6 Replies)
Discussion started by: R!C
6 Replies

8. HP-UX

Search environment variables for paths

Hi, I am using the HP machine at the moment and by default I have been setup with the kron shell i.e. my home profile is .kshrc I would like to access a program anywhere on the system so I have added a path and created an environment variable like this: export myvarpath=/a/abc/def/ghij... (3 Replies)
Discussion started by: cyberfrog
3 Replies

9. Shell Programming and Scripting

search and replace using awk with variables

Hi, I have been trying to use awk with variables that needs to search for a pattern and replace it with another pattern, the patterns are supplied in a variable. I have tried several different ways without success and hope that someone can help me. Here are the details echo $UPC 07007457809... (2 Replies)
Discussion started by: jerardfjay
2 Replies

10. Shell Programming and Scripting

Ksh script - Design ? - Search file and set variables

Hi - I'm trying to think of a clever way to write a shell script (trying to stay w/ ksh as that's what I know the best...) that will resolve the following problem: Problem - On a daily basis I have to email folks who are on-call to remind them. I was hoping to script this out so I could have... (9 Replies)
Discussion started by: littlefrog
9 Replies
Login or Register to Ask a Question