Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

FTP search ,grep using perl

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting FTP search ,grep using perl
# 43  
Old 04-26-2013
Below example for unix which i want in perl and embeded in the existing script.
I dont need modified time.

Code:
cp filename filename.`date`

I run this script everyday once . whenever i run it should create a backup with timestamp. Then i want yesterday and today file difference and see if there is any update .
# 44  
Old 04-26-2013
How is one to tell if there's any file difference without downloading them? Even identically-sized files could be different... Why not just download them no matter what?
# 45  
Old 04-26-2013
There are 13000 files for 2013 year folder and there are 30 years back mean 30 folders . Downloading all files for all years are taking almost 24 hours ..which we want to reduce the time .


By doing this we are checking previous day and current day and see if there are any updates . if so download only those files which has update.

The script which you have written is actually not downloading the files rather getting the files list, size ,mtime into an output file which is much easier.
then everyday once we run we get the list ...then compare 2 files and see if there is any update .
# 46  
Old 04-26-2013
But you copy them every day... They will change every day.
# 47  
Old 04-26-2013
My mission is to get yesterday and today file comparision and get the update .

Please suggest me the best approach.

My way of thinking was to get get output.log to cp to output.log.yesterday
then
compare output.log.yesterday output.log
Last edited by ajayram_arya; 04-26-2013 at 05:05 PM..
# 48  
Old 04-26-2013
You pretty much need the mtime, I think, and I can't test that since my FTP server doesn't have that.

I really don't think FTP is appropriate for this kind of automatic checking... There are so many little special one-off cases where an update will be missed... File the same size, time resolution too large, that sort of thing. And it'd depend on having the right kind of ftp server, the cooperative kind that gives you mtime in the readout.

Is it possible to change how files are uploaded, so that new files don't overwrite the old? Or move away files that have already been downloaded, so that you can tell when it's uploaded again? Then you would know a file had been uploaded, not just guess so, and wouldn't miss any updates.
# 49  
Old 04-26-2013
Corona688

We are not doing anything on the FTP server . I would need everything on the local server to see the diff..

Any way . Is there a way i can create a copy of the log file in the existing script.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to use a grep search to search for a specific string within multiple directories?

Lets say I have a massive directory which is filled with other directories all filled with different c++ scripts and I want a listing of all the scripts that contain the string: "this string". Is there a way to use a grep search for that? I tried: grep -lr "this string" * but I do not... (3 Replies)
Discussion started by: Circuits
3 Replies

2. UNIX for Beginners Questions & Answers

Grep/awk using a begin search pattern and end search pattern

I have this fileA TEST FILE ABC this file contains ABC; TEST FILE DGHT this file contains DGHT; TEST FILE 123 this file contains ABC, this file contains DEF, this file contains XYZ, this file contains KLM ; I want to have a fileZ that has only (begin search pattern for will be... (2 Replies)
Discussion started by: vbabz
2 Replies

3. Shell Programming and Scripting

Perl - start search by using search button or by pressing the enter key

#Build label and text box $main->Label( -text => "Input string below:" )->pack(); $main->Entry( -textvariable => \$text456 )->pack(); $main->Button( -text => "Search", -command => sub { errchk ($text456) ... (4 Replies)
Discussion started by: popeye
4 Replies

4. Shell Programming and Scripting

Perl - use search keywords from array and search a file and print 3rd field when matched

Hi , I have been trying to write a perl script to do this job. But i am not able to achieve the desired result. Below is my code. my $current_value=12345; my @users=("bob","ben","tom","harry"); open DBLIST,"<","/var/tmp/DBinfo"; my @input = <DBLIST>; foreach (@users) { my... (11 Replies)
Discussion started by: chidori
11 Replies

5. HP-UX

[Solved] Unable to rename file in ftp server .Net:FTP perl

Hello All, I am trying to connect to ftp server and get the files. Also i need to rename the file in other ftp dir. rename method is not allowing me to rename the file in other dir. When i tried copy command by using net::FTP:FILE then perl says it is not installed. Can some body help me to... (2 Replies)
Discussion started by: krsnadasa
2 Replies

6. UNIX for Dummies Questions & Answers

recursive search and ftp

Could someone help me in recursive search and ftp'ing the files to remote server? The host machine will have /dir1/dira/list_of_files1 /dir1/dirb/list_of_files2 /dir1/dirc/list_of_files3 . . . so., I need to search from dir1 recursively (only one level down) and find all the files that... (1 Reply)
Discussion started by: brahmi
1 Replies

7. Shell Programming and Scripting

perl search and replace - search in first line and replance in 2nd line

Dear All, i want to search particular string and want to replance next line value. following is the test file. search string is tmp,??? ,10:1 "???" may contain any 3 character it should remain the same and next line replace with ,10:50 tmp,123 --- if match tmp,??? then... (3 Replies)
Discussion started by: arvindng
3 Replies

8. Shell Programming and Scripting

Perl: Search for string on line then search and replace text

Hi All, I have a file that I need to be able to find a pattern match on a line, search that line for a text pattern, and replace that text. An example of 4 lines in my file is: 1. MatchText_randomNumberOfText moreData ReplaceMe moreData 2. MatchText_randomNumberOfText moreData moreData... (4 Replies)
Discussion started by: Crypto
4 Replies

9. Shell Programming and Scripting

using finddepth in ftp to search for directories in perl

Hi all, I have script which downloads the build and copies onto the local machine I am able to download files in a directory, but unable to get the files in subdierctories. I am using finddepth to search for sub directories but I am unable to do so. Here is my code: ... (0 Replies)
Discussion started by: gurukottur
0 Replies
Login or Register to Ask a Question