Read latest file name with a date and time and then download from FTP


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Read latest file name with a date and time and then download from FTP
# 1  
Old 07-24-2014
Read latest file name with a date and time and then download from FTP

Hi All,

Please help.

I have requirement to read the file / folder based on the latest date and download the file and folder.

There will be files and folders in the location like

20140630-144422
20140630-144422.csv
20140707-182653
20140707-182653.csv
20140710-183153
20140710-183153.csv
20140711-184040
20140711-184040.csv
20140715-185910
20140715-185910.csv
20140717-085017
20140717-085017.csv
20140719-121256
20140719-121256.csv

In the file list first number series before "-" is date and second number series is time.

I want to read latest file name with a date and time and then download it.

Thanks & regards
Praveen
# 2  
Old 07-24-2014
Not sure I understand your problem. Are respective file and folder named identically (except for the .csv extension)? Use ls | tail -2 or ls | sort -r | head -2.
This User Gave Thanks to RudiC For This Post:
# 3  
Old 07-25-2014
Hi Rudic,

Thanks for the reply. Respective file and folder names are always with date-time> So it will be always different.

Please advice.

Regards
Praveen

Last edited by Praveen Pandit; 07-25-2014 at 02:04 AM..
# 4  
Old 07-25-2014
If they are always different, why are the all the same in your example??? Why do you even have directories if all of your directories and *.csv files are all in a single directory?

Is "the location" on your system? Or, is it on a remote system?

Read the filenames from what?

Download it from where? Download it to where?
This User Gave Thanks to Don Cragun For This Post:
# 5  
Old 07-25-2014
Hi Don Cragun,

Thanks for your reply.

I am repasting the filenames
Code:
20140630-144422
20140630-144422.csv
20140707-182653
20140707-182653.csv

1. 20140630-144422 is a directory named after 30th June 2014 with a time at the end. Subsequently we have a input feed file as "20140630-144422.csv" for the same date.
2. Similarly 20140707-182653 is a directory named after 7th July 2014 with a time at the end. Subsequently we have a input feed file as "20140707-182653.csv" for the same date.

File and folder names are different because each one is identified by date and time. Each ".csv" file is accompanied with a directory with a same name.
Directory contains all images and the CSV file contains data which needs to be associated with the images. The provider puts data and the images daily.
Only the file with current date (time need not be checked) has to be pulled from the FTP location for processing.

I want to download the images from the latest directory and save it in the server under one path for example /websites/www.abc.com/images. And CSV has to be downloaded under another
path like "/root/dataprocess/abc".

Please help.

Regards
Praveen

Last edited by Praveen Pandit; 07-27-2014 at 03:44 AM.. Reason: Added code tags
# 6  
Old 07-26-2014
Please help. I am stuck Smilie
# 7  
Old 07-26-2014
This is totally untested, but if you want today's files, I think you want something like:
Code:
latest_dir=$(date "+%Y%M%D-*[0-9]")
host="put remote hostname here"
ftp <<<-EOF
	ftp $host
	cd /websites/www.abc.com/images
	lcd /root/dataprocess/abc
	mget "$latest_dir.csv" "$latest_dir/*"
EOF

This User Gave Thanks to Don Cragun For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Download latest file via ftp server unix through shell script

Hello this is my first post in this forum , I dont want to be unhappy.. I am writing one script but facing difficulty to find the latest file with some new pattern My requirement is 1. The file is coming like "ABCD-23220140303" at FTP server once in a week. 2. script will run on daily... (3 Replies)
Discussion started by: ajju
3 Replies

2. Shell Programming and Scripting

How to extract latest file by looking at date time stamp from a directory?

hi, i have a Archive directory in which files are archived or stored with date and time stamp to prevent over writing. example: there are 5 files s1.txt s2.txt s3.txt s4.txt s5.txt while moving these files to archive directory, date and time stamp is added. of format `date... (9 Replies)
Discussion started by: Little
9 Replies

3. Shell Programming and Scripting

Remove Duplicates on multiple Key Columns and get the Latest Record from Date/Time Column

Hi Experts , we have a CDC file where we need to get the latest record of the Key columns Key Columns will be CDC_FLAG and SRC_PMTN_I and fetch the latest record from the CDC_PRCS_TS Can we do it with a single awk command. Please help.... (3 Replies)
Discussion started by: vijaykodukula
3 Replies

4. UNIX for Advanced & Expert Users

Want to download a latest file with current date from FTP location

Dear Friends, I need help to write a shell / perl script to download the files from FTP location, having different file names (date inside the file name). Example: Mar 5 09:24 cfx_03052013_return_file.txt Mar 6 02:13 cfx_03062013_return_file.txt Mar 7 06:40... (3 Replies)
Discussion started by: Praveen Pandit
3 Replies

5. Shell Programming and Scripting

Grep the Content of a LOG File which has latest Date and Time

Hi All, Need a small help. I have a log file which keeps updating for every Minute with multiple number of lines. I just want to grep few properties which has latest Date and Time to it. How do i do it? I wanted to grep a property by name "Reloading cache with a maximum of" from the... (4 Replies)
Discussion started by: nvindraneel
4 Replies

6. Shell Programming and Scripting

How to FTP the latest file, based on date, from a remote server through a shell script?

How to FTP the latest file, based on date, from a remote server through a shell script? I have four files to be FTP'ed from remote server. They are of the following format. build1_runtime_mmddyyyy.txt build2_runtime_mmddyyyy.txt build3_runtime_mmddyyyy.txt buifile_count_mmddyyyy.txt ... (9 Replies)
Discussion started by: imran_affu
9 Replies

7. Shell Programming and Scripting

Question about how to ftp download the latest file from a directory

Dear all, Hope you are doing well. I am in trouble to write a shell for ftp downloading the latest file from remote server. Situation: There is a directory named 'weekly' which contains .csv files with the following pattern: RES_EN_100417-080003.csv.Z. The new file is generated... (3 Replies)
Discussion started by: kel1014
3 Replies

8. Shell Programming and Scripting

Same time ftp download in perl multiple sites.

I currently have a perl script that have to retreive a single file from 20+ sites every 10 min. Right now it will ftp to site1 and download and continue up until site20. I am trying to get this to run all the ftp d/l at the same time. This is where I have my problem, I can't get it to work. ... (5 Replies)
Discussion started by: kofs79
5 Replies

9. Shell Programming and Scripting

shell script to find latest date and time of the files

Hi everyone, Please help:) I have a list of 1000 different files which comes daily to the directory.Some of the files are not coming to the directory now. I need to write a shell script to find the latest date and time of the files they came to the directory. The files should be unique.... (1 Reply)
Discussion started by: karthicss
1 Replies

10. Shell Programming and Scripting

FTP - Get the file date and time on the remote server

I would like to know if there is a way to get the date and timestamp of the file that is being FTP from the remote server using shell script. Currently the get command from FTP will have current date and timestamp. Tried the earlier suggestion 'HardFeed' but still getting the current date and time... (12 Replies)
Discussion started by: gthokala
12 Replies
Login or Register to Ask a Question