Sort files by Date-timestamps available in filename & pick the sortedfiles one by one Post: 302078709

Sponsored Content

Top Forums Shell Programming and Scripting Sort files by Date-timestamps available in filename & pick the sortedfiles one by one Post 302078709 by Chindhu on Tuesday 4th of July 2006 06:12:46 AM

07-04-2006

Registered User

Sort files by Date-timestamps available in filename & pick the sortedfiles one by one

Hi,

I am new to Unix shell scripting. Can you please help me with this immediate requirement to code.. The requirement is as given below.

In a directory say Y, I have files like this.

PP_100000_28062006_122731_746.dat
PP_100000_28062006_122731_745.dat
PP_100000_28062006_122734_745.dat
PP_100000_28062006_122732_745.dat
PP_100000_28062006_122801_745.dat

QQ_100001_28062006_122733_745.dat
QQ_100001_28062006_122731_745.dat

RR_100002_28062006_122731_745.dat
RR_100002_28062006_122732_745.dat
RR_100002_28062006_122729_745.dat

format: <type>_<somesequence>_DDMMYYYY_HHMMSS_<organisationID>

Now, I will have an input parameter coming in as 'Directory path' (path to Y) and type (can be PP, QQ or RR. If type is NULL, means I need to process all the 3 types)

Assuming we get type as PP

Now I need to pick up files of this type. We can see there are 5 files matching this string.
Now, I need to check the date and time stamp as available in the file names (and not the unix system date timestamp), compare it, and pick up the file with the lowest date timestamp in its name, first - and process it.
As you see I have 2 files with same timestamp here - PP_100000_28062006_122731_746.dat and PP_100000_28062006_122731_745.dat. In this case I have to process it in ascending order of <organisationID>. ie, PP_100000_28062006_122731_745.dat first, followed by PP_100000_28062006_122731_746.dat

Once processed, I have to pick the next lowest date time stamp file for processing.

I will be archiving successfully processed files in another directory, and renaming failed files to say FAILED (suffix) so that it wont be picked up again.

Any sample code/ pointers/ suggestions would be of great help.

Thanks a lot in advance,
Chindhu

Chindhu

View Public Profile for Chindhu

Find all posts by Chindhu

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sort & match multiple files

Hi, I have some question and need some guidance how to sort and match multiple files. 1. all the data in the files are numbers e.g. 1234567 1584752 2563156 2. each sorted file have their own ouput. e.g. test.csv -> test_sorted.csv 3. Then, I need to match all...

2. Shell Programming and Scripting

Getting all the .gz files between Two Date/TimeStamps

Hi, I am trying to write a script to ftp and get all the files between two date/time stamps from a archive directory. I have sent an attatchment of my archive directory. With the script I intend to get files for ex: between request.log.2008-08-22-03-53-49.gz &...

3. UNIX for Dummies Questions & Answers

Adding Date & time stamps to filename

I need to edit the file name with date and time while writing the script. please help.

4. UNIX for Dummies Questions & Answers

sort files by numeric filename

dear all, i have .dat files named as: 34.dat 2.dat 16.dat 107.dat i would like to sort them by their filenames as: 2.dat 16.dat 34.dat 107.dat i have tried numerous combinations of sort and ls command (in vain) to obtain : 107.dat 16.dat 2.dat 34.dat

5. Shell Programming and Scripting

Sort files by date in filename

Hi, I am a newbie to shell programming and I need some help in sorting a list of files in ascending order of date in the filenames. The file format is always : IGL01_AC_D_<YYYYMMDD>_N01_01 For example, in a directory MyDirectory I have the following files: IGL01_AC_D_20110712_N01_01.dat...

6. Shell Programming and Scripting

URGENT!!! bash script to sort files into folder according to a string in the filename

Hi all. I am very new to linux scripting and i have a task i can only solve with a script. I need to sort files base on the date string in their filenames and create a folder using the same date string then move the files to their respective folders. Scenario: Folder Path:...

7. Shell Programming and Scripting

Bash script to sort files into folder according to a string in the filename

8. Shell Programming and Scripting

Sort log files based on numeric value in the filename

Hi, I have a list of log files as follows: name_date_0001_ID0.log name_date_0001_ID2.log name_date_0001_ID1.log name_date_0002_ID2.log name_date_0004_ID0.log name_date_0005_ID0.log name_date_0021_ID0.log name_date_0025_ID0.log ..........................................

9. Shell Programming and Scripting

[Solved] Modifying/Removing Timestamps from a filename

So given filenames of varying lengths, I was wondering how I would remove or modify appended timestamps of the current date DD-MM-YY. So say: test_DD-MM-YY.txt coolbeans_DD-MM-YY.pdf And what I expect the output to be: test.txt coolbeans.pdf Thanks :)

10. Shell Programming and Scripting

How to list files that are not first two files date & last file date for every month-year?

Hi All, I need to find all files other than first two files dates & last file date for month and month/year wise list. lets say there are following files in directory Mar 19 2012 c.txt Mar 19 2012 cc.txt Mar 21 2012 d.txt Mar 22 2012 f.txt Mar 24 2012 h.txt Mar 25 2012 w.txt Feb 12...

LEARN ABOUT DEBIAN

sdpa

SDPA(1) 						      General Commands Manual							   SDPA(1)

NAME

       SDPA - High-performance software package for SemiDefinite Programs

SYNOPSIS

       sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads  numThreads]
       sdpa [options] files...
       sdpa --version

DESCRIPTION

       sdpa  - "SDPA (SemiDefinite Programming Algorithm)" is one of the most efficient and stable software packages for solving SDPs based on the
       primal-dual interior-point method.

       SDP (SemiDefinite Program) is used for financial engineering, machine learning, control theory, sensor network problem, quantum	chemistry,
       quantum information, combinatorial optimizaiton, polynomial optimization, and so on.

       Futher information on SDP and SDPA can be found at
       http://sdpa.sourceforge.net/

OPTIONS

       ---- option type 1 ----
       sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads numThreads]
       parameters = 0 default, 1 fast (unstable), 2 slow (stable)
       example1-1: sdpa example1.dat example1.result
       example1-2: sdpa example1.dat-s example1.result
       example1-3: sdpa example1.dat example1.result example1.ini
       example1-4: sdpa example1.dat example1.result -pt 2
       example1-5: sdpa example1.dat example1.result -dimacs
       example1-6: sdpa example1.dat example1.result -numThreads 4
       ---- option type 2 ----
       sdpa [option filename]+
	 -dd : data dense :: -ds : data sparse
	 -id : init dense :: -is : init sparse
	 -o  : output	  :: -p  : parameter
	 -pt : parameters , 0 default, 1 fast (unstable)
			    2 slow (stable)
       example2-1: sdpa -o example1.result -dd example1.dat
       example2-2: sdpa -ds example1.dat-s -o example1.result -p param.sdpa
       example2-3: sdpa -ds example1.dat-s -o example1.result -pt 2
       example2-4: sdpa -ds example1.dat-s -o example1.result -dimacs
       example2-5: sdpa -ds example1.dat-s -o example1.result -numThreads 4
       ---- option type 3 ----
       sdpa --version
       to print out version and exit.

       PARAMETER_FILE
	      is decided by the following priority
		 1: The file assigned by '-p' option of 'option type 2'.
		     For 'option type1', this is skipped.
		 2: ./param.sdpa
		     For 'option type2', this is skipped.
		 3: /usr/share/sdpa/param.sdpa
		 4: Default parameter

       -dimacs
	      printout dimacs information incurring additional computation cost

       -numThreads
	      number of pthreads for internal computation

AUTHOR

       SDPA was written by SDPA Project <sdpa-developers@lists.sourceforge.net>.

       This manual page was written by Makoto Yamashita <Makoto.Yamashita@is.titech.ac.jp>.

								   July 28, 2011							   SDPA(1)