Identifying missing file dates Post: 302996903

Sponsored Content

Top Forums Shell Programming and Scripting Identifying missing file dates Post 302996903 by nalu on Thursday 4th of May 2017 04:59:00 AM

05-04-2017

Registered User

Hi Rudic,
I have explained the requirement with expected result.
My requirement:
I want to find the missing files based on the date in the file name from current date to in a given interval of days.

Code:

 
 Case1 : Want to find missing files in 10 days with one date in the file name.
For example:
I have the below files in the directory /bin/daily/dtefiles
jera_sit_2017-04-24-150325.txt
jera_sit_2017-04-25-150325.txt
jera_sit_2017-04-26-141232.txt
jera_sit_2017-04-29-122344.txt
jera_sit_2017-05-02-122344.txt
jera_sit_2017-05-03-122344.txt
 In this case the missing files are for the dates 2017-04-27,2017-04-28,2017-04-30,2017-05-01.

The script I posted is working fine for case1.

Code:

 
 Case2:Want to find missing files in 10 days with more than one date in the file name.
For example:
I have the below files in the directory /bin/daily/msn_files
jera_msn_2017-04-28-150325_2017-04-29-112227_2017-04-29-112227.txt
jera_msn_2017-04-24-150325_2017-04-24-112227_2017-04-25-112227.txt
jera_msn_2017-04-24-150325_2017-04-26-112227_2017-04-26-112227.txt
jera_msn_2017-04-25-150325_2017-04-26-112227_2017-04-27-112227.txt
jera_msn_2017-04-30-150325_2017-04-30-112227_2017-05-01-112227.txt

In the above files names we have more than one date. It should consider only last date in the file name.
It should not consider other dates.
In this case the missing files are for the dates 2017-04-24,2017-04-28,2017-04-30,2017-05-02.
My script is not working for case2 .

Code:

 
 For case 1 Parameter values are.
file_path=/bin/daily/dtefiles
file_format=XXXX_XXX_YYYY-MM-DD-HHIISS.TXT
check_mode=1
back_days_hr_min_hr_min=10
 For case 2 Parameter values are.
file_path=/bin/daily/dtefiles
file_format=XXXX_XXX_XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX_YYYY-MM-DD-HHIISS.TXT
check_mode=1
back_days_hr_min_hr_min=10

Please help me.
Thanks in advance.

Last edited by nalu; 05-04-2017 at 06:04 AM..

nalu

View Public Profile for nalu

Find all posts by nalu

10 More Discussions You Might Find Interesting

1. Programming

Identifying and removing control characters in a file.

What is the best method to identify an remove control characters in a file. Would it be easier to do this in Unix or in C.

2. Shell Programming and Scripting

identifying null values in a file

I have a huge file with 20 fileds in each record and each field is seperated by "|". If i want to get all the reocrds that have 18th or for that matter any filed as null how can i do it? Please let me know

3. Shell Programming and Scripting

Problem identifying charset of a file

Hi all, My objective is to find out the charset using which a file is encoded. (The OS is SunOs) I have set NLS_LANG to AR8MSWIN1256 and spooled the file. When viewed the file using vi, I saw the following \307\341\321\355\307\326 I then inserted the line containing these codes in a...

4. Shell Programming and Scripting

Identifying suffixes in a file and printing them out

Hello, I am interested in finding and identifying suffixes for Indian names through an awk script or a perl program. Suffixes normally are found at the end of a word as is shown in the sample given below. What I need is a perl script which will identify suffixes of a defined lenght to be given in...

5. UNIX for Dummies Questions & Answers

How to write the dates between 2 dates into a file

Hi All, I am trying to print the dates that falls between 2 date variables into a file. Here is the example. $BUS_DATE =20120616 $SUB_DATE=20120613 Output to file abc.txt should be : 20120613,20120614,120120615,20120616 Can you pls help me accomplish this in LINUX. Thanks...

6. Shell Programming and Scripting

Identifying the file completion

Hi, A script is running for multiple databases so data is also being populated for multiple DBs in a.txt file. I need to rename this file once all the data is populated. Kindly suggest me How can I check once file is populated completely before renaming? Thanks in advance.

7. UNIX for Advanced & Expert Users

How to get the Missing dates between two dates in the table?

Hi Am Using Unix Ksh ... I have a Table called date select * from date ; Date 01/02/2013 06/02/2013 I need the output as Missing Date 01/02/2013 02/02/2013 03/02/2013 04/02/2013 05/02/2013 06/02/2013

8. Shell Programming and Scripting

Identifying presence and name of new file(s)?

I have an HP-UX server that runs a script each night. The script connects to an SFTP server and downloads all xml files (if any are present) from a certain folder, and then deletes the files from the SFTP server. So sometimes it will download a new file, sometimes it will download 2 or 3 new...

9. Programming

Identifying a missing primary key

I have the following method to identify missing primary keys in a MySQL database schema: USE information_schema; SELECT xx.table_name FROM (SELECT table_name, COUNT(*) FROM columns WHERE table_schema = @myDB GROUP BY table_name, column_key) xx GROUP BY xx.table_name HAVING COUNT(*) = 1; I...

10. Shell Programming and Scripting

Identifying Missing File Sequence

Hi, I have a file which contains few columns and the first column has the file names, and I would like to identify the missing file sequence number form the file and would copy to another file. My files has data in below format. APKRISPSIN320131231201319_0983,1,54,125,...

LEARN ABOUT REDHAT

dp

DP(8)                                                                [nmh-1.5]                                                               DP(8)

NAME

       dp - parse dates 822-style

SYNOPSIS

       /usr/lib/mh/dp [-form formatfile] [-format string] [-width columns] [-version] [-help] dates ...

DESCRIPTION

       Dp  is  a  program that parses dates according to the ARPA Internet standard.  It also understands many non-standard formats, such as those
       produced by TOPS-20 sites and some UNIX sites using ctime(3).  It is useful for seeing how nmh will interpret a date.

       The dp program treats each argument as a single date, and prints the date out in the official 822-format.  Hence, it  is  usually  best  to
       enclose each argument in quotes for the shell.

       To  override  the  output  format  used by dp, the -format string or -format file switches are used.  This permits individual fields of the
       address to be extracted with ease.  The string is simply a format string and the file is simply a format file.  See  mh-format(5)  for  the
       details.

       Here is the default format string used by dp:

            %<(nodate{text})error: %{text}%|%(putstr(pretty{text}))%>

       which  says  that  if an error was detected, print the error, a `:', and the date in error.  Otherwise, output the 822-proper format of the
       date.

FILES

       $HOME/.mh_profile          The user profile

PROFILE COMPONENTS

       None

SEE ALSO

       ap(8), Standard for the Format of ARPA Internet Text Messages (RFC-822)

DEFAULTS

       `-format' default as described above
       `-width' default to the width of the terminal

CONTEXT

       None

BUGS

       The argument to the -format switch must be interpreted as a single token by the shell that invokes dp.  Therefore, one must  usually  place
       the argument to this switch inside quotes.

MH.6.8                                                             11 June 2012                                                              DP(8)

10 More Discussions You Might Find Interesting

1. Programming

Identifying and removing control characters in a file.

Discussion started by: oracle8

2. Shell Programming and Scripting

identifying null values in a file

Discussion started by: dsravan

3. Shell Programming and Scripting

Problem identifying charset of a file

Discussion started by: sridhar_423

4. Shell Programming and Scripting

Identifying suffixes in a file and printing them out

Discussion started by: gimley

5. UNIX for Dummies Questions & Answers

How to write the dates between 2 dates into a file

Discussion started by: dsfreddie

6. Shell Programming and Scripting

Identifying the file completion

Discussion started by: ravigupta2u

7. UNIX for Advanced & Expert Users

How to get the Missing dates between two dates in the table?

Discussion started by: Venkatesh1

8. Shell Programming and Scripting

Identifying presence and name of new file(s)?

Discussion started by: lupin..the..3rd

9. Programming

Identifying a missing primary key

Discussion started by: figaro

10. Shell Programming and Scripting

Identifying Missing File Sequence

Discussion started by: rramkrishnas

LEARN ABOUT REDHAT

dp