"Need Help in reading N days files from a Directory & combining the files"

Post #302586180 by dsfreddie on Friday 30th of December 2011 11:24:24 AM

Need Help in reading N days files from a Directory & combining the files

Hi All,

Request your expertise in tackling one requirement in my project,(i dont have much expertise in Shell Scripting). The requirement is as below,

1) We store the last run date of a process in a file. When the batch run the next time, it should read this file, get the last run date from the file. Using this date, the script should read all the files from the Directory that falls between Current Date & previous run date (the date we got from file) & combine it into one Single file for further processing.

Any help/thoughts on how to accomplish this through Shell Script/multiple commands will be highly appreciated.

Thanks in Advance,
Freddie
 
Test Your Knowledge in Computers #737
Difficulty: Medium
In 1979, the TRS-80 had the largest selection of software in the microcomputer market.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing files automatically from a directory after 30 days.

Hello; I have a directory that is collecting log and act files. I need to write a script that will remove these files once they are 30 days old. I have read through a number of threads on this site that have given me a great deal of information. However I have what seems to be a unique... (7 Replies)
Discussion started by: justinb_155
7 Replies

2. Shell Programming and Scripting

Searching for files over 30 days old in current directory

May be a simple question for experts here.... I need to get the list of files older than 30 days in the current folder. I tried "find", but it searches recursively in all the sub directories. Can I restrict the recursive search and extract the files only from current directory ? (18 Replies)
Discussion started by: cxredd4
18 Replies

3. Shell Programming and Scripting

ls latest 4 days or specify days of files in the directory

Hi, I would like to list latest 2 days, 3 days or 4 days,etc of files in the directory... how? is it using ls? (3 Replies)
Discussion started by: happyv
3 Replies

4. Shell Programming and Scripting

Delete files older than 10 Days in a directory

Hi All I want to remove the files with name like data*.csv from the directory older than 10 days. If there is no files exists to remove older than 10 days, It should not do anything. Thanks Jo (9 Replies)
Discussion started by: rajeshjohney
9 Replies

5. UNIX for Dummies Questions & Answers

Reading the dates from a file & moving the files from a directory

Hi All, I am coding for a requirement where I need to read a file & get the values of SUB_DATE. Once the dates are found, i need to move the files based on these dates from one directory to another. ie, this is how it will be in the file, SUB_DATE = 20120608,20120607,20120606,20120606... (5 Replies)
Discussion started by: dsfreddie
5 Replies

6. AIX

Want to delete directory, subdirectories and all files which are older than 7 days

how do i remove sub directories of a directory and all files which are older than 7 days by a single command in AIX. pls help me. I am using command as #find /gpfs1/home/vinod/hpc/ -depth -type d -mtime +7 -exec rm -rf {} \; so i want to delete all sub directories and all files from the... (1 Reply)
Discussion started by: vinodkmpal
1 Replies

7. UNIX Desktop Questions & Answers

Combining files with specific patterns of naming in a directory

Greetings Unix exports, I am facing some problems in combining files with different name patterns with a directory and I would appreciate if you can help me I have more than 1000 files but they follow a specific pattern of naming. e.g. 64Xtest01.txt They are divided into two sets of test and... (9 Replies)
Discussion started by: A-V
9 Replies

8. Shell Programming and Scripting

How to clean 3 days before files, from a directory?

I have a Solaris System. I am using bash shell. I want to prepare a script which can do the below. There are few directories i need to clean. In those directories, I need to delete files which are older than 3 days. 3 days before files need to be deleted. The directories are as follows.... (7 Replies)
Discussion started by: Saidul
7 Replies

9. Shell Programming and Scripting

Compressing & removing files in a directory & subdirectory

Hi, I want a simple line of code that will compress files within a directory specified (parameter) and its subdirectories and also i want to remove files which are exactly 365 days old from the sysdate after this compression. Please help. Thanks, JD (8 Replies)
Discussion started by: Jesshelle David
8 Replies

10. Linux

Finding files older than x days within directory with spaces

Hi, I am trying to run a command that finds all files over x amount of days, issue is one of the directories has spaces within it. find /files/target directory/*/* -type f -mtime +60 When running the above the usual error message is thrown back + find '/files/target\' 'directory/*/*' -type... (1 Reply)
Discussion started by: Ads89
1 Replies
TV_GRAB_COMBINER(1p)					User Contributed Perl Documentation				      TV_GRAB_COMBINER(1p)

NAME
tv_grab_combiner - Grab listings by combining data from several grabbers. SYNOPSIS
tv_grab_combiner --help tv_grab_combiner --configure [--config-file FILE] tv_grab_combiner [--config-file FILE] [--days N] [--offset N] [--output FILE] [--quiet] DESCRIPTION
Output TV and listings in XMLTV format by combining data from several other grabbers. First you must run tv_grab_combiner --configure to choose which grabbers you want to grab data with and how these grabbers should be configured. Then you can run tv_grab_combiner with the --days and --offset options to grab data. Omitting these options will use the default values for these parameters for each grabber. Since these defaults differs between grabbers, you might end up with data for different periods of time for different channels. OPTIONS
--configure Prompt for which grabbers to use, how these grabbers shall be configured and write the configuration file. --config-file FILE Set the name of the configuration file, the default is ~/.xmltv/tv_grab_combiner.conf. This is the file written by --configure and read when grabbing. --output FILE When grabbing, write output to FILE rather than standard output. --days N When grabbing, grab N days rather than 5. --offset N Start grabbing at today + N days. N may be negative. --quiet Suppress the progress-bar normally shown on standard error. --version Show the version of the grabber. --help Print a help message and exit. ERROR HANDLING
If any of the called grabbers exit with an error, tv_grab_combiner will exit with a status code of 1 to indicate that the data is incomplete. If any grabber produces output that is not well-formed xml, the output from that grabber will be ignored and tv_grab_combiner will exit with a status code of 1. ENVIRONMENT VARIABLES
The environment variable HOME can be set to change where configuration files are stored. All configuration is stored in $HOME/.xmltv/. AUTHOR
Mattias Holmlund, mattias -at- holmlund -dot- se. BUGS
perl v5.14.2 2012-06-13 TV_GRAB_COMBINER(1p)

Featured Tech Videos

All times are GMT -4. The time now is 05:59 PM.
Unix & Linux Forums Content Copyright 1993-2019. All Rights Reserved.
Privacy Policy