Sponsored Content
Top Forums Shell Programming and Scripting pull range of dates/times and put into new file Post 302402045 by methyl on Monday 8th of March 2010 06:34:41 PM
Old 03-08-2010
Please post "ls -la" directory listing of one of the files mentioned. This is to clarify the exact format of modified date and time stamp.

Please state whether the directory containing the files has subdirectories.

Please state approximately how many files there are in the directory.

Please post your Operating System and preferred shell (e.g. bash, ksh, etc.).

There are two common approaches to selecting all files between two dates. One involves using extensions to the "date" command in Linux to convert a character date into a binary date suitable for comparison. Another more portable unix/Linux solution involves creating temporary reference files with specific timestamps and using unix "find" (or even shell file timestamp comparison commands) to decide which files fall between the range.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Display dates within a given date range

Hi All, I have a requirement to display all the dates within the provided (through user input) date range. For eg: If I enter 28012009 (as From date in the format 'DDMMYYYY') and 02022009(as To date in the format 'DDMMYYYY'), the output should be all dates occuring between the from and to... (11 Replies)
Discussion started by: sunpraveen
11 Replies

2. Shell Programming and Scripting

How do I pull a substring out of a file?

I'm new to shell scripting and am trying to write a small script that pulls a substring out of a file that has a few lines of text in it. The file will eventually have a lot of text, I just put a few lines in it for testing purposes. Anyway, this is what I have so far... #!/bin/ksh ... (4 Replies)
Discussion started by: enator45
4 Replies

3. Shell Programming and Scripting

Pull log between two dates.

Hi, I am trying to pull out lines from logs between two dates, the logs has lines like this : conn=552 op=3 msgId=17228 - RESULT err=0 tag=97 nentries=0 etime=0 dn="cn=amldapuser,ou=dsame u sers,dc=abc,dc=com" conn=553 op=-1 msgId=-1 - fd=34 slot=34 LDAP connection from 52.99.164.14 to... (4 Replies)
Discussion started by: john_prince
4 Replies

4. Shell Programming and Scripting

How pull the Data from the file and should be mailed

Hi All, I need to pull the data from a file from 2 set of directories & should be mailed. I have a code , it is failing for some reason. Do somebody correct me where my script is going wrong. Directories: 1st Set of Directory /176_PS/Transactions/**/syslog.log ** : prd1 prd2... (2 Replies)
Discussion started by: raghunsi
2 Replies

5. Shell Programming and Scripting

Using 'date' to list a range of dates

Hi guys, I have been trying to create a list of dates from a certain range, ie. range from 01011950 to 31122000 But when my below code reaches certain dates, it comes up with a; 'date: invalid date 'yyyy-mm-dd -d 1day' Sofar I have come up with the following, slow and ugly; ... (4 Replies)
Discussion started by: TAPE
4 Replies

6. Shell Programming and Scripting

How to put date range from a perl & sql script

Hi Guys, Can someone please help me on adding/inserting a variable date to an sql scipt? Basically I want to assign a 7 days date range. As shown below.. #!/usr/bin/perl use strict; use Env qw(ORACLE_HOME); my $SQLPLUS='/opt/oracle/product/10.1.0/db_1/bin/sqlplus -S... (1 Reply)
Discussion started by: pinpe
1 Replies

7. Shell Programming and Scripting

Trying to pull a variable out of an xml file...

Hello. I'm new to *ix and am trying to pull a variable or two from an xml document. The document is in the format: <name>7_3(A).mov</name> <description>Some description from a file</description> <updatename>7_3_A.mov</updatename> <updatepath>Dailies Released</updatepath> ... (3 Replies)
Discussion started by: Renfield
3 Replies

8. Emergency UNIX and Linux Support

show div on select - range of dates

Hi, I am sure this is simple, but I am breaking my head. I need 1 page with at the top a range of dates, 2002, 2003, 2004 etc If you select 2002 it will show the content of 1 div, if you select 2002 the content of another div. this is for showing announcements on a site, right now there... (1 Reply)
Discussion started by: lawstudent
1 Replies

9. UNIX for Dummies Questions & Answers

How to write the dates between 2 dates into a file

Hi All, I am trying to print the dates that falls between 2 date variables into a file. Here is the example. $BUS_DATE =20120616 $SUB_DATE=20120613 Output to file abc.txt should be : 20120613,20120614,120120615,20120616 Can you pls help me accomplish this in LINUX. Thanks... (5 Replies)
Discussion started by: dsfreddie
5 Replies

10. Shell Programming and Scripting

Display data from a range of dates

I have a data in a file called SCHED which has 5 columns: sched no, date, time, place and remarks. The image is shown below. http://dl.dropbox.com/u/54949888/Screenshot%20from%202013-01-02%2002%3A42%3A25.png Now, I want to display only the schedules which fall under a certain date range which... (2 Replies)
Discussion started by: angilulu
2 Replies
tcpslice(8)						      System Manager's Manual						       tcpslice(8)

NAME
tcpslice - Extracts sections of or merges tcpdump files SYNOPSIS
/usr/sbin/tcpslice [-dRrt] [-w file] [start-time [end-time]] file... OPTIONS
Dumps the start and end times specified by the given range and exits. This option is useful for checking that the given range actually specifies the times you think it does. If the -R, -r, or -t option has been specified, the times are dumped in the corresponding format; otherwise, raw format (-R) is used. Dumps the timestamps of the first and last packets in each input file as raw timestamps in the form sssssssss.uuuuuu. This option can not be specified in conjunction with the -r or -t option. Same as the -R option except the timestamps are dumped in human-readable format, similar to that used by the date(1) command. This option cannot be specified in conjunction with the -R or -t options. Same as the -R option except the timestamps are dumped in tcpslice format, in the ymdhmsu format. See the DESCRIPTION section. This option cannot be specified in conjunction with the -R or -r option. Directs the output to file rather than stdout. DESCRIPTION
The tcpslice program extracts portions of packet-trace files generated using the tcpdump -w command. It can also be used to concatenate files. The tcpslice command copies to stdout all packets from its input file(s) whose timestamps fall within a given range. The starting and end- ing times of the range may be specified on the command line. All ranges are inclusive. The starting time defaults to the time of the first packet in the first input file; this is called the first time. The ending time defaults to ten years after the starting time. Thus, the command tcpslice trace-file copies trace-file to stdout (assuming the file does not include more than ten years' worth of data). There are a number of ways to specify times. The first is using UNIX timestamps of the form sssssssss.uuuuuu (the format specified by the tcpdump -tt command). For example, 654321098.7654 specifies 38 seconds and 765,400 microseconds after 8:51PM PDT, Sept. 25, 1990. The examples in this reference page use Pacific Daylight Time (PDT); however, when displaying times and interpreting times symbolically (as shown in this reference page), tcpslice uses the local time zone, regardless of the time zone in which the tcpdump file was generated. The daylight saving setting used is that which is appropriate for the local time zone at the date in question. For example, times associated with summer months will usually include daylight saving effects, and those with winter months will not. Times may also be specified relative to either the first time (when specifying a starting time) or the starting time (when specifying an ending time) by preceding a numeric value in seconds with a plus sign (+). For example, a starting time of +200 indicates 200 seconds after the first time, and the two arguments +200 +300 indicate from 200 seconds after the first time through 500 seconds after the first time. Times may also be specified in terms of years (y), months (m), days (d), hours (h), minutes (m), seconds (s), and microseconds(u). For example, the UNIX timestamp 654321098.7654 discussed earlier could also be expressed as follows: 1990y9m25d20h51m38s765400u When specifying times using this style, fields that are omitted default as follows: If the omitted field is a unit greater than that of the first specified field, its value defaults to the corresponding value taken from either first time (if the starting time is being specified) or the starting time (if the ending time is being specified). If the omitted field is a unit less than that of the first specified field, then it defaults to zero. For example, suppose the input file has a first time of the UNIX timestamp mentioned previously (38 seconds and 765,400 microseconds after 8:51 PM PDT, September 25, 1990). The following example specifies 9:36 PM PDT on the same date: 21h36m The following example specifies a range from 9:36 PM PDT through 1:54 AM PDT the next day: 21h36m 26d1h54m Relative times can also be specified when using the ymdhmsu format. Omitted fields then default to zero (0) if the unit of the field is greater than that of the first specified field, and to the corresponding value taken from either the first time or the starting time if the omitted field's unit is less than that of the first specified field. Using the first time of the UNIX timestamp mentioned previously, the following example specifies a range from 10:00 PM PDT on that date through 11:10PM PDT: 22h +1h10m The following example specifies a range from 38.7654 seconds after 9:51 PM PDT through 38.7654 seconds after 11:01 PM PDT: +1h +1h10m The first hour of the file could be extracted using the following specification: +0 +1h Note that with the ymdhmsu format there is an ambiguity between using m for month or for minute. The ambiguity is resolved as follows: if an m field is followed by a d field, it specifies months; otherwise it specifies minutes. If more than one input file is specified, tcpslice first copies packets lying in the given range from the first file. It then increases the starting time of the range to lie just beyond the timestamp of the last packet in the first file, repeats the process with the second file, and so on. In this manner, files with interleaved packets are not merged. For a given file, only packets that are newer than any in the preceding files will be considered. This mechanism avoids any possibility of a packet occurring more than once in the output. RESTRICTIONS
An input filename that beings with a digit or a plus sign (+) can be confused with a start and end time. Such filenames can be specified with a leading period and backslash (./); for example, specify the file 04Jul76.trace as The tcpslice program cannot read its input from stdin, since it uses random-access to read through its input files. The tcpslice program does not write to its output to a terminal (as indicated by isatty(3)). This prevents binary data from displaying on a user's terminal. You must either redirect stdout or specify an output file using the -w option. The tcpslice program does not work properly on tcpdump files spanning more than one year with files containing portions of packets whose original length was more than 65,535 bytes or with files containing fewer than three packets. If you use these files, the following error message is displayed: couldn't find final packet in file These problems are due to the interpolation scheme used by tcpslice to significantly increase its processing speed when dealing with large trace files. The tcpslice program can efficiently extract slices from the middle of trace files of any size, and can also work with trun- cated trace files (that is, the final packet in the file is only partially present, typically caused by tcpdump being killed). SEE ALSO
Commands: pfstat(1), pfconfig(8), tcpdump(8) Files: bpf(7), packetfilter(7) tcpslice(8)
All times are GMT -4. The time now is 04:13 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy