Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Extract lines if string found from last 30 min only Post 303032018 by RudiC on Saturday 9th of March 2019 02:58:38 PM
Old 03-09-2019
How about carefully reading, understanding, and heeding all the posts (and comments therein) offering help to you? The script you used was commented on and improved in a later post. You shouldn't expect turnkey solutions (although those are frequently delivered) but understand the proposals and experiment with them until they satisfy your needs.


Having said that, how about
Code:
$ paste -d'\t\b' <(date -f <(sed 's/^<\|>.*$//g; s/,//2' file) +"%F %T") file | awk -F"\t" -vTS="$(date -d'30 min ago' +'%F %T')" '($1 > TS) {sub ("^" $1 FS, ""); print}'
<Mar 9, 2019, 6:50:41,556 PM UTC> <Error> <Coherence> <BEA-000000>
<Mar 9, 2019, 6:56:45,132 PM UTC> <Error> <Coherence> <BEA-000000>

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Best approach for a 10 min extract out of several log files with timestamped records

I have a task where I need to code a shell script to extract a 10 min range (10 min from now until now) extract of a log file. I taught I could simply use a command that would say something like Start=date - 10 min but I didn't find anything. Looks like the only solution would have to code a... (3 Replies)
Discussion started by: Browser_ice
3 Replies

2. Shell Programming and Scripting

Print lines after the search string until blank line is found

All I want is to look for the pattern in the file...If I found it at # places... I want print lines after those pattern(line) until I find a blank line. Log EXAMPLE : MT:Exception caught The following Numbers were affected: 1234 2345 2346 Error java.lang.InternalError:... (3 Replies)
Discussion started by: prash184u
3 Replies

3. Shell Programming and Scripting

Find min.max value if matching columns found using AWK

Input_ File : 2 3 4 5 1 1 0 1 2 1 -1 1 2 1 3 1 3 1 4 1 6 5 6 6 6 6 6 7 6 7 6 8 5 8 6 7 Desired output : 2 3 4 5 -1 1 4 1 6 5 6 8 5 8 6 7 (3 Replies)
Discussion started by: vasanth.vadalur
3 Replies

4. Shell Programming and Scripting

search and replace, when found, delete multiple lines, add new set of lines?

hey guys, I tried searching but most 'search and replace' questions are related to one liners. Say I have a file to be replaced that has the following: $ cat testing.txt TESTING AAA BBB CCC DDD EEE FFF GGG HHH ENDTESTING This is the input file: (3 Replies)
Discussion started by: DeuceLee
3 Replies

5. Shell Programming and Scripting

grep log lines logged in 10 min

A log files has lines (1 line per each log for a majority; a few for 2 lines per each log) May 31 14:00:11 rtprodapp1 local2:notice sudo: jdoe : TTY=pts/0 ; PWD=/home/jdoe ; USER=root ; COMMAND=/usr/bin/su - May 31 14:03:19 rtprodapp1 local2:notice sudo: jdoe : TTY=pts/0 ; PWD=/home/jdoe ;... (4 Replies)
Discussion started by: Daniel Gate
4 Replies

6. Shell Programming and Scripting

Get 20 lines above string found, and 35 below string

i want to search a log for a string. when that string is found, i want to grab the a set number of lines that came before the string, and a set number of lines that come after the string. so if i search for the word "Error" in the /var/log/messages file, how can I output the 20 lines that came... (4 Replies)
Discussion started by: SkySmart
4 Replies

7. UNIX for Advanced & Expert Users

Move a block of lines to file if string found in the block.

I have a "main" file which has blocks of data for each user defined by tags BEGIN and END. BEGIN ID_NUM:24879 USER:abc123 HOW:47M CMD1:xyz1 CMD2:arp2 STATE:active PROCESS:id60 END BEGIN ID_NUM:24880 USER:def123 HOW:4M CMD1:xyz1 CMD2:xyz2 STATE:running PROCESS:id64 END (7 Replies)
Discussion started by: grep_me
7 Replies

8. UNIX for Dummies Questions & Answers

Integrate MIN and MAX in a string

I need to use awk for this task ! input (fields are separated by ";"): 1%2%3%4%;AA 5%6%7%8%9;AA 1%2%3%4%5%6;BB 7%8%9%10%11%12;BBIn the 1st field there are patterns composed of numbers separated by "%". The 2nd field define groups (here two different groups called "AA" and "BB"). Records... (8 Replies)
Discussion started by: beca123456
8 Replies

9. Shell Programming and Scripting

Extract lines with min value, using two field separators.

I have a file with two ID columns followed by five columns of counts in fraction form. I'd like to print lines that have a count of at least 4 (so at least 4 in the numerator, e.g. 4/17) in at least one of the five columns. Input file: comp51820_c1_seq1 693 0/29 0/50 0/69 0/36 0/31... (6 Replies)
Discussion started by: pathunkathunk
6 Replies

10. Shell Programming and Scripting

Search String and extract few lines under the searched string

Need Assistance in shell programming... I have a huge file which has multiple stations and i wanted to search particular station and extract few lines from it and the rest is not needed Bold letters are the stations . The whole file has multiple stations . Below example i wanted to search... (4 Replies)
Discussion started by: ajayram_arya
4 Replies
CHRONICLE(1)						User Contributed Perl Documentation					      CHRONICLE(1)

NAME
chronicle - A simple blog compiler. SYNOPSIS
chronicle [options] Path Options: --comments Specify the path to the optional comments directory. --config Specify a configuration file to read. --input Specify the input directory to use. --output Specify the directory to write output to. --theme-dir Specify the path to the theme templates. --theme Specify the theme to use. --pattern Specify the pattern of files to work with. --url-prefix Specify the prefix to the live blog. --sitemap-prefix Specify the prefix for the site map. Blog Entry Options: --format Specify the format of your entries, HTML/textile/markdown. Pre & Post-Build Commands: --pre-build Specify a command to execute prior to building the blog. --post-build Specify a command to execute once the blog has been built. --pre-filter A command to filter each blog entry before HTML conversion. --post-filter A command to filter each blog entry after HTML conversion. Sorting Options: --recent-dates-first Show recent entries first in the archive view. --recent-tags-first Show recent entries first in the tag view. Counting Options: --entry-count=N Number of posts to show on the index. --rss-count=N Number of posts to include on the RSS index feed. Optional Features: --author Specify the author's email address --comment-days Specify the number maximum age of posts to accept comments. --date-archive-path Include the date in the archive. --force Force the copying of static files from the blog theme. --lang Specify the language to use for formatting dates. --lower-case Lower-case all filenames which are output. --no-archive Don't create an archive page. --no-cache Don't use the optional memcached features, even if available. --no-calendar Don't use the optional calendar upon the index. --no-comments Don't allow comments to be posted. --no-sitemap Don't generate a sitemap. --no-tags Don't produce any tag pages. --no-xrefs Don't produce any cross references. Help Options: --help Show the help information for this script. --manual Read the manual for this script. --verbose Show useful debugging information. --version Show the version number and exit. ABOUT
Chronicle is a simple tool to convert a collection of text files, located within a single directory, into a blog consisting of static HTML files. It supports only the bare minimum of features which are required to be useful: * Tagging support. * RSS support. * Archive support. The obvious deficiencies are: * Lack of support for instant commenting. * Lack of pingback/trackback support. Having said that it is a robust, stable, and useful system. BLOG FORMAT
The format of the text files we process is critical to the output pages. Each entry should look something like this: Title: This is the title of the blog post Date: 2nd March 2007 Tags: one, two, three, long tag The text of your entry goes here. NOTE: The header MUST be separated from the body of the entry by at least a single empty line. In this example we can see that the entry itself has been prefaced with a small header. An entry header is contains three optional lines, if these are not present then there are sensible defaults as described below. The formatting of the output dates may be changed via the use of the B<--lang> command line option (or the matching "lang=french" option in the configuration file), but the date of the entry itself should be specified in English. Title: Describes the title of the post. If not present the filename of the entry is used instead. "Subject:" may also be used. Subject: This is a synonym for 'Title:'. Date: The date the post was written. If not present the creation time of the file is used instead. Publish: This header is removed from all entries, and is used by the chronicle-spooler script. Tags: Any tags which should be associated with the entry, separated by commas. The format of the entry is assumed to be HTML, however there is support for writing your entries in both textile and markdown formats. The format of entries is specified via the B<--format> argument, or via a "format: foo" setting in your chroniclerc file. The format of entries is assumed to be global; that is all your entries will be assumed to be in the same format. However you can add a "format: foo" pseudo header to specific entries if you wish to write specific entries in a different format. To allow flexibility in the handling of entries each blog entry will be passed through the filter script B<chronicle-entry-filter> which allows you to modify this handling in a single location. This script allows entries to be updated via filters both before and after the conversion to HTML. For further details please see the manpage for that script. CONFIGURATION
The configuration of the software is minimal, and generally performed via the command line arguments. However it is possible to save settings either in the file global /etc/chroniclerc or the per-user ~/.chroniclerc file. If you wish you may pass the name of another configuration file to the script with the B<--config> flag. This will be read after the previous two files, and may override any settings which are present. The configuration file contains lines like these: input = /home/me/blog output = /var/www/blog format = markdown Keys which are unknown are ignored. OPTIONAL CACHING
To speed the rebuilding of a large blog the compiler may use a local Memcached daemon, if installed and available. To install this, under a Debian GNU/Linux system please run: apt-get update apt-get install memcached libcache-memcached-perl You may disable this caching behaviour with --no-cache, and see the effect with --verbose. OPTIONAL CALENDAR
If the 'HTML::CalendarMonthSimple' module is available each blog will contain a simple month-view of the current month upon the index. To disable this invoke the program with '--no-calendar'. OPTIONAL COMMENTING
Included with the chronicle code you should find the file cgi-bin/comments.cgi. This file is designed to write submitted comments to the local filesystem of your web-server. If you install that, and edit the path at the start of the script you should be able to include comments in your blog. In short there are three things you need to do: Install the CGI script and edit the path at the start. Copy the output comments to your local blog source. Run this script again with --comments=./path/to/comments This should include the comments in the static output. More explicit instructions are provided within the file 'COMMENTS' included within the distribution. AUTHOR
Steve -- http://www.steve.org.uk/ LICENSE
Copyright (c) 2007-2010 by Steve Kemp. All rights reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the full text of the license. perl v5.12.3 2011-05-15 CHRONICLE(1)
All times are GMT -4. The time now is 08:06 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy