Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching
Top Forums Shell Programming and Scripting HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching Post 302676487 by biztank on Tuesday 24th of July 2012 04:37:58 PM
Old 07-24-2012
Network HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching
I have a LOG file which looks like this
Code:
 
Import started at: Mon Jul 23 02:13:01 EDT 2012
Initialization completed in 2.146 seconds.
--------------------------------------------------------------------------------
--
Import summary for Import item: PolicyInformation
--------------------------------------------------------------------------------
--
Batch size: 1.
Commit count: 100.
Error Tolerance Level: 1.
Error Count: 0.
Amount of data processed: 10.
Amount of objects committed: 8.
Data Importer initialization time: 1 seconds.
Data Importer execution began: Mon Jul 23 02:13:03 EDT 2012
Data Importer execution ended: Mon Jul 23 02:13:06 EDT 2012
Data Importer completed in 2.735 seconds.
Total flush time: 0 seconds.
Total commit time: 0.008 seconds.
Affected tables (4):
Table name: PolicyHdr, Affected number of rows: 118.
Table name: PolicyDetl, Affected number of rows: 76.
Table name: ClaimSeq, Affected number of rows: 211.
Table name: Claimant, Affected number of rows: 116.
----------------------------------------------------------------------------------
 
Program exiting with exit code: 0.
Import completed successfully with no errors.
Import ended at: Mon Jul 23 02:13:06 EDT 2012
Import completed in 4.891 seconds.

I have KEYWORDS whcih are these
Error Count:
Amount of data processed:
Import completed in
and many more


Whats the best way to open and loop thru the file line by line looking for Keywords like these and extracting rest of the information .

i've looked/read several posts but nothing quiet what i need.
i tried GREP/AWK & SED but nothing is giving me what i want... (obviously im not an expert scriptor)

now this is what i've cooked up so far
Code:
#!/bin/bash
file="/home/myuser/importlog.txt"
val1='Import completed in'
while IFS= read -r line
do
let count++ # display $line or do somthing with $line
#echo "$count $line"
fit=`expr substr "$line" 1 17`
if [ $fit == $val1 ]
then
echo "Found IT $line"
fi
done <"$file"

it fails with line 9: [: too many arguments

not sure why its failing when matching the $fit == $val1 coz at command line it works

$ line='Import completed in'
$ fit=`expr substr "$line" 1 17`
$ echo $fit
Import completed


can any of you experts quickly cut my agony by helping me out... sincerely appreciated....
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

shell script to read a line in gps receiver log file and append that line to new file

Hi, I have gps receiver log..its giving readings .like below Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. GPSD,R=1 $GPGSV,3,1,11,08,16,328,40,11,36,127,00,28,33,283,39,20,11,165,00*71... (3 Replies)
Discussion started by: gudivada213
3 Replies

2. UNIX for Dummies Questions & Answers

shell script to read file line by line

Hi, I need to read a text file from shell script line by line and copy the feilds of each line. Below is the complete requirement. I've text file which contains ... pgm1 file11 file12 file13 pgm2 file21 file22 pgm3 file31 file32 file33 I'll give input as... (4 Replies)
Discussion started by: ani12345
4 Replies

3. Shell Programming and Scripting

how can u read a file line by line in shell script ?

hello , plz help for below script req:- how can we read a file line by line in shell script ? (4 Replies)
Discussion started by: abhigrkist
4 Replies

4. Shell Programming and Scripting

get the fifth line of a text file into a shell script and trim the line to extract a WORD

FOLKS , i have a text file that is generated automatically of an another korn shell script, i want to bring in the fifth line of the text file in to my korn shell script and look for a particular word in the line . Can you all share some thoughts on this one. thanks... Venu (3 Replies)
Discussion started by: venu
3 Replies

5. Shell Programming and Scripting

Shell script to read a text file line by line & process it...

Hi , I am trying to write an shell, which reads a text file (from a location) having a list of numbers of strictly 5 digits only ex: 33144 Now my script will check : 1) that each entry is only 5 digits & numeric only, no alphabets, & its not empty. 2)then it executes a shell script called... (8 Replies)
Discussion started by: new_to_shell
8 Replies

6. Shell Programming and Scripting

Replace line in file with line in another file based on matching string

Hi I am not the best scripter in the world and have run into a issue which you might be able to guide me on... I have two files. File1 : A123, valueA, valueB B234, valueA, valueB C345, valueA, valueB D456, valueA, valueB E567, valueA, valueB F678, valueA, valueB File2: C345,... (5 Replies)
Discussion started by: luckycharm
5 Replies

7. Shell Programming and Scripting

Shell script to read multiple options from file, line by line

Hi all I have spent half a day trying to create a shell script which reads a configuration file on a line by line basis. The idea of the file is that each will contain server information, such as IP address and various port numbers. The line could also be blank (The file is user created). Here... (1 Reply)
Discussion started by: haggismn
1 Replies

8. Shell Programming and Scripting

Replace and add line in file with line in another file based on matching string

Hi, I want to achieve something similar to what described in another post: The difference is I want to add the line if the pattern is not found. File 1: A123, valueA, valueB B234, valueA, valueB C345, valueA, valueB D456, valueA, valueB E567, valueA, valueB F678, valueA, valueB ... (11 Replies)
Discussion started by: jyu3
11 Replies

9. Shell Programming and Scripting

Replace line in file with line in another file based on matching string

HI Can any one guide me how to achieve this task. I have 2 files env.txt #Configuration.Properties values identity_server_url = http://identity.test-hit.com:9783/identity/service/user/register randon_password_length = 6 attachment_file_path = /pass/temp/attachments/... (1 Reply)
Discussion started by: nikilbr86
1 Replies

10. Shell Programming and Scripting

Shell script UNIX to read text file line by line

i have a text file as belows, it includes 2 columns, 1st is the column name, 2nd is the file_name data_file.txt column_name file_name col1 file1 col2 file2 col3 file1 col4 file1 col5 file2 now, i would like to... (4 Replies)
Discussion started by: tester111
4 Replies

LEARN ABOUT DEBIAN

mozroots

Mono(MozRoots)															    Mono(MozRoots)

NAME

       mozroots - Download and import trusted root certificates from Mozilla's LXR into Mono's certificate store

SYNOPSIS

       mozroots [--import [--machine] [--sync | --ask | --ask-add | --ask-remove]]

DESCRIPTION

       This program downloads the trusted root certificates from the Mozilla LXR web site into the Mono certificate store.

       Mono  by  default  does	not ship with any default certificates and allows the user to pick its trusted certificates.  The mozroots command
       will bring the Mozilla certificates into your local machine.

OPTIONS

       --import
	      Import the certificates into the trust store.

       --sync Synchronize (add/remove) the trust store with the certificates.  Synchronize is useful for new Mono installations (no roots) and for
	      automated updates (no user confirmation for addition or removal).

       --ask  Always  confirm before adding or removing trusted certificates.  Note: The initial import will likely add about 100 new trusted root
	      certificates into your store. You'll have to answer yes to every one of them if this option is specified.

       --ask-add
	      Always confirm before adding a new trusted certificate.  Note: The initial import will likely add about 100 new  trusted	root  cer-
	      tificates into your store. You'll have to answer yes to every one of them if this option is specified.

       --ask-remove
	      Always confirm before removing an existing trusted certificate.

ADVANCED OPTIONS

       --url url
	      Specify  an  alternative URL for downloading the trusted certificates (LXR source format). This should only be useful for testing or
	      if the Mozilla's LXR web site address is changed. It can also be used to cache a	local  copy  of  the  LXR  file  into  your  local
	      intranet.

       --file name
	      Do not download from LXR but use the specified file. This is useful if many computers have to download the same file from the Inter-
	      net.  This way you can keep a local copy on a file server (and minimize network traffic).

       --pkcs7 name
	      Export the certificates into a PKCS#7 file. This is useful for debugging purpose or for re-importing the same list into other  soft-
	      ware.

       --machine
	      Import  the  certificate	in  the  machine trust store. The default is to import all trusted root certificates into the current user
	      store.

       --quiet
	      Limit console output to errors and confirmations messages. This is useful when scripting.

EXAMPLES

       After the initial Mono installation you'll have no trusted roots certificates pre-installed.  Neither will you have some root test certifi-
       cates  installed  (your	own  or the ones provided by using setreg ). In this case the simplest thing to do, if you want to trust all those
       certificates, is to import and synchronize.
	    $ mozroots --import --sync
	    Mozilla Roots Importer - version 1.1.9.0
	    Download and import trusted root certificates from Mozilla's LXR.
	    Copyright 2002, 2003 Motus Technologies. Copyright 2004-2005 Novell. BSD licensed.

	    Downloading from 'http://lxr.mozilla.org/seamonkey/source/security/nss/lib/ckfw/builtins/certdata.txt'...
	    Importing certificates into user store...
	    93 new root certificates were added to your trust store.
	    Import process completed.

       If you created some test certificates (e.g. for using SSL/TLS with XSP) and/or if your enterprise requires some	additional  root  certifi-
       cates  (e.g.  intranet)	then  you  may	want to skip the removal part of the process. You can do this by asking for a removal confirmation
       (--ask-remove option) and answer no when prompted.
	    $ mozroots --import --ask-remove
	    Mozilla Roots Importer - version 1.1.9.0
	    Download and import trusted root certificates from Mozilla's LXR.
	    Copyright 2002, 2003 Motus Technologies. Copyright 2004-2005 Novell. BSD licensed.

	    Downloading from 'http://lxr.mozilla.org/seamonkey/source/security/nss/lib/ckfw/builtins/certdata.txt'...
	    Importing certificates into user store...
	    93 new root certificates were added to your trust store.
	    2 previously trusted certificates were not part of the update.

	    Issuer: CN=Mono Test Root Agency
	    Serial number: 69-B0-E1-4F-88-6E-C7-85-48-0E-74-91-38-76-F4-28
	    Valid from 9/1/2003 11:55:48 AM to 12/31/2039 1:59:59 PM
	    Thumbprint SHA-1: EF-26-C2-28-11-3F-79-ED-9D-EC-3F-3B-D5-7A-26-F2-7C-9F-FA-63
	    Thumbprint MD5:   AE-19-3E-64-36-21-F2-A4-8B-69-38-CA-64-4B-2E-62
	    Are you sure you want to remove this certificate ? no

       You can still use the synchronize option (--sync) if you have activated
       the default test roots certificate on your system. They will be removed
       at the end of the synchronization process but you can quickly add them
       back with the
       setreg
       tool.
	    $ setreg 1 true

       Another option to ease updates is to synchronize your machine trust store (using the --machine option) and keep your customized (test) cer-
       tificates  in  your  personal store (or vice versa). Note that every user on this computer will be trusting all the newly imported certifi-
       cates.
	    $ mozroots --import --machine --sync
	    Mozilla Roots Importer - version 1.1.9.0
	    Download and import trusted root certificates from Mozilla's LXR.
	    Copyright 2002, 2003 Motus Technologies. Copyright 2004-2005 Novell. BSD licensed.

	    Downloading from 'http://lxr.mozilla.org/seamonkey/source/security/nss/lib/ckfw/builtins/certdata.txt'...
	    Importing certificates into user store...
	    94 new root certificates were added to your trust store.
	    Import process completed.

       Once the initial import is complete the number of changes (additions or removals) is generally very low. In this case  it  makes  sense	to
       know about any changes (i.e. ask for confirmation). No confirmation will be required if no changes are made to your trust store.
	    $ mozroots --import --ask
	    Mozilla Roots Importer - version 1.1.9.0
	    Download and import trusted root certificates from Mozilla's LXR.
	    Copyright 2002, 2003 Motus Technologies. Copyright 2004-2005 Novell. BSD licensed.

	    Downloading from 'http://lxr.mozilla.org/seamonkey/source/security/nss/lib/ckfw/builtins/certdata.txt'...
	    Importing certificates into user store...
	    Import process completed.

FILES

       ~/.config/.mono/certs, /usr/share/.mono/certs

       Contains Mono certificate stores for users / machine. See the certmgr(1) manual page for more information on managing certificate stores.

COPYRIGHT

       Copyright (C) 2005 Novell.

MAILING LISTS

       Mailing lists are listed at the http://www.mono-project.com/Mailing_Lists

WEB SITE

       http://www.mono-project.com

SEE ALSO

       mono(1),certmgr(1).setreg(1)

																    Mono(MozRoots)
All times are GMT -4. The time now is 02:46 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy