Sponsored Content
Top Forums Shell Programming and Scripting How to log file processing details to database table usnig UNIX shell script? Post 302967162 by Atul kumar on Saturday 20th of February 2016 05:42:34 AM
Old 02-20-2016
How to log file processing details to database table usnig UNIX shell script?

we are getting files on daily basis.we need to process these files.

i need a unix shell script where we can count
1-The no of files processed
2-No of data/record processed for each files.

The script should log these details into a database table. If there is any error while file reading/extraction , then it should log into a error table.

Please let me know how to achieve this.
 

10 More Discussions You Might Find Interesting

1. Programming

how to diplay the file details on terminal in table format

hi all i want to display the details of text files on terminal in table format as JobID SubmissionTime ExecutionTime CompletionTime Status Server Machine user_1 00:00:00 00:00:00 ... (1 Reply)
Discussion started by: nitya2025
1 Replies

2. Shell Programming and Scripting

How to connect to database db2 through Unix Shell Script

I am trying to connect to database db2 through shell script. The process I am trying is > db2 It gives me error Access Denied. While checking for access I have the rights. Is there ant other way round..? Please help. (3 Replies)
Discussion started by: ankitgupta
3 Replies

3. Shell Programming and Scripting

what is uses of unix shell script in database projects

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx (2 Replies)
Discussion started by: alokjyotibal
2 Replies

4. UNIX for Dummies Questions & Answers

Script for parsing details in a log file to a seperate file

Hi Experts, Im a new bee for scripting, I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the... (2 Replies)
Discussion started by: pingnagan
2 Replies

5. UNIX for Dummies Questions & Answers

Shell Script: Traverse Database Table Row by Row

Hello Everyone, My issue is that I want to traverse a database table row by row and do some action on the value retrieved in each row. I have gone through a lot of shell script questions/posts. I could find row by row traversal of a file but not a database table. Please help. Thanks &... (5 Replies)
Discussion started by: ahsan.asghar
5 Replies

6. UNIX for Dummies Questions & Answers

How to Update DB table from txt file using CRONJOB in Unix Shell Script

Hi Experts, can guide how we can Update a Database Table using a txt file source Using Unix Shell Scripts. What are the Cron Jobs codes can written to Update DB table. txt file contains record like data. US 09/03/2012 User DocType DocID. these above feilds in txt files need to be updated in... (4 Replies)
Discussion started by: mahesh.sap
4 Replies

7. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M... (5 Replies)
Discussion started by: ajayram
5 Replies

8. Shell Programming and Scripting

Is it possible to get the database details in UNIX?

Hi, Sorry i can't find what particular forum should i post my question. I was given a username and password for the database, but i was not given the hostname, SID and the port to were i can connect to with. Is there a way for me to get the following details in unix, by the way i am using... (5 Replies)
Discussion started by: reignangel2003
5 Replies

9. Shell Programming and Scripting

Download a db table through UNIX shell script

Hi, I'm an amateur and need your help in figuring this out. I have been asked to connect to a prod db from non-prod env., and download a table from prod db to non-prod env. I was able to connect to the prod db and then run a simple query as below. @@@@@@@@@@ ... (7 Replies)
Discussion started by: arunpvp
7 Replies

10. UNIX for Beginners Questions & Answers

Generic script to load file details(ls -ltr) in to a database.

All, I am trying to create a report on the duration of an ETL load from the file arrival to the final dump in to a database for SLA's. Does anyone have any guidance or ideas on how metadata can be extracted; information of a file: like file name, created timestamp, count of records and load... (1 Reply)
Discussion started by: pradeepp
1 Replies
LR_VENDOR_CRON.IN(1)					  LogReport's Lire Documentation				      LR_VENDOR_CRON.IN(1)

NAME
lr_vendor_cron - generate Lire reports from all known log files on the system SYNOPSIS
lr_vendor_cron daily|weekly|monthly DESCRIPTION
lr_vendor_cron is designed to be invoked by cron. On systems supporting /etc/cron.d/, this script can be invoked by creating /etc/cron.d/lire, which should read e.g.: 02 5 * * * root /usr/sbin/lr_vendor_cron daily 22 5 * * 0 root /usr/sbin/lr_vendor_cron weekly 42 5 1 * * root /usr/sbin/lr_vendor_cron monthly lr_vendor_cron reads files /etc/sysconfig/lire.d/*.cfg and /etc/default/lire.d/*.cfg. For each log file, such a file should exist. The files should set the following shell variables: daemon the name of a binary which generated the specific log. This is used to test wether the *.cfg-file is suitable for the current system. If you'd like to generate a log for which no daemon is present on the current system, just use a placeholder like "daemon=/bin/true". service a Lire service, e.g. sendmail, logfile e.g. /var/log/mail.log.1.gz, filter e.g. 'gzip -dc' or 'zcat | grep sendmail', and rotateperiod one of the supported lr_vendor_cron arguments. extraopts optional: extra options passed to lr_log2mail(1). Set this to e.g. '--template www_local'. After parsing the configuration files, lr_vendor_cron invokes lr_log2mail(1) on the `filter'ed log file. Reading and filtering the log is done as root, lr_log2mail is run as user lire, using su(1). Output is fed to logger(1). SECURITY
lr_vendor_cron is supposed to be run as root. However, please note that this script is distributed WITHOUT ANY WARRANTY. If you don't like to run such a script as root, make sure your lire user has read access to all log files you'd like to get processed, and adapt this script. We supply this script mainly for people building packages. On many Unix and GNU/Linux distributions, it's hard to enforce log file readability by the lire user. This script is mainly a way to work around this. ENVIRONMENT VARIABLES
lr_vendor_cron honours DEBUG, CONFDIR, PRIORITY (for logger(1) call), and LIREUSER. Beware! PRIORITY as used here is independent of the LR_FACILITY as set in /etc/lire/defaults. This script does not use any of the settings in /etc/lire/defaults. VERSION
$Id: lr_vendor_cron.in,v 1.14 2006/07/23 13:16:33 vanbaal Exp $ COPYRIGHT
Copyright (C) 2002, 2003 Stichting LogReport Foundation LogReport@LogReport.org Copyright (C) 2005 Joost van Baal This program is part of Lire. Lire is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with http://www.gnu.org/copyleft/gpl.html. AUTHORS
Francis J. Lacoste <flacoste@logreport.org>, Joost van Baal <joostvb@logreport.org> Lire 2.1.1 2006-07-23 LR_VENDOR_CRON.IN(1)
All times are GMT -4. The time now is 05:23 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy