Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Generic script to load file details(ls -ltr) in to a database. Post 303040159 by pradeepp on Thursday 24th of October 2019 09:22:18 AM
Old 10-24-2019
Script to load file metadata in to a database.

All,

I am trying to create a report on the duration of an ETL load from the file arrival to the final dump in to a database for SLA's.

Does anyone have any guidance or ideas on how metadata can be extracted; information of a file: like file name, created timestamp, count of records and load into a table ? (oracle or teradata).

Thanks in Advance!

Last edited by pradeepp; 10-24-2019 at 12:04 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell Script to Load data into the database using a .csv file and .ctl file

Since i'm new to scripting i'm findind it difficult to code a script. The script has to be an executable with 2 paramters passed to it.The Parameters are 1. The Control file name(.ctl file) 2. The Data file name(.csv file) Does anybody have an idea about it? :confused: (3 Replies)
Discussion started by: Csmani
3 Replies

2. UNIX for Advanced & Expert Users

ls -ltr, TIME DETAILS ??

when I write the command ls -ltr it shows the detail of the files. Like -rwxrwxrwx 1 mqsiadm mqbrkrs 0 Aug 29 14:03 dspmq_temp -rwxrwxrwx 1 mqsiadm mqbrkrs 666 Aug 30 06:12 dspmq_script In this,DATE TIME is shown, Now the question is : how can I see the all the times... (5 Replies)
Discussion started by: varungupta
5 Replies

3. Red Hat

Conceptual details about apache load balancing

Hi Techies, Setup details - 1. H/W Load Balancer 2. Two Apache Servers with load balancing and rewrite rule 3. Two Application servers Request will be travel 1 then 2 then 3 Queries - 1. When any session is established I can see that requests of that session is going to both... (0 Replies)
Discussion started by: ganesh_gore
0 Replies

4. Shell Programming and Scripting

why do we need UNIX shell script to load data into Oracle database

Hello everyone, I am new to shell scripting/ loading data into a database. I want to load data into Oracle database using SQL loader. Can some one please explain why do we need unix shell script to load the data into the database? Also can someone please explain what has to be in that script?... (5 Replies)
Discussion started by: new_prog
5 Replies

5. Shell Programming and Scripting

I have two commands “ls -h” and “ls -ltr”. How do i make sure “ls -ltr” is run after “ls -h” is suc

help me (2 Replies)
Discussion started by: sonu pandey
2 Replies

6. Shell Programming and Scripting

How to log file processing details to database table usnig UNIX shell script?

we are getting files on daily basis.we need to process these files. i need a unix shell script where we can count 1-The no of files processed 2-No of data/record processed for each files. The script should log these details into a database table. If there is any error while file... (3 Replies)
Discussion started by: Atul kumar
3 Replies

7. Shell Programming and Scripting

Required help on a Generic File-watcher script

Hi All, Good morning... I have prepared a shell script which will monitor files in a certain folder and if available, SCP it to a destination path. Now the challenge I'm facing is my script is currently SCP-ing to only a single destination path. Wherever different destination path is in... (1 Reply)
Discussion started by: saps19
1 Replies

8. UNIX for Advanced & Expert Users

Load a file from UNIX into database

Hi, I want your help to see if there is a way wherein we can load a set of files which are lying in unix server into my database using sql loader. Also the person who will be running sql loader does not have access to unix system. So is there a way i can provide any sql loader script wherein... (1 Reply)
Discussion started by: Vivekit82
1 Replies

9. Shell Programming and Scripting

Need generic command to get complete running process details

I am on SunOS and Linux I need generic command to get complete process details from which i will eventually extract socket details (listen address and port) ps -ef | ggrep -i server | ggrep -i mydomaindoes not yield a process that should have both the grep entries along with the listen... (8 Replies)
Discussion started by: mohtashims
8 Replies

10. UNIX for Beginners Questions & Answers

Creating script to read many files and load into database via single control file

Hi, I have many files but with only 2 names , I want to load the data of that file into database through sqlldr with single control file. how can i do that ????? Example: switch_file switch_file billing_file billing_file now these files should be loaded into same database but different... (1 Reply)
Discussion started by: niti_sharma
1 Replies
LVMDUMP(8)						      System Manager's Manual							LVMDUMP(8)

NAME
lvmdump - create lvm2 information dumps for diagnostic purposes SYNOPSIS
lvmdump [options] [-d directory] DESCRIPTION
lvmdump is a tool to dump various information concerning LVM2. By default, it creates a tarball suitable for submission along with a prob- lem report. The content of the tarball is as follows: - dmsetup info - table of currently running processes - recent entries from /var/log/messages (containing system messages) - complete lvm configuration and cache - list of device nodes present under /dev - if enabled with -m, metadata dump will be also included - if enabled with -a, debug output of vgscan, pvscan and list of all available volume groups, physical volumes and logical volumes will be included - if enabled with -c, cluster status info OPTIONS
-h -- print help message -a -- advanced collection WARNING: if lvm is already hung, then this script may hang as well if -a is used -m -- gather LVM metadata from the PVs This option generates a 1:1 dump of the metadata area from all PVs visible to the system, which can cause the dump to increase in size considerably. However, the metadata dump may represent a valuable diagnostic resource. -d directory -- dump into a directory instead of tarball By default, lvmdump will produce a single compressed tarball containing all the information. Using this option, it can be instructed to only produce the raw dump tree, rooted in directory. -c -- if clvmd is running, gather cluster data as well ENVIRONMENT VARIABLES
LVM_BINARY The LVM2 binary to use. Defaults to "lvm". Sometimes you might need to set this to "/sbin/lvm.static", for example. DMSETUP_BINARY The dmsetup binary to use. Defaults to "dmsetup". Red Hat, Inc. LVM TOOLS 2.02.67(2) (2010-06-04) LVMDUMP(8)
All times are GMT -4. The time now is 10:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy