10-24-2019
Script to load file metadata in to a database.
All,
I am trying to create a report on the duration of an ETL load from the file arrival to the final dump in to a database for SLA's.
Does anyone have any guidance or ideas on how metadata can be extracted; information of a file: like file name, created timestamp, count of records and load into a table ? (oracle or teradata).
Thanks in Advance!
Last edited by pradeepp; 10-24-2019 at 12:04 PM..
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Since i'm new to scripting i'm findind it difficult to code a script. The script has to be an executable with 2 paramters passed to it.The Parameters are
1. The Control file name(.ctl file)
2. The Data file name(.csv file)
Does anybody have an idea about it? :confused: (3 Replies)
Discussion started by: Csmani
3 Replies
2. UNIX for Advanced & Expert Users
when I write the command ls -ltr it shows the detail of the files. Like
-rwxrwxrwx 1 mqsiadm mqbrkrs 0 Aug 29 14:03 dspmq_temp
-rwxrwxrwx 1 mqsiadm mqbrkrs 666 Aug 30 06:12 dspmq_script
In this,DATE TIME is shown, Now the question is : how can I see the all the times... (5 Replies)
Discussion started by: varungupta
5 Replies
3. Red Hat
Hi Techies,
Setup details -
1. H/W Load Balancer
2. Two Apache Servers with load balancing and rewrite rule
3. Two Application servers
Request will be travel 1 then 2 then 3
Queries -
1. When any session is established I can see that requests of that session is going to both... (0 Replies)
Discussion started by: ganesh_gore
0 Replies
4. Shell Programming and Scripting
Hello everyone,
I am new to shell scripting/ loading data into a database.
I want to load data into Oracle database using SQL loader. Can some one please explain why do we need unix shell script to load the data into the database? Also can someone please explain what has to be in that script?... (5 Replies)
Discussion started by: new_prog
5 Replies
5. Shell Programming and Scripting
help me (2 Replies)
Discussion started by: sonu pandey
2 Replies
6. Shell Programming and Scripting
we are getting files on daily basis.we need to process these files.
i need a unix shell script where we can count
1-The no of files processed
2-No of data/record processed for each files.
The script should log these details into a database table. If there is any error while file... (3 Replies)
Discussion started by: Atul kumar
3 Replies
7. Shell Programming and Scripting
Hi All,
Good morning...
I have prepared a shell script which will monitor files in a certain folder and if available, SCP it to a destination path.
Now the challenge I'm facing is my script is currently SCP-ing to only a single destination path. Wherever different destination path is in... (1 Reply)
Discussion started by: saps19
1 Replies
8. UNIX for Advanced & Expert Users
Hi,
I want your help to see if there is a way wherein we can load a set of files which are lying in unix server into my database using sql loader.
Also the person who will be running sql loader does not have access to unix system.
So is there a way i can provide any sql loader script wherein... (1 Reply)
Discussion started by: Vivekit82
1 Replies
9. Shell Programming and Scripting
I am on SunOS and Linux
I need generic command to get complete process details from which i will eventually extract socket details (listen address and port)
ps -ef | ggrep -i server | ggrep -i mydomaindoes not yield a process that should have both the grep entries along with the listen... (8 Replies)
Discussion started by: mohtashims
8 Replies
10. UNIX for Beginners Questions & Answers
Hi,
I have many files but with only 2 names , I want to load the data of that file into database through sqlldr with single control file. how can i do that ?????
Example:
switch_file
switch_file
billing_file
billing_file
now these files should be loaded into same database but different... (1 Reply)
Discussion started by: niti_sharma
1 Replies
LVMDUMP(8) System Manager's Manual LVMDUMP(8)
NAME
lvmdump - create lvm2 information dumps for diagnostic purposes
SYNOPSIS
lvmdump [options] [-d directory]
DESCRIPTION
lvmdump is a tool to dump various information concerning LVM2. By default, it creates a tarball suitable for submission along with a prob-
lem report.
The content of the tarball is as follows:
- dmsetup info
- table of currently running processes
- recent entries from /var/log/messages (containing system messages)
- complete lvm configuration and cache
- list of device nodes present under /dev
- if enabled with -m, metadata dump will be also included
- if enabled with -a, debug output of vgscan, pvscan and list of all available volume groups, physical volumes and logical volumes will be
included
- if enabled with -c, cluster status info
OPTIONS
-h -- print help message
-a -- advanced collection
WARNING: if lvm is already hung, then this script may hang as well if -a is used
-m -- gather LVM metadata from the PVs
This option generates a 1:1 dump of the metadata area from all PVs visible to the system, which can cause the dump to increase in
size considerably. However, the metadata dump may represent a valuable diagnostic resource.
-d directory -- dump into a directory instead of tarball
By default, lvmdump will produce a single compressed tarball containing all the information. Using this option, it can be instructed
to only produce the raw dump tree, rooted in directory.
-c -- if clvmd is running, gather cluster data as well
ENVIRONMENT VARIABLES
LVM_BINARY
The LVM2 binary to use. Defaults to "lvm". Sometimes you might need to set this to "/sbin/lvm.static", for example.
DMSETUP_BINARY
The dmsetup binary to use. Defaults to "dmsetup".
Red Hat, Inc. LVM TOOLS 2.02.67(2) (2010-06-04) LVMDUMP(8)