06-12-2012
Additional questions:
Do you need to run this match frequently or is it a once-off job?
How frequently are the data files updated?
Are there just new records appended to the files or are they completly re-written?
7 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file.
What will be the besat and fastest way to extract the ne file.
sample file format :--... (2 Replies)
Discussion started by: learner16s
2 Replies
2. Shell Programming and Scripting
hi,
I'm trying to sort a file which has 3.7 million records an gettign the following error...any help is appreciated...
sort: Write error while merging.
Thanks (6 Replies)
Discussion started by: greenworld
6 Replies
3. What is on Your Mind?
Here is an easy game!
I wrote a number between 0 and 20 (that can include 0 and 20) on a piece of paper. I am staring at it now, imagining the number so you can read my mind ;)
Reply once, and only once, with a number from 0 to 20 and the first person to guess it wins 1,000,000 Bits.
... (24 Replies)
Discussion started by: Neo
24 Replies
4. Shell Programming and Scripting
I have a log file that is about 1.2 million lines long and about 300MB.
we need a way to clean up this file and only keep the last few thousand lines.
if i use tail command we run our of memory as the file is too big.
I do have a key word to match on.
example, we want to keep every line... (8 Replies)
Discussion started by: robsonde
8 Replies
5. UNIX for Dummies Questions & Answers
Hi,
one of the server, log directory was never cleaned up. We have so many files. I want to remove all the files that starts with dfr* but I get error message when I use the *.
rm qfr*
bash: /usr/bin/rm: Arg list too long
I am trying to write this script but not working.
... (4 Replies)
Discussion started by: samnyc
4 Replies
6. UNIX for Dummies Questions & Answers
Hi,
Which way is faster rm -rf /path/ or find / -name -exec rm {} \; and why? (7 Replies)
Discussion started by: cain82
7 Replies
7. UNIX for Dummies Questions & Answers
Hi,
here is my problem:
I've got a file with 6 columns (file1):
a b c d e f
a b c d e f
a b c d e f
a b c d e f
I need to add 1 million columns to this file, each column needs to be a zero.
Here is how the result file (file2) should look like (for the sake of the example, I've only... (7 Replies)
Discussion started by: zajtat
7 Replies
LEARN ABOUT DEBIAN
globus-gram-audit
GLOBUS-GRAM-AUDIT(8) GRAM5 Commands GLOBUS-GRAM-AUDIT(8)
NAME
globus-gram-audit - Load GRAM4 and GRAM5 audit records into a database
SYNOPSIS
globus-gram-audit [--conf CONFIG_FILE] [[--create] | [--update=OLD-VERSION]] [--check] [--delete] [--audit-directory AUDITDIR] [--quiet]
DESCRIPTION
The globus-gram-audit program loads audit records to an SQL-based database. It reads $GLOBUS_LOCATION/etc/globus-job-manager.conf by
default to determine the audit directory and then uploads all files in that directory that contain valid audit records to the database
configured by the globus_gram_job_manager_auditing_setup_scripts package. If the upload completes successfully, the audit files will be
removed.
The full set of command-line options to globus-gram-audit consist of:
--conf CONFIG_FILE
Use CONFIG_FILE instead of the default from the
configuration file for audit database
configuration.
--check
Check whether the insertion of a record was
successful by querying the database after
inserting the records. This is used in tests.
--delete Delete audit records from the database right
after inserting them. This is used in tests to
avoid filling the databse with test records.
--audit-directory DIR Look for audit records in DIR, instead of looking
in the directory specified in the job manager
configuration. This is used in tests to control
which records are loaded to the database and then
deleted.
--query SQL Perform the given SQL query on the audit
database. This uses the database information from
the configuration file to determine how to
contact the database.
--quiet Reduce the amount of output for common
operations.
FILES
The globus-gram-audit uses the following files (paths relative to $GLOBUS_LOCATION.
etc/globus-gram-job-manager.conf
GRAM5 job manager configuration. It includes the
default path to the audit directory
etc/globus-gram-audit.conf
Audit configuration. It includes the information
needed to contact the audit database.
University of Chicago 08/30/2011 GLOBUS-GRAM-AUDIT(8)