Search Results

Specify one argument to your script:

find . -name 'vdaq.txt' | xargs -n 1 vdaqconv

Probably like:

find . -name 'vdaq.txt' | xargs vdaqconv

Oh ok no problem. Here are the changes incorporated:

#!/usr/bin/perl -w

open (DATAFILE, $ARGV[0]) or die ("Could not open data file.");

print("Start Date, End Date, Start Time, End Time,...

For more complex text processing, I like to use Perl. If you have it installed in your environment, I found this to work on your initial data file:

#!/usr/bin/perl -w

open (DATAFILE, $ARGV[0])...

zaxxon's advice is correct if for some reason it is a file compressed using gzip, but it was named with a ".zip" extension. However, it is worth mentioning that the error you encountered may also be...

Sure it's a valid point that if disk space max is being reached during sort, the same issue may be encountered while inserting into a DB. However, we don't really know all the details of the server....

Have you considered loading this data into a DB, and using SQL to select the records in a sorted way, then streaming it out to a file with identical structure as your original file?

Probably Perl if you have it. Here's the module:

John McNamara / Spreadsheet-WriteExcel - search.cpan.org (http://search.cpan.org/dist/Spreadsheet-WriteExcel/)

I don't think it's a good idea to hack the history to implement another hack in your program.

The ARGV stuff should be easy. Just check the length of ARGV array to see if you got enough...

That seems efficient to me, but you may want to try xargs or something to simplify your script. What have you written to accomplish the task?

May work for you:


find ~/modeling* -name "*.log"|xargs -ix bash -c "tac x|grep -m 3 -e ITER"

There is actually no check for the number "1" anywhere in the script. The "foreach" just iterates over all of the lines of the file, in order. The "if" statement checks to see if the line begins...

Got Perl?

eturk-linux 20:13:50 (~/temp/pl)> cat filter.pl

#!/usr/bin/perl -w

open(IN,"dat.pdb") || die("Could not open infile!");
open(OUT,">new.pdb") || die("Could not open outfile!");
my...

I like Tyler's solution better :)

Just one of a million Perl solutions:

#!/usr/bin/perl -w

open(IN,"out1.txt") || die("Could not open infile!");
open(OUT,">extract.txt") || die("Could not open outfile!");
foreach $line (<IN>)...

Well the issue is more or less this line:


mv $1 /data2/harvest/


Because the mv command doesn't really know anything more than the destination directory you have specified. If you...

A bit convoluted but it works on my system:


tr '\n' '|' < rules.dat | sed 's/|$//' | xargs -iRULE egrep -v RULE data.dat


1) Change newlines to pipes
2) Remove trailing pipe
3) Pass...

From: Bash Guide Guide for Beginners - Quoting characters (http://www.linuxtopia.org/online_books/bash_guide_for_beginners/sect_03_03.html)

answer in bold:

Using double quotes the literal value...

Yeah, with the beginning and end of line special characters, you are restricting the pattern effectively.

Glad to know it worked for you!

Let me give some output from your script to make sure we're on the same page here:


eturk-linux 17:12:11 (~/bin)> ./test.pl
aaX
matches
eturk-linux 17:14:19 (~/bin)> ./test.pl
W1X
matches...

Hi Jeffers,

I would probably pre-filter the data using shell commands. One command you could use just to count the number of unique users would be:

cut -f 4 -d',' data.dat | sort | uniq | wc...

grep -i -E 'error|warning' file

Hi Jeffers,

So to sum the values in the columns, you can modify the final print statement a bit like so, or sum it up in the main processing loop:


foreach (sort keys %resultsHash) {
...

Hi Jeffers,

I made the changes that you had listed, and it worked fine for me:


#!/usr/bin/perl -w
use POSIX;

open (LOGFILE, $ARGV[0]) or die ("Could not open log file.");

foreach $line...

There are a couple areas for improvement of your shell script. However, to address your primary concern, yes you can use variables in the find command. However, to allow those variables to be...