Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement

 
Thread Tools Search this Thread
Special Forums News, Links, Events and Announcements UNIX and Linux RSS News Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement
# 1  
Old 11-23-2009
Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement

HPL-2009-359 Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement - Forman, George; Scholz, Martin
Keyword(s): AUC, F-measure, machine learning, ten-fold cross-validation, classification performance measurement, high class imbalance, class skew, experiment protocol
Abstract: Cross-validation is a mainstay for measuring performance and progress in machine learning. There are subtle differences in how exactly to compute accuracy, F-measure and Area Under the ROC Curve (AUC) in cross-validation studies. However, these details are not discussed in the literature, and incomp ...
Full Report

More...
Login or Register to Ask a Question

Previous Thread | Next Thread

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How many studies have unequal values for each pair?

I have several Studies (s) which has points (p) having Values (v). My goal is to determine for each pair of points, how many studies have different values ( if available ). Study Point Value 1 p1 value1 1 p2 value2 1 p3 value1 1 p4 value3 1 p5 value3 2 p2 value1 2 p4 value1 3 p1 value1... (5 Replies)
Discussion started by: senhia83
5 Replies

2. UNIX for Advanced & Expert Users

Redhat - IO performance measurement

Hi Currently we have SAN setup in our Redhat Environment. I have used iostat tool and ran it couple of times, i think there is IO bottle neck. Can anyone suggest any other tools or help me how to perform multiple Reads/Writes to test its performance (1 Reply)
Discussion started by: rakeshkumar
1 Replies

3. Shell Programming and Scripting

Using regular expressions to separate apples from oranges

I have a problem that I think could (should?) be possible using regular expressions. I've been using regular expressions for some time, so I have some experience with it, but I can't find a way to make this work correctly. Say I have a long string of different fruits: and I need the first... (7 Replies)
Discussion started by: odyssey
7 Replies

4. UNIX for Dummies Questions & Answers

Commands performance measurement

Hi, Actually i wanted to check out the process time for the execution of commands on unix, i looking for the script which can include all commands which are to be executed on the system and i need to get the time for executing each command, can somebody help me Thanks & Regards Murali (1 Reply)
Discussion started by: hsmuralidhara
1 Replies

5. What is on Your Mind?

Are You Going to Buy Apples iPhone?

Seems like the new Apple iPhone is the biggest technical event of the year. Are you going to bite? (13 Replies)
Discussion started by: Neo
13 Replies

6. UNIX for Advanced & Expert Users

Performance measurement of Code

I hope I am posting the query at right place.. I have the project running as 32 bit application on Solaris 8. I want to port this to 64Bit application. Before I start this process, I would like to compare the performance of a sample code running as 32Bit/64 Bit executables on a 64 bit... (1 Reply)
Discussion started by: amit_sapre
1 Replies

7. UNIX for Dummies Questions & Answers

any pitfalls to using $dos2unix function?

Greetings- are there any pitfalls/costs/etc to be aware of using the "$dos2unix <filename>" utility in Solaris 8? does it really work as simply as it's described / recommended in other threads ? We want to establish the procedure / develop a script or procedure to automatically strip out ^M... (1 Reply)
Discussion started by: gsumers22texas
1 Replies
Login or Register to Ask a Question
Validation::Class::Collection(3pm)			User Contributed Perl Documentation			Validation::Class::Collection(3pm)

NAME
Validation::Class::Collection - Generic Container Class for Various Collections VERSION
version 7.70 SYNOPSIS
use Validation::Class::Collection; my $foos = Validation::Class::Collection->new; $foos->add(foo => Foo->new); print $foos->count; # 1 object DESCRIPTION
Validation::Class::Collection provides an all-purpose container for hash objects. This class is primarily used as a base class for collection management classes. METHODS
new my $self = Validation::Class::Collection->new; add $self = $self->add(foo => Foo->new); $self->add(foo => Foo->new, bar => Bar->new); clear $self = $self->clear; count my $count = $self->count; each $self = $self->each(sub{ my ($name, $object) = @_; ... }); find my $matches = $self->find(qr/update_/); # hashref get my $object = $self->get($name); has if ($self->has($name)) { ... } hash my $hash = $self->hash; keys my @keys = $self->keys; list my @objects = $self->list; remove $object = $self->remove($name); values my @objects = $self->values; AUTHOR
Al Newkirk <anewkirk@ana.io> COPYRIGHT AND LICENSE
This software is copyright (c) 2011 by Al Newkirk. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. perl v5.14.2 2012-06-28 Validation::Class::Collection(3pm)