Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement

 
Thread Tools Search this Thread
Special Forums News, Links, Events and Announcements UNIX and Linux RSS News Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement
# 1  
Old 11-23-2009
Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement

HPL-2009-359 Apples-to-Apples in Cross-Validation Studies: Pitfalls in Classifier Performance Measurement - Forman, George; Scholz, Martin
Keyword(s): AUC, F-measure, machine learning, ten-fold cross-validation, classification performance measurement, high class imbalance, class skew, experiment protocol
Abstract: Cross-validation is a mainstay for measuring performance and progress in machine learning. There are subtle differences in how exactly to compute accuracy, F-measure and Area Under the ROC Curve (AUC) in cross-validation studies. However, these details are not discussed in the literature, and incomp ...
Full Report

More...
Login or Register to Ask a Question

Previous Thread | Next Thread

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How many studies have unequal values for each pair?

I have several Studies (s) which has points (p) having Values (v). My goal is to determine for each pair of points, how many studies have different values ( if available ). Study Point Value 1 p1 value1 1 p2 value2 1 p3 value1 1 p4 value3 1 p5 value3 2 p2 value1 2 p4 value1 3 p1 value1... (5 Replies)
Discussion started by: senhia83
5 Replies

2. UNIX for Advanced & Expert Users

Redhat - IO performance measurement

Hi Currently we have SAN setup in our Redhat Environment. I have used iostat tool and ran it couple of times, i think there is IO bottle neck. Can anyone suggest any other tools or help me how to perform multiple Reads/Writes to test its performance (1 Reply)
Discussion started by: rakeshkumar
1 Replies

3. Shell Programming and Scripting

Using regular expressions to separate apples from oranges

I have a problem that I think could (should?) be possible using regular expressions. I've been using regular expressions for some time, so I have some experience with it, but I can't find a way to make this work correctly. Say I have a long string of different fruits: and I need the first... (7 Replies)
Discussion started by: odyssey
7 Replies

4. UNIX for Dummies Questions & Answers

Commands performance measurement

Hi, Actually i wanted to check out the process time for the execution of commands on unix, i looking for the script which can include all commands which are to be executed on the system and i need to get the time for executing each command, can somebody help me Thanks & Regards Murali (1 Reply)
Discussion started by: hsmuralidhara
1 Replies

5. What is on Your Mind?

Are You Going to Buy Apples iPhone?

Seems like the new Apple iPhone is the biggest technical event of the year. Are you going to bite? (13 Replies)
Discussion started by: Neo
13 Replies

6. UNIX for Advanced & Expert Users

Performance measurement of Code

I hope I am posting the query at right place.. I have the project running as 32 bit application on Solaris 8. I want to port this to 64Bit application. Before I start this process, I would like to compare the performance of a sample code running as 32Bit/64 Bit executables on a 64 bit... (1 Reply)
Discussion started by: amit_sapre
1 Replies

7. UNIX for Dummies Questions & Answers

any pitfalls to using $dos2unix function?

Greetings- are there any pitfalls/costs/etc to be aware of using the "$dos2unix <filename>" utility in Solaris 8? does it really work as simply as it's described / recommended in other threads ? We want to establish the procedure / develop a script or procedure to automatically strip out ^M... (1 Reply)
Discussion started by: gsumers22texas
1 Replies
Login or Register to Ask a Question
Validation::Class::Backwards(3pm)			User Contributed Perl Documentation			 Validation::Class::Backwards(3pm)

NAME
Validation::Class::Backwards - Backwards-Compatibility Layer for Validation::Class VERSION
version 7.70 SYNOPSIS
package SomeClass; use Validation::Class; package main; my $class = SomeClass->new; ... 1; DESCRIPTION
Validation::Class::Backwards is responsible for providing deprecated functionality to the Validation::Class::Prototype layer whilst clearly remaining separate via namespacing. Note: The methods described here will eventually become obsolete and cease to exist. Please review the namespace occasionally and adjust your code accordingly. Using methods defined here will generate warnings unless you unset the $ENV{'VALIDATION_CLASS_BC_WARNING'} environment variable. METHODS
error DEPRECATING: The error method is used to set and/or retrieve errors encountered during validation. The error method with no parameters returns the error message object which is an arrayref of error messages stored at class-level. # set errors at the class-level return $self->error('this isnt cool', 'unknown somethingorother'); # set an error at the field-level, using the field ref (not field name) $self->error($field_object, "i am your error message"); # return all errors encountered/set as an arrayref my $all_errors = $self->error(); RECOMMENDED: # see Validation::Class::Errors # set errors at the class-level return $self->errors->add(...); # set an error at the field-level $self->fields->{$field_name}->{errors}->add(...); # return all errors encountered my $list = $self->errors->list; AUTHOR
Al Newkirk <anewkirk@ana.io> COPYRIGHT AND LICENSE
This software is copyright (c) 2011 by Al Newkirk. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. perl v5.14.2 2012-06-28 Validation::Class::Backwards(3pm)