InputType
- The type of the input data for supervised learning.OutputType
- The type of the output data for supervised learning.StatisticType
- The type of the statistic generated by the
performance evaluator on the learned object for each fold. It is
created by passing the learned object plus the test data for the
fold into the performance evaluator.SummaryType
- The type produced by the summarizer at the end of
the experiment from a collection of the given statistics (one for
each fold). This represents the performance result for the learning
algorithm for the whole experiment.public class SupervisedLearnerComparisonExperiment<InputType,OutputType,StatisticType,SummaryType> extends LearnerComparisonExperiment<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>,Evaluator<? super InputType,OutputType>,StatisticType,SummaryType>
LearnerComparisonExperiment.Result<SummaryType>
confidence, learners, performanceEvaluator, statistics, summaries, summarizer
foldCreator, numTrials
listeners
Constructor and Description |
---|
SupervisedLearnerComparisonExperiment()
Creates a new instance of
SupervisedLearnerComparisonExperiment . |
SupervisedLearnerComparisonExperiment(ValidationFoldCreator<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>> foldCreator,
PerformanceEvaluator<? super Evaluator<? super InputType,OutputType>,? super java.util.Collection<? extends InputOutputPair<InputType,OutputType>>,? extends StatisticType> performanceEvaluator,
NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> statisticalTest,
Summarizer<? super StatisticType,? extends SummaryType> summarizer)
Creates a new instance of
SupervisedLearnerComparisonExperiment . |
evaluate, evaluate, getConfidence, getLearners, getPerformanceEvaluator, getStatisticalTest, getStatistics, getSummaries, getSummarizer, runTrial, setConfidence, setLearners, setPerformanceEvaluator, setStatisticalTest, setStatistics, setSummaries, setSummarizer
getFoldCreator, getNumTrials, runExperiment, setFoldCreator, setNumTrials
addListener, fireExperimentEnded, fireExperimentStarted, fireTrialEnded, fireTrialStarted, getListeners, removeListener, setListeners
clone
public SupervisedLearnerComparisonExperiment()
SupervisedLearnerComparisonExperiment
.public SupervisedLearnerComparisonExperiment(ValidationFoldCreator<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>> foldCreator, PerformanceEvaluator<? super Evaluator<? super InputType,OutputType>,? super java.util.Collection<? extends InputOutputPair<InputType,OutputType>>,? extends StatisticType> performanceEvaluator, NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> statisticalTest, Summarizer<? super StatisticType,? extends SummaryType> summarizer)
SupervisedLearnerComparisonExperiment
.foldCreator
- The object to use for creating the folds.performanceEvaluator
- The evaluator to use to compute the
performance of the learned object on each fold.statisticalTest
- The statistical test to apply to the performance
results of the two learners to determine if they are
statistically different.summarizer
- The summarizer for summarizing the result of the
performance evaluator from all the folds.