Package | Description |
---|---|
gov.sandia.cognition.learning.experiment |
Provides experiments for validating the performance of learning algorithms.
|
gov.sandia.cognition.statistics.method |
Provides algorithms for evaluating statistical data and conducting statistical inference, particularly frequentist methods.
|
Modifier and Type | Method and Description |
---|---|
NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> |
LearnerComparisonExperiment.getStatisticalTest()
Gets the statistical test to use to determine if the two learners are
significantly different.
|
Modifier and Type | Method and Description |
---|---|
void |
LearnerComparisonExperiment.setStatisticalTest(NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> statisticalTest)
Sets the statistical test to use to determine if the two learners are
significantly different.
|
Constructor and Description |
---|
LearnerComparisonExperiment(ValidationFoldCreator<InputDataType,FoldDataType> foldCreator,
PerformanceEvaluator<? super LearnedType,? super java.util.Collection<? extends FoldDataType>,? extends StatisticType> performanceEvaluator,
NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> statisticalTest,
Summarizer<? super StatisticType,? extends SummaryType> summarizer)
Creates a new instance of LearnerComparisonExperiment.
|
SupervisedLearnerComparisonExperiment(ValidationFoldCreator<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>> foldCreator,
PerformanceEvaluator<? super Evaluator<? super InputType,OutputType>,? super java.util.Collection<? extends InputOutputPair<InputType,OutputType>>,? extends StatisticType> performanceEvaluator,
NullHypothesisEvaluator<java.util.Collection<? extends StatisticType>> statisticalTest,
Summarizer<? super StatisticType,? extends SummaryType> summarizer)
Creates a new instance of
SupervisedLearnerComparisonExperiment . |
Modifier and Type | Interface and Description |
---|---|
interface |
BlockExperimentComparison<DataType>
Implements a null-hypothesis multiple-comparison test from a block-design
experiment.
|
Modifier and Type | Class and Description |
---|---|
class |
AnalysisOfVarianceOneWay
Analysis of Variance single-factor null-hypothesis testing procedure,
usually called "1-way ANOVA".
|
class |
ChiSquareConfidence
This is the chi-square goodness-of-fit test.
|
class |
FisherSignConfidence
This is an implementation of the Fisher Sign Test, which is a robust
nonparameteric test to determine if two groups have a different mean.
|
class |
FriedmanConfidence
The Friedman test determines if the rankings associated with various
treatments are equal.
|
class |
GaussianConfidence
This test is sometimes called the "Z test"
Defines a range of values that the statistic can take, as well as the
confidence that the statistic is between the lower and upper bounds.
|
class |
KolmogorovSmirnovConfidence
Performs a Kolmogorov-Smirnov Confidence Test.
|
class |
MannWhitneyUConfidence
Performs a Mann-Whitney U-test on the given data (usually simply called a
"U-test", sometimes called a Wilcoxon-Mann-Whitney U-test, or
Wilcoxon rank-sum test).
|
class |
MultipleComparisonExperiment
A multiple comparisons experiment that does a block comparison and then a
post-hoc test.
|
class |
StudentTConfidence
This class implements Student's t-tests for different uses.
|
class |
WilcoxonSignedRankConfidence
This is a Wilcoxon Signed-Rank Sum test, which performs a pair-wise test
to determine if two datasets are different.
|
Modifier and Type | Field and Description |
---|---|
static NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> |
AbstractPairwiseMultipleHypothesisComparison.DEFAULT_PAIRWISE_TEST
Default pair-wise confidence test: Student's Paired t-test.
|
protected NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> |
AbstractPairwiseMultipleHypothesisComparison.pairwiseTest
Confidence test used for pair-wise null-hypothesis tests.
|
Modifier and Type | Method and Description |
---|---|
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> |
AbstractPairwiseMultipleHypothesisComparison.getPairwiseTest()
Getter for pairwiseTest
|
Modifier and Type | Method and Description |
---|---|
protected void |
AbstractPairwiseMultipleHypothesisComparison.Statistic.computePairwiseTestResults(java.util.Collection<? extends java.util.Collection<? extends java.lang.Number>> data,
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Computes the pair-wise confidence test results
|
void |
AbstractPairwiseMultipleHypothesisComparison.setPairwiseTest(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Setter for pairwiseTest
|
Constructor and Description |
---|
AbstractPairwiseMultipleHypothesisComparison(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of BonferroniCorrection
|
AdjustedPValueStatistic(java.util.Collection<? extends java.util.Collection<? extends java.lang.Number>> data,
double uncompensatedAlpha,
double adjustedAlpha,
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of StudentizedMultipleComparisonStatistic
|
BonferroniCorrection(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of BonferroniCorrection
|
HolmCorrection(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of BonferroniCorrection
|
ShafferStaticCorrection(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of BonferroniCorrection
|
SidakCorrection(NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of SidakCorrection
|
Statistic(java.util.Collection<? extends java.util.Collection<? extends java.lang.Number>> data,
double uncompensatedAlpha,
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of StudentizedMultipleComparisonStatistic
|
Statistic(java.util.Collection<? extends java.util.Collection<? extends java.lang.Number>> data,
double uncompensatedAlpha,
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of Statistic
|
Statistic(java.util.Collection<? extends java.util.Collection<? extends java.lang.Number>> data,
double uncompensatedAlpha,
NullHypothesisEvaluator<java.util.Collection<? extends java.lang.Number>> pairwiseTest)
Creates a new instance of Statistic
|