edu.umass.cs.mallet.base.fst
Class TokenAccuracyEvaluator
java.lang.Object
edu.umass.cs.mallet.base.fst.TransducerEvaluator
edu.umass.cs.mallet.base.fst.TokenAccuracyEvaluator
- public class TokenAccuracyEvaluator
- extends TransducerEvaluator
Fields inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator |
alwaysEvaluateWhenFinished, checkpointFilePrefix, checkpointIterationsToSkip, checkpointTransducer, numIterationsToSkip, numIterationsToWait, printModelAtEnd, viterbiOutput, viterbiOutputEncoding, viterbiOutputFilePrefix, viterbiOutputIterationsToSkip, viterbiOutputIterationsToWait |
Method Summary |
boolean |
evaluate(Transducer crf,
boolean finishedTraining,
int iteration,
boolean converged,
double cost,
InstanceList training,
InstanceList validation,
InstanceList testing)
Evaluates a Tranducers on a given training, validation, and testing set. |
double |
getLastAccuracy()
Returns the accuracy from the last time test() or evaluate() was called |
void |
test(Transducer model,
InstanceList data,
java.lang.String description,
java.io.PrintStream viterbiOutputStream)
|
Methods inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator |
getCheckpointFilePrefix, getCheckpointIterationsToSkip, getCheckpointTransducer, getNumIterationsToSkip, getNumIterationsToWait, getViterbiOutput, getViterbiOutputEncoding, getViterbiOutputFilePrefix, getViterbiOutputIterationsToSkip, getViterbiOutputIterationsToWait, isAlwaysEvaluateWhenFinished, isPrintModelAtEnd, setAlwaysEvaluateWhenFinished, setCheckpointFilePrefix, setCheckpointIterationsToSkip, setCheckpointTransducer, setNumIterationsToSkip, setNumIterationsToWait, setPrintModelAtEnd, setViterbiOutput, setViterbiOutputEncoding, setViterbiOutputFilePrefix, setViterbiOutputIterationsToSkip, setViterbiOutputIterationsToWait, shouldDoEvaluate |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
TokenAccuracyEvaluator
public TokenAccuracyEvaluator(boolean printViterbiPath)
TokenAccuracyEvaluator
public TokenAccuracyEvaluator()
evaluate
public boolean evaluate(Transducer crf,
boolean finishedTraining,
int iteration,
boolean converged,
double cost,
InstanceList training,
InstanceList validation,
InstanceList testing)
- Description copied from class:
TransducerEvaluator
- Evaluates a Tranducers on a given training, validation, and testing set. .
The default implementation calls the evaluator's test on the
training, validation, and testing sets.
- Overrides:
evaluate
in class TransducerEvaluator
- Parameters:
crf
- The transducer to evaluate.finishedTraining
- Whether training has finished. Evaluators can be set to always evaluate when training completes.iteration
- The current iterationconverged
- Whether training has converged. Most evaluators ignore this.cost
- The current cost during training. Some evaluators may include this in the output.training
- The training set. If null, the argument is ignored.validation
- The validation set. If null, the argument is ignored.testing
- The testing set. If null, the argument is ignored.
- Returns:
- Whether training should continue.
test
public void test(Transducer model,
InstanceList data,
java.lang.String description,
java.io.PrintStream viterbiOutputStream)
- Specified by:
test
in class TransducerEvaluator
getLastAccuracy
public double getLastAccuracy()
- Returns the accuracy from the last time test() or evaluate() was called
- Returns: