edu.umass.cs.mallet.base.fst
Class TokenAccuracyEvaluator

java.lang.Object
  extended byedu.umass.cs.mallet.base.fst.TransducerEvaluator
      extended byedu.umass.cs.mallet.base.fst.TokenAccuracyEvaluator

public class TokenAccuracyEvaluator
extends TransducerEvaluator


Field Summary
 
Fields inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator
alwaysEvaluateWhenFinished, checkpointFilePrefix, checkpointIterationsToSkip, checkpointTransducer, numIterationsToSkip, numIterationsToWait, printModelAtEnd, viterbiOutput, viterbiOutputEncoding, viterbiOutputFilePrefix, viterbiOutputIterationsToSkip, viterbiOutputIterationsToWait
 
Constructor Summary
TokenAccuracyEvaluator()
           
TokenAccuracyEvaluator(boolean printViterbiPath)
           
 
Method Summary
 boolean evaluate(Transducer crf, boolean finishedTraining, int iteration, boolean converged, double cost, InstanceList training, InstanceList validation, InstanceList testing)
          Evaluates a Tranducers on a given training, validation, and testing set.
 double getLastAccuracy()
          Returns the accuracy from the last time test() or evaluate() was called
 void test(Transducer model, InstanceList data, java.lang.String description, java.io.PrintStream viterbiOutputStream)
           
 
Methods inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator
getCheckpointFilePrefix, getCheckpointIterationsToSkip, getCheckpointTransducer, getNumIterationsToSkip, getNumIterationsToWait, getViterbiOutput, getViterbiOutputEncoding, getViterbiOutputFilePrefix, getViterbiOutputIterationsToSkip, getViterbiOutputIterationsToWait, isAlwaysEvaluateWhenFinished, isPrintModelAtEnd, setAlwaysEvaluateWhenFinished, setCheckpointFilePrefix, setCheckpointIterationsToSkip, setCheckpointTransducer, setNumIterationsToSkip, setNumIterationsToWait, setPrintModelAtEnd, setViterbiOutput, setViterbiOutputEncoding, setViterbiOutputFilePrefix, setViterbiOutputIterationsToSkip, setViterbiOutputIterationsToWait, shouldDoEvaluate
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

TokenAccuracyEvaluator

public TokenAccuracyEvaluator(boolean printViterbiPath)

TokenAccuracyEvaluator

public TokenAccuracyEvaluator()
Method Detail

evaluate

public boolean evaluate(Transducer crf,
                        boolean finishedTraining,
                        int iteration,
                        boolean converged,
                        double cost,
                        InstanceList training,
                        InstanceList validation,
                        InstanceList testing)
Description copied from class: TransducerEvaluator
Evaluates a Tranducers on a given training, validation, and testing set. .

The default implementation calls the evaluator's test on the training, validation, and testing sets.

Overrides:
evaluate in class TransducerEvaluator
Parameters:
crf - The transducer to evaluate.
finishedTraining - Whether training has finished. Evaluators can be set to always evaluate when training completes.
iteration - The current iteration
converged - Whether training has converged. Most evaluators ignore this.
cost - The current cost during training. Some evaluators may include this in the output.
training - The training set. If null, the argument is ignored.
validation - The validation set. If null, the argument is ignored.
testing - The testing set. If null, the argument is ignored.
Returns:
Whether training should continue.

test

public void test(Transducer model,
                 InstanceList data,
                 java.lang.String description,
                 java.io.PrintStream viterbiOutputStream)
Specified by:
test in class TransducerEvaluator

getLastAccuracy

public double getLastAccuracy()
Returns the accuracy from the last time test() or evaluate() was called

Returns: