edu.umass.cs.mallet.projects.seg_plus_coref.ie
Class MultiSegmentationEvaluator

java.lang.Object
  extended byedu.umass.cs.mallet.base.fst.TransducerEvaluator
      extended byedu.umass.cs.mallet.projects.seg_plus_coref.ie.MultiSegmentationEvaluator

public class MultiSegmentationEvaluator
extends TransducerEvaluator


Field Summary
 
Fields inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator
printModelAtEnd
 
Constructor Summary
MultiSegmentationEvaluator(java.lang.Object[] segmentStartTags, java.lang.Object[] segmentContinueTags)
           
MultiSegmentationEvaluator(java.lang.Object[] segmentStartTags, java.lang.Object[] segmentContinueTags, java.lang.String viterbiOutputFilePrefix, int viterbiOutputIterationsToSkip)
           
 
Method Summary
 boolean evaluate(Transducer crf, boolean finishedTraining, int iteration, boolean converged, double cost, InstanceList training, InstanceList validation, InstanceList testing)
          Evaluates a Tranducers on a given training, validation, and testing set.
 int getEvalIterations()
           
 void test(Transducer transducer, InstanceList data, java.lang.String description, java.io.PrintStream viterbiOutputStream)
           
 
Methods inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator
getCheckpointFilePrefix, getCheckpointIterationsToSkip, getCheckpointTransducer, getNumIterationsToSkip, getNumIterationsToWait, getViterbiOutput, getViterbiOutputEncoding, getViterbiOutputFilePrefix, getViterbiOutputIterationsToSkip, getViterbiOutputIterationsToWait, isAlwaysEvaluateWhenFinished, isPrintModelAtEnd, setAlwaysEvaluateWhenFinished, setCheckpointFilePrefix, setCheckpointIterationsToSkip, setCheckpointTransducer, setNumIterationsToSkip, setNumIterationsToWait, setPrintModelAtEnd, setViterbiOutput, setViterbiOutputEncoding, setViterbiOutputFilePrefix, setViterbiOutputIterationsToSkip, setViterbiOutputIterationsToWait, shouldDoEvaluate
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

MultiSegmentationEvaluator

public MultiSegmentationEvaluator(java.lang.Object[] segmentStartTags,
                                  java.lang.Object[] segmentContinueTags)

MultiSegmentationEvaluator

public MultiSegmentationEvaluator(java.lang.Object[] segmentStartTags,
                                  java.lang.Object[] segmentContinueTags,
                                  java.lang.String viterbiOutputFilePrefix,
                                  int viterbiOutputIterationsToSkip)
Method Detail

getEvalIterations

public int getEvalIterations()

test

public void test(Transducer transducer,
                 InstanceList data,
                 java.lang.String description,
                 java.io.PrintStream viterbiOutputStream)
Specified by:
test in class TransducerEvaluator

evaluate

public boolean evaluate(Transducer crf,
                        boolean finishedTraining,
                        int iteration,
                        boolean converged,
                        double cost,
                        InstanceList training,
                        InstanceList validation,
                        InstanceList testing)
Description copied from class: TransducerEvaluator
Evaluates a Tranducers on a given training, validation, and testing set. .

The default implementation calls the evaluator's test on the training, validation, and testing sets.

Overrides:
evaluate in class TransducerEvaluator
Parameters:
crf - The transducer to evaluate.
finishedTraining - Whether training has finished. Evaluators can be set to always evaluate when training completes.
iteration - The current iteration
converged - Whether training has converged. Most evaluators ignore this.
cost - The current cost during training. Some evaluators may include this in the output.
training - The training set. If null, the argument is ignored.
validation - The validation set. If null, the argument is ignored.
testing - The testing set. If null, the argument is ignored.
Returns:
Whether training should continue.