Skip navigation links
A B C D E G I J L M N O P Q R S T U 

A

averagePrecision() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns the average precision of the query.

B

binaryPreference() - Method in class org.lemurproject.ireval.RetrievalEvaluator
The binary preference measure, as presented in Buckley, Voorhees "Retrieval Evaluation with Incomplete Information", SIGIR 2004.

C

comparisonEvaluation(SetRetrievalEvaluator, SetRetrievalEvaluator, String, String) - Static method in class org.lemurproject.ireval.IREval
Compare two sets of retrieval results.
countBaselineBetter() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
countEqual() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
countTreatmentBetter() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
create(TreeMap<String, ArrayList<RetrievalEvaluator.Document>>, TreeMap<String, ArrayList<RetrievalEvaluator.Judgment>>) - Static method in class org.lemurproject.ireval.IREval
Creates a SetRetrievalEvaluator from data from loadRanking and loadJudgments.

D

Document(String, int, double) - Constructor for class org.lemurproject.ireval.RetrievalEvaluator.Document
Constructs a new Document object.
Document(String) - Constructor for class org.lemurproject.ireval.RetrievalEvaluator.Document
Constructs a new Document object.
documentNumber - Variable in class org.lemurproject.ireval.RetrievalEvaluator.Document
The document identifier.
documentNumber - Variable in class org.lemurproject.ireval.RetrievalEvaluator.Judgment
The document identifier.

E

evaluateAll(String) - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
Get a Map containing a particular metric value for each query.

G

geometricMeanAveragePrecision() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
getEvaluators() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
getFixedPoints() - Static method in class org.lemurproject.ireval.RetrievalEvaluator
 
getFixedPoints() - Static method in class org.lemurproject.ireval.SetRetrievalEvaluator
 

I

interpolatedPrecision() - Method in class org.lemurproject.ireval.RetrievalEvaluator
 
interpolatedPrecision() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
IREval - Class in org.lemurproject.ireval
A trec_eval style tool in pure java.
IREval() - Constructor for class org.lemurproject.ireval.IREval
 
irrelevantRetrievedDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
This method returns a list of all documents that were retrieved but assumed to be irrelevant.

J

judgedIrrelevantRetrievedDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
 
Judgment(String, int) - Constructor for class org.lemurproject.ireval.RetrievalEvaluator.Judgment
Constructs a new Judgment instance.
judgment - Variable in class org.lemurproject.ireval.RetrievalEvaluator.Judgment
The relevance judgment for this document, where positive values mean relevant, and zero means not relevant.

L

loadJudgments(String) - Static method in class org.lemurproject.ireval.IREval
Loads a TREC judgments file.
loadRanking(String) - Static method in class org.lemurproject.ireval.IREval
Reads in a TREC ranking file.

M

main(String[]) - Static method in class org.lemurproject.ireval.IREval
Tool main method.
meanAveragePrecision() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanBaselineMetric() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
meanBinaryPreference() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanNormalizedDiscountedCumulativeGain() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanNormalizedDiscountedCumulativeGain(int) - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanPrecision(int) - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanReciprocalRank() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanRPrecision() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
meanTreatmentMetric() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 

N

normalizationTermNDCG(int) - Method in class org.lemurproject.ireval.RetrievalEvaluator
 
normalizedDiscountedCumulativeGain() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Normalized Discounted Cumulative Gain
normalizedDiscountedCumulativeGain(int) - Method in class org.lemurproject.ireval.RetrievalEvaluator
Normalized Discounted Cumulative Gain
numberRelevant() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
numberRelevantRetrieved() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 
numberRetrieved() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 

O

org.lemurproject.ireval - package org.lemurproject.ireval
 

P

pairedTTest() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
precision(int) - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns the precision of the retrieval at a given number of documents retrieved.
precisionAtFixedPoints() - Method in class org.lemurproject.ireval.RetrievalEvaluator
 
precisionAtFixedPoints() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 

Q

queryName() - Method in class org.lemurproject.ireval.RetrievalEvaluator
 

R

randomizedTest() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
rank - Variable in class org.lemurproject.ireval.RetrievalEvaluator.Document
The rank of the document in a retrieved ranked list.
recall(int) - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns the recall of the retrieval at a given number of documents retrieved.
reciprocalRank() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns the reciprocal of the rank of the first relevant document retrieved, or zero if no relevant documents were retrieved.
relevantDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns a list of all documents judged relevant, whether they were retrieved or not.
relevantMissedDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns a list of documents that were judged relevant that were not retrieved.
relevantRetrieved(int) - Method in class org.lemurproject.ireval.RetrievalEvaluator
The number of relevant documents retrieved at a particular rank.
relevantRetrievedDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns a list of retrieved documents that were judged relevant, in the order that they were retrieved.
RetrievalEvaluator - Class in org.lemurproject.ireval
A retrieval evaluator object computes a variety of standard information retrieval metrics commonly used in TREC, including binary preference (BPREF), geometric mean average precision (GMAP), mean average precision (MAP), and standard precision and recall.
RetrievalEvaluator(String, List<RetrievalEvaluator.Document>, Collection<RetrievalEvaluator.Judgment>) - Constructor for class org.lemurproject.ireval.RetrievalEvaluator
Creates a new instance of RetrievalEvaluator
RetrievalEvaluator.Document - Class in org.lemurproject.ireval
This class represents a document returned by a retrieval system.
RetrievalEvaluator.Judgment - Class in org.lemurproject.ireval
This class represents a relevance judgment of a particular document for a specific query.
retrievedDocuments() - Method in class org.lemurproject.ireval.RetrievalEvaluator
 
rPrecision() - Method in class org.lemurproject.ireval.RetrievalEvaluator
Returns the precision at the rank equal to the total number of relevant documents retrieved.

S

score - Variable in class org.lemurproject.ireval.RetrievalEvaluator.Document
The score given to this document by the retrieval system.
SetRetrievalComparator - Class in org.lemurproject.ireval
 
SetRetrievalComparator(Map<String, Double>, Map<String, Double>) - Constructor for class org.lemurproject.ireval.SetRetrievalComparator
Creates a new instance of SetRetrievalComparator
SetRetrievalEvaluator - Class in org.lemurproject.ireval
Computes summary statistics over a set of queries.
SetRetrievalEvaluator(Collection<RetrievalEvaluator>) - Constructor for class org.lemurproject.ireval.SetRetrievalEvaluator
Creates a new instance of SetRetrievalEvaluator
signTest() - Method in class org.lemurproject.ireval.SetRetrievalComparator
 
singleEvaluation(SetRetrievalEvaluator, boolean) - Static method in class org.lemurproject.ireval.IREval
Returns an output string very similar to that of trec_eval.
singleQuery(String, RetrievalEvaluator) - Static method in class org.lemurproject.ireval.IREval
Returns an output string very similar to that of trec_eval.

T

toString() - Method in class org.lemurproject.ireval.SetRetrievalEvaluator
 

U

usage() - Static method in class org.lemurproject.ireval.IREval
Print tool usage
A B C D E G I J L M N O P Q R S T U 
Skip navigation links