Class | Description |
---|---|
ConceptLoader |
Loads an Iterable of mapped concepts (Universal Pages) into a database.
|
DumpLoader |
Load the contents of a dump into the various daos.
|
InterLanguageLinkExtractor | |
LoadedStats | |
LuceneLoader |
This loader indexes raw pages into the lucene index.
|
PhraseLoader | |
PipelineLoader |
Runs stages in the pipeline.
|
RedirectLoader |
Idea for changing the flow of parsing:
- First load all redirect page id -> page id into memory (TIntIntHashMap).
|
SqlLinksLoader |
Loads links that are in the SQL dump but not the parsed wiki text.
|
UniversalLinkLoader |
Generates and loads the Universal Link map into a database.
|
WikiTextLoader |
Parses the wiki text associated with articles
and populates data stores for links, ills, and categories.
|
Copyright © 2014. All rights reserved.