A B D F G I L M O P R S 

A

add(DumpLinkInfo) - Method in class org.wikibrain.download.DumpLinkCluster
 
availableDumpDatesSorted(List<Date>) - Method in class org.wikibrain.download.RequestedLinkGetter
Return a sorted list of dump dates before the date requested.

B

BASEURL_STRING - Static variable in class org.wikibrain.download.DumpLinkGetter
 

D

download(URL, File) - Method in class org.wikibrain.download.FileDownloader
 
downloadFrom(File) - Method in class org.wikibrain.download.DumpFileDownloader
Processes a tsv file containing dump link info and initiates the download process on that info.
DumpFileDownloader - Class in org.wikibrain.download
Downloads dumps from a specified tsv file containing lines of dump links.
DumpFileDownloader(File) - Constructor for class org.wikibrain.download.DumpFileDownloader
 
DumpLinkCluster - Class in org.wikibrain.download
This class wraps a complex map of DumpLinkInfo, and provides iteration by language so that during the download process, downloads proceed one language at a time.
DumpLinkCluster() - Constructor for class org.wikibrain.download.DumpLinkCluster
 
DumpLinkGetter - Class in org.wikibrain.download
 
DumpLinkGetter(Language, List<FileMatcher>, String) - Constructor for class org.wikibrain.download.DumpLinkGetter
 
DumpLinkInfo - Class in org.wikibrain.download
A wrapper class for storing and processing information about a dump link.
DumpLinkInfo(Language, String, FileMatcher, URL, int) - Constructor for class org.wikibrain.download.DumpLinkInfo
 
DumpLinkInfo(String, String, String, String, String, int) - Constructor for class org.wikibrain.download.DumpLinkInfo
 

F

FileDownloader - Class in org.wikibrain.download
A utility class to download files from urls.
FileDownloader() - Constructor for class org.wikibrain.download.FileDownloader
 

G

get(Language) - Method in class org.wikibrain.download.DumpLinkCluster
 
getAllDates() - Method in class org.wikibrain.download.RequestedLinkGetter
Return all dates on the dump index page of a particular language.
getCounter() - Method in class org.wikibrain.download.DumpLinkInfo
 
getDate() - Method in class org.wikibrain.download.DumpLinkInfo
 
getDownloadName() - Method in class org.wikibrain.download.DumpLinkInfo
 
getDumpFiles(List<String>) - Method in class org.wikibrain.download.DumpLinkGetter
Return all links of a particular language the fits one of the patterns
getDumps() - Method in class org.wikibrain.download.RequestedLinkGetter
Get dump file links of the most recent available before the requestDate.
getFileLinks() - Method in class org.wikibrain.download.DumpLinkGetter
Get file links that are marked "done" (plus MD5sum) on a dump page of the specified language and specified dumpDate
getFileName() - Method in class org.wikibrain.download.DumpLinkInfo
Returns a string for the file name with which to save this dump file
getLangLinks() - Method in class org.wikibrain.download.RequestedLinkGetter
 
getLanguage() - Method in class org.wikibrain.download.DumpLinkInfo
 
getLanguageWikiUrl() - Method in class org.wikibrain.download.DumpLinkGetter
Get the URL of the index wiki page of a specified language.
getLinkMatcher() - Method in class org.wikibrain.download.DumpLinkInfo
 
getLocalPath() - Method in class org.wikibrain.download.DumpLinkInfo
Returns a string for the local path in which to save this dump file
getMd5() - Method in class org.wikibrain.download.DumpLinkInfo
 
getMd5Sums(List<String>) - Method in class org.wikibrain.download.DumpLinkGetter
Get MD5 of the dump of the specified language and dumpDate.
getOneFile(DumpLinkInfo) - Method in class org.wikibrain.download.DumpFileDownloader
Attempts to download the specified file.
getUrl() - Method in class org.wikibrain.download.DumpLinkInfo
 

I

iterator() - Method in class org.wikibrain.download.DumpLinkCluster
 

L

LOG - Static variable in class org.wikibrain.download.FileDownloader
 

M

main(String[]) - Static method in class org.wikibrain.download.DumpFileDownloader
 
main(String[]) - Static method in class org.wikibrain.download.DumpLinkGetter
 
main(String[]) - Static method in class org.wikibrain.download.RequestedLinkGetter
Parse command line and generate .tsv file containing language code, date of dump, name of file type and link url.

O

org.wikibrain.download - package org.wikibrain.download
 

P

parseFile(File) - Static method in class org.wikibrain.download.DumpLinkInfo
Parses a file of info pertaining to dump links into a cluster of DumpLinkInfo.

R

RequestedLinkGetter - Class in org.wikibrain.download
Get URLs of the dump file links with specified language, type of dump file and the date before which the dumps are pulled.
RequestedLinkGetter(Language, List<FileMatcher>, Date) - Constructor for class org.wikibrain.download.RequestedLinkGetter
 

S

setBackoffTime(int) - Method in class org.wikibrain.download.FileDownloader
 
setCounter(int) - Method in class org.wikibrain.download.DumpLinkInfo
 
setDate(String) - Method in class org.wikibrain.download.DumpLinkInfo
 
setDisplayInfo(int) - Method in class org.wikibrain.download.FileDownloader
 
setLanguage(Language) - Method in class org.wikibrain.download.DumpLinkInfo
 
setLinkMatcher(FileMatcher) - Method in class org.wikibrain.download.DumpLinkInfo
 
setMaxAttempts(int) - Method in class org.wikibrain.download.FileDownloader
 
setMd5(String) - Method in class org.wikibrain.download.DumpLinkInfo
 
setSleepTime(int) - Method in class org.wikibrain.download.FileDownloader
 
setUrl(URL) - Method in class org.wikibrain.download.DumpLinkInfo
 
size() - Method in class org.wikibrain.download.DumpLinkCluster
 
A B D F G I L M O P R S 

Copyright © 2014. All rights reserved.