|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc>
org.apache.nutch.indexer.DeleteDuplicates.InputFormat
public static class DeleteDuplicates.InputFormat
Nested Class Summary | |
---|---|
class |
DeleteDuplicates.InputFormat.DDRecordReader
|
Field Summary |
---|
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat |
---|
LOG |
Constructor Summary | |
---|---|
DeleteDuplicates.InputFormat()
|
Method Summary | |
---|---|
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc> |
getRecordReader(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf job,
org.apache.hadoop.mapred.Reporter reporter)
Return each index as a split. |
org.apache.hadoop.mapred.InputSplit[] |
getSplits(org.apache.hadoop.mapred.JobConf job,
int numSplits)
Return each index as a split. |
Methods inherited from class org.apache.hadoop.mapred.FileInputFormat |
---|
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, isSplitable, listPaths, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize, validateInput |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DeleteDuplicates.InputFormat()
Method Detail |
---|
public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits) throws IOException
getSplits
in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc>
getSplits
in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc>
IOException
public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc> getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter) throws IOException
getRecordReader
in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc>
getRecordReader
in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc>
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |