org.apache.nutch.fetcher
Class FetcherOutputFormat

java.lang.Object
  extended by org.apache.nutch.fetcher.FetcherOutputFormat
All Implemented Interfaces:
org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

public class FetcherOutputFormat
extends Object
implements org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.


Constructor Summary
FetcherOutputFormat()
           
 
Method Summary
 void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job)
           
 org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()
Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs,
                             org.apache.hadoop.mapred.JobConf job)
                      throws IOException
Specified by:
checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
Throws:
IOException

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
                                                                                                      org.apache.hadoop.mapred.JobConf job,
                                                                                                      String name,
                                                                                                      org.apache.hadoop.util.Progressable progress)
                                                                                               throws IOException
Specified by:
getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
Throws:
IOException


Copyright © 2006 The Apache Software Foundation