org.apache.giraph.io

Class EdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeInputFormat<I,E>

Type Parameters:

I - Vertex id

E - Edge data

All Implemented Interfaces:

GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>

Direct Known Subclasses:

AggregatorsTestComputation.SimpleEdgeInputFormat, MultiEdgeInputFormat, PseudoRandomEdgeInputFormat, TextEdgeInputFormat, WrappedEdgeInputFormat

public abstract class EdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends GiraphInputFormat<I,org.apache.hadoop.io.Writable,E>

Input format for reading single edges. Provides access to ImmutableClassesGiraphConfiguration. It's guaranteed that whatever parameters are set in the configuration are also going to be available in all method arguments related to this input format (context in getSplits and createEdgeReader; methods invoked on EdgeReader). So if backing input format relies on some parameters from configuration, you can safely set them for example in DefaultImmutableClassesGiraphConfigurable.setConf(org.apache.giraph.conf.ImmutableClassesGiraphConfiguration).

Constructor Summary

Constructors

Constructor and Description
EdgeInputFormat()

Method Summary

Modifier and Type	Method and Description
abstract EdgeReader<I,E>	createEdgeReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create an edge reader for a given split.

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

checkInputSpecs, getSplits, readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EdgeInputFormat

public EdgeInputFormat()

Method Detail

createEdgeReader

public abstract EdgeReader<I,E> createEdgeReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                 org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                          throws IOException

Create an edge reader for a given split. The framework will call EdgeReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

IOException