org.apache.giraph.worker

Class VertexInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.worker.InputSplitsCallable<I,V,E>

org.apache.giraph.worker.VertexInputSplitsCallable<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

Callable<VertexEdgeCount>

public class VertexInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends InputSplitsCallable<I,V,E>

Load as many vertex input splits as possible. Every thread will has its own instance of WorkerClientRequestProcessor to send requests.

Field Summary

Fields

Modifier and Type	Field and Description
static int	VERTICES_FILTERED_UPDATE_PERIOD How often to update filtered out metrics
static int	VERTICES_UPDATE_PERIOD How often to update metrics and print info

Fields inherited from class org.apache.giraph.worker.InputSplitsCallable

configuration, context, workerClientRequestProcessor

Constructor Summary

Constructors

Constructor and Description
VertexInputSplitsCallable(VertexInputFormat<I,V,E> vertexInputFormat, org.apache.hadoop.mapreduce.Mapper.Context context, ImmutableClassesGiraphConfiguration<I,V,E> configuration, BspServiceWorker<I,V,E> bspServiceWorker, WorkerInputSplitsHandler splitsHandler) Constructor.

Method Summary

Modifier and Type	Method and Description
GiraphInputFormat	getInputFormat() Get input format
InputType	getInputType() Get input type
protected VertexEdgeCount	readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit) Read vertices from input split.

Methods inherited from class org.apache.giraph.worker.InputSplitsCallable

call, getInputSplit, getTotalEdgesFilteredCounter, getTotalEdgesLoadedMeter, getTotalVerticesFilteredCounter, getTotalVerticesLoadedMeter, initMetrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

VERTICES_UPDATE_PERIOD

public static final int VERTICES_UPDATE_PERIOD

How often to update metrics and print info

See Also:

Constant Field Values

VERTICES_FILTERED_UPDATE_PERIOD

public static final int VERTICES_FILTERED_UPDATE_PERIOD

How often to update filtered out metrics

See Also:

Constant Field Values

Constructor Detail

VertexInputSplitsCallable

public VertexInputSplitsCallable(VertexInputFormat<I,V,E> vertexInputFormat,
                                 org.apache.hadoop.mapreduce.Mapper.Context context,
                                 ImmutableClassesGiraphConfiguration<I,V,E> configuration,
                                 BspServiceWorker<I,V,E> bspServiceWorker,
                                 WorkerInputSplitsHandler splitsHandler)

Constructor.

Parameters:

vertexInputFormat - Vertex input format

context - Context

configuration - Configuration

bspServiceWorker - service worker

splitsHandler - Handler for input splits

Method Detail

getInputFormat

public GiraphInputFormat getInputFormat()

Description copied from class: InputSplitsCallable

Get input format

Specified by:

getInputFormat in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input format

getInputType

public InputType getInputType()

Description copied from class: InputSplitsCallable

Get input type

Specified by:

getInputType in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input type

readInputSplit

protected VertexEdgeCount readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit)
                                  throws IOException,
                                         InterruptedException

Read vertices from input split. If testing, the user may request a maximum number of vertices to be read from an input split.

Specified by:

readInputSplit in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to process with vertex reader

Returns:

Vertices and edges loaded from this input split

Throws:

IOException

InterruptedException