Package | Description |
---|---|
org.apache.giraph.benchmark |
Package of benchmarks for performance testing and optimization
|
org.apache.giraph.block_app.framework.api.giraph |
Giraph implementation of graph processing system API used by
Blocks Framework.
|
org.apache.giraph.block_app.framework.internal |
Implementation of execution logic, guiding internal execution of
Block Application.
|
org.apache.giraph.block_app.migration |
Migration utility for transforming standard Giraph applications, into
Block Applications.
|
org.apache.giraph.examples |
Package of Giraph examples.
|
org.apache.giraph.examples.block_app |
Package of Giraph examples for Block Applications.
|
org.apache.giraph.examples.scc |
Classes for Strongly Connected Components computation.
|
org.apache.giraph.graph |
Package of all the graph related objects, built on the
org.apache.bsp package.
|
org.apache.giraph.io |
Input/Output related things.
|
org.apache.giraph.io.formats |
Package of reusable library Giraph objects.
|
org.apache.giraph.io.internal |
Input/Output classes for internal use only.
|
org.apache.giraph.io.iterables |
Iterable wrappers for IO readers/writers
|
org.apache.giraph.jython |
Jython integration.
|
org.apache.giraph.worker |
Package of all the worker related things
|
Modifier and Type | Class and Description |
---|---|
static class |
AggregatorsBenchmark.AggregatorsBenchmarkComputation
Vertex class for AggregatorsBenchmark
|
static class |
AggregatorsBenchmark.AggregatorsBenchmarkWorkerContext
WorkerContext class for AggregatorsBenchmark
|
class |
PageRankComputation
Implementation of PageRank in which vertex ids are ints, page rank values
are floats, and graph is unweighted.
|
static class |
RandomMessageBenchmark.RandomMessageBenchmarkWorkerContext
WorkerContext forRandomMessageBenchmark. |
static class |
RandomMessageBenchmark.RandomMessageComputation
Actual message computation (messaging in this case)
|
static class |
ReducersBenchmark.ReducersBenchmarkComputation
Vertex class for ReducersBenchmark
|
static class |
ReducersBenchmark.ReducersBenchmarkWorkerContext
WorkerContext class for ReducersBenchmark
|
class |
ShortestPathsComputation
Shortest paths algorithm.
|
class |
WeightedPageRankComputation
Implementation of Page Rank algorithm on a weighted graph.
|
Modifier and Type | Class and Description |
---|---|
class |
BlockComputation
Computation that executes receiver and sender blocks passed
into BlockWorkerPieces.
|
class |
BlockWorkerContext
WorkerContext that executes receiver and sender blocks passed
into BlockWorkerPieces.
|
Modifier and Type | Method and Description |
---|---|
static <S> BlockWorkerPieces<S> |
BlockWorkerPieces.getNextWorkerPieces(WorkerGlobalCommUsage worker) |
Modifier and Type | Class and Description |
---|---|
class |
MigrationAbstractComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M1 extends org.apache.hadoop.io.Writable,M2 extends org.apache.hadoop.io.Writable>
Replacement for AbstractComputation when migrating to
Blocks Framework, disallowing functions that are tied to
execution order.
|
static class |
MigrationAbstractComputation.MigrationBasicComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Drop-in replacement for BasicComputation when migrating to
Blocks Framework, disallowing functions that are tied to
execution order.
|
static class |
MigrationAbstractComputation.MigrationFullAbstractComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M1 extends org.apache.hadoop.io.Writable,M2 extends org.apache.hadoop.io.Writable>
Drop-in replacement for AbstractComputation when migrating to
Blocks Framework.
|
static class |
MigrationAbstractComputation.MigrationFullBasicComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Drop-in replacement for BasicComputation when migrating to
Blocks Framework.
|
Modifier and Type | Class and Description |
---|---|
class |
AggregatorsTestComputation
Computation which uses aggrergators.
|
static class |
AggregatorsTestComputation.SimpleEdgeReader
Simple Edge Reader
|
static class |
AggregatorsTestComputation.SimpleVertexReader
Simple VertexReader
|
class |
BrachaTouegDeadlockComputation
This code demonstrates the Bracha Toueg deadlock detection algorithm.
|
class |
ConnectedComponentsComputation
Implementation of the HCC algorithm that identifies connected components and
assigns each vertex its "component identifier" (the smallest vertex id
in the component)
The idea behind the algorithm is very simple: propagate the smallest
vertex id along the edges to all vertices of a connected component.
|
class |
GeneratedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
Used by GeneratedEdgeInputFormat
to read some generated data
|
class |
GeneratedVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
Used by GeneratedVertexInputFormat to read some generated data
|
class |
IdentityComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
User applications can subclass IdentityComputation, which
simply prints the results that have been read for testing IO related
jobs under any inputformat
|
class |
LongDoubleDoubleTextInputFormat.LongDoubleDoubleDoubleVertexReader
Vertex reader associated with
LongDoubleDoubleTextInputFormat . |
class |
LongDoubleFloatTextInputFormat.LongDoubleFloatVertexReader
Vertex reader associated with
LongDoubleDoubleTextInputFormat . |
class |
LongDoubleNullTextInputFormat.LongDoubleNullDoubleVertexReader
Vertex reader associated with
LongDoubleNullTextInputFormat . |
class |
MaxComputation
Simple algorithm that computes the max value in the graph.
|
class |
NormalizingLongDoubleDoubleTextInputFormat.NormalizingLongDoubleDoubleDoubleVertexReader
Vertex reader associated with
LongDoubleDoubleTextInputFormat . |
class |
PageRankWithKryoSimpleWritable
Copy of SimplePageRank, modified to test vertex/edge and
message values that derives from KryoSimpleWritable.
|
static class |
PageRankWithKryoSimpleWritable.PageRankWithKryoVertexReader
Simple VertexReader that supports
PageRankWithKryoSimpleWritable |
static class |
PageRankWithKryoSimpleWritable.PageRankWithKryoWorkerContext
Worker context used with
PageRankWithKryoSimpleWritable . |
class |
RandomWalkComputation<E extends org.apache.hadoop.io.Writable>
Base class for executing a random walk on a graph
|
class |
RandomWalkWithRestartComputation
Executes "RandomWalkWithRestart", a random walk on the graph which is biased
towards a source vertex.
|
class |
RandomWalkWorkerContext
Worker context for random walks.
|
static class |
SimpleCheckpoint.SimpleCheckpointComputation
Actual computation.
|
static class |
SimpleCheckpoint.SimpleCheckpointVertexWorkerContext
Worker context associated with
SimpleCheckpoint . |
class |
SimpleCombinerComputation
Test whether messages can go through a combiner.
|
class |
SimpleFailComputation
Vertex to allow unit testing of failure detection
|
class |
SimpleInDegreeCountComputation
Simple function to return the out degree for each vertex.
|
class |
SimpleLongDoubleDoubleDoubleIdentityComputation
A simple use of the Identity Vertex for taking care of Long, Double,
Double, Double type Inputformat Good for use with
io.LongDoubleDoubleAdjacencyListVertexInputFormat
|
class |
SimpleMasterComputeComputation
Demonstrates a computation with a centralized part implemented via a
MasterCompute.
|
static class |
SimpleMasterComputeComputation.SimpleMasterComputeWorkerContext
Worker context used with
SimpleMasterComputeComputation . |
class |
SimpleMsgComputation
Test whether messages can be sent and received by vertices.
|
class |
SimpleMutateGraphComputation
Vertex to allow unit testing of graph mutations.
|
static class |
SimpleMutateGraphComputation.SimpleMutateGraphVertexWorkerContext
Worker context used with
SimpleMutateGraphComputation . |
class |
SimpleOutDegreeCountComputation
Simple function to return the out degree for each vertex.
|
class |
SimplePageRankComputation
Demonstrates the basic Pregel PageRank implementation.
|
static class |
SimplePageRankComputation.SimplePageRankVertexReader
Simple VertexReader that supports
SimplePageRankComputation |
static class |
SimplePageRankComputation.SimplePageRankWorkerContext
Worker context used with
SimplePageRankComputation . |
class |
SimpleShortestPathsComputation
Demonstrates the basic Pregel shortest paths implementation.
|
class |
SimpleSuperstepComputation
Just a simple Vertex compute implementation that executes 3 supersteps, then
finishes.
|
static class |
SimpleSuperstepComputation.SimpleSuperstepVertexReader
Simple VertexReader that supports
SimpleSuperstepComputation |
class |
SimpleTriangleClosingComputation
Demonstrates triangle closing in simple,
unweighted graphs for Giraph.
|
static class |
SimpleVertexWithWorkerContext.EmitterWorkerContext
Example worker context to emit data as part of a superstep.
|
static class |
SimpleVertexWithWorkerContext.SimpleComputation
Actual vetex implementation
|
class |
TestComputationStateComputation
Vertex to test the local variables in Computation, and pre/postSuperstep
methods
|
static class |
TestComputationStateComputation.TestComputationStateWorkerContext
WorkerContext for TestComputationState
|
static class |
VerifyMessage.VerifyMessageComputation
Send and verify messages.
|
static class |
VerifyMessage.VerifyMessageComputation.VerifyMessageVertexWorkerContext
Worker context used with
VerifyMessage.VerifyMessageComputation . |
Modifier and Type | Class and Description |
---|---|
static class |
SimpleMigrationMasterBlockFactory.SimpleMigrationMasterComputation
Demonstrates a computation with a centralized part implemented via a
MasterCompute.
|
Modifier and Type | Class and Description |
---|---|
class |
SccComputation
Finds strongly connected components of the graph.
|
class |
SccLongLongNullTextInputFormat.LongLongNullVertexReader
Vertex reader associated with
SccLongLongNullTextInputFormat . |
Modifier and Type | Interface and Description |
---|---|
interface |
Computation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M1 extends org.apache.hadoop.io.Writable,M2 extends org.apache.hadoop.io.Writable>
Interface for an application for computation.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M1 extends org.apache.hadoop.io.Writable,M2 extends org.apache.hadoop.io.Writable>
See
Computation for explanation of the interface. |
class |
BasicComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Computation in which both incoming and outgoing message types are the same.
|
Modifier and Type | Method and Description |
---|---|
void |
AbstractComputation.initialize(GraphState graphState,
WorkerClientRequestProcessor<I,V,E> workerClientRequestProcessor,
CentralizedServiceWorker<I,V,E> serviceWorker,
WorkerGlobalCommUsage workerGlobalCommUsage)
Initialize, called by infrastructure before the superstep starts.
|
void |
Computation.initialize(GraphState graphState,
WorkerClientRequestProcessor<I,V,E> workerClientRequestProcessor,
CentralizedServiceWorker<I,V,E> serviceWorker,
WorkerGlobalCommUsage workerGlobalCommUsage)
Initialize, called by infrastructure before the superstep starts.
|
Modifier and Type | Class and Description |
---|---|
class |
BasicVertexValueReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Abstract base class for VertexValueReader.
|
class |
EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
Analogous to org.apache.giraph.bsp.BspRecordReader for edges.
|
class |
MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>
Will read the mapping from an input split.
|
class |
ReverseEdgeDuplicator<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
An EdgeReader that creates the opposite direction edge for each edge read.
|
class |
VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
Analogous to Hadoop's RecordReader for vertices.
|
class |
VertexValueReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Vertex reader for
VertexValueInputFormat . |
Modifier and Type | Class and Description |
---|---|
protected class |
AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader
Vertex reader associated with
AdjacencyListTextVertexInputFormat . |
class |
IntIntNullTextInputFormat.IntIntNullVertexReader
Vertex reader associated with
IntIntNullTextInputFormat . |
class |
IntIntNullTextVertexInputFormat.IntIntNullVertexReader
Vertex reader associated with
IntIntNullTextVertexInputFormat . |
class |
IntIntTextVertexValueInputFormat.IntIntTextVertexValueReader
VertexValueReader associated with
IntIntTextVertexValueInputFormat . |
class |
IntNullNullTextInputFormat.IntNullNullNullVertexReader
Reader for this InputFormat.
|
class |
IntNullTextEdgeInputFormat.IntNullTextEdgeReader
EdgeReader associated with
IntNullTextEdgeInputFormat . |
protected class |
JsonBase64VertexInputFormat.JsonBase64VertexReader
Simple reader that supports
JsonBase64VertexInputFormat |
protected class |
LongDoubleDoubleAdjacencyListVertexInputFormat.LongDoubleDoubleAdjacencyListVertexReader
VertexReader associated with
LongDoubleDoubleAdjacencyListVertexInputFormat . |
class |
LongLongNullTextInputFormat.LongLongNullVertexReader
Vertex reader associated with
LongLongNullTextInputFormat . |
static class |
SequenceFileVertexInputFormat.SequenceFileVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,X extends Vertex<I,V,E>>
Vertex reader used with
SequenceFileVertexInputFormat . |
protected class |
TextDoubleDoubleAdjacencyListVertexInputFormat.TextDoubleDoubleAdjacencyListVertexReader
Vertex reader used with
TextDoubleDoubleAdjacencyListVertexInputFormat |
protected class |
TextEdgeInputFormat.TextEdgeReader
|
protected class |
TextEdgeInputFormat.TextEdgeReaderFromEachLine
Abstract class to be implemented by the user to read an edge from each
text line.
|
protected class |
TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>
Abstract class to be implemented by the user to read an edge from each
text line after preprocessing it.
|
protected class |
TextVertexInputFormat.TextVertexReader
Abstract class to be implemented by the user based on their specific
vertex input.
|
protected class |
TextVertexInputFormat.TextVertexReaderFromEachLine
Abstract class to be implemented by the user to read a vertex from each
text line.
|
protected class |
TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<T>
Abstract class to be implemented by the user to read a vertex from each
text line after preprocessing it.
|
protected class |
TextVertexInputFormat.TextVertexReaderFromEachLineProcessedHandlingExceptions<T,X extends Throwable>
Abstract class to be implemented by the user to read a vertex from each
text line after preprocessing it with exception handling.
|
protected class |
TextVertexValueInputFormat.TextVertexValueReader
|
protected class |
TextVertexValueInputFormat.TextVertexValueReaderFromEachLine
Abstract class to be implemented by the user to read a vertex value from
each text line.
|
protected class |
TextVertexValueInputFormat.TextVertexValueReaderFromEachLineProcessed<T>
Abstract class to be implemented by the user to read a vertex value from
each text line after preprocessing it.
|
Modifier and Type | Class and Description |
---|---|
class |
WrappedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
For internal use only.
|
class |
WrappedMappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>
For internal use only.
|
class |
WrappedVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
For internal use only.
|
Modifier and Type | Method and Description |
---|---|
void |
WrappedEdgeReader.setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage) |
void |
WrappedMappingReader.setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage) |
void |
WrappedVertexReader.setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage) |
Modifier and Type | Class and Description |
---|---|
class |
EdgeReaderWrapper<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
Wraps
GiraphReader for edges into EdgeReader |
class |
MappingReaderWrapper<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>
Wraps
GiraphReader for mapping into
MappingReader |
class |
VertexReaderWrapper<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
Wraps
GiraphReader for vertices into VertexReader |
Modifier and Type | Class and Description |
---|---|
class |
JythonGiraphComputation<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M1 extends org.apache.hadoop.io.Writable,M2 extends org.apache.hadoop.io.Writable>
The
Computation class for using
Jython with Giraph. |
Modifier and Type | Interface and Description |
---|---|
interface |
WorkerThreadGlobalCommUsage
WorkerAggregatorUsage which can be used in each of the
computation threads. |
Modifier and Type | Class and Description |
---|---|
class |
DefaultWorkerContext
A dummy implementation of
WorkerContext . |
class |
WorkerAggregatorDelegator<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
Class for delegating WorkerAggregatorUsage and
WorkerGlobalCommUsage methods to corresponding interface.
|
class |
WorkerAggregatorHandler
Handler for reduce/broadcast on the workers
|
class |
WorkerAggregatorHandler.ThreadLocalWorkerGlobalCommUsage
Not thread-safe implementation of
WorkerThreadGlobalCommUsage . |
class |
WorkerContext
WorkerContext allows for the execution of user code
on a per-worker basis.
|
Modifier and Type | Method and Description |
---|---|
void |
WorkerAggregatorDelegator.setWorkerGlobalCommUsage(WorkerGlobalCommUsage workerGlobalCommUsage)
Set worker global communication usage
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.