Package | Description |
---|---|
org.apache.giraph.block_app.framework.block |
Block interface as a composable unit of execution, and its common
implementations.
|
org.apache.giraph.block_app.framework.internal |
Implementation of execution logic, guiding internal execution of
Block Application.
|
org.apache.giraph.block_app.framework.piece |
Single execution object - Piece, and related classes.
|
org.apache.giraph.block_app.framework.piece.delegate |
Pieces that delegate their work to a set of one or multiple other Pieces.
|
org.apache.giraph.block_app.library.gc |
GC utility pieces.
|
org.apache.giraph.block_app.library.internal |
Internal implementation of Pieces needed for Pieces utility class.
|
org.apache.giraph.block_app.library.iteration |
Utilities for having iteration within execution stage object.
|
org.apache.giraph.block_app.migration |
Migration utility for transforming standard Giraph applications, into
Block Applications.
|
Modifier and Type | Method and Description |
---|---|
Iterator<AbstractPiece> |
RepeatUntilBlock.iterator() |
Iterator<AbstractPiece> |
FilteringBlock.iterator() |
Iterator<AbstractPiece> |
SequenceBlock.iterator() |
Iterator<AbstractPiece> |
EmptyBlock.iterator() |
Iterator<AbstractPiece> |
IfBlock.iterator() |
Iterator<AbstractPiece> |
Block.iterator()
Create iterator representing all pieces needed to be executed
in this block.
|
Iterator<AbstractPiece> |
RepeatBlock.iterator() |
Modifier and Type | Method and Description |
---|---|
void |
RepeatUntilBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
FilteringBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
SequenceBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
EmptyBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
IfBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
Block.forAllPossiblePieces(Consumer<AbstractPiece> consumer)
Calls consumer for each Piece:
- in no particular order
- potentially calling multiple times on same Piece
- even if Piece might never be returned in the iterator
- it will be called at least once for every piece that is
going to be returned by iterator
Can be used for static analysis/introspection of the block,
without actually executing them.
|
void |
RepeatBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Modifier and Type | Method and Description |
---|---|
AbstractPiece |
PairedPieceAndStage.getPiece() |
Constructor and Description |
---|
PairedPieceAndStage(AbstractPiece piece,
S executionStage) |
Modifier and Type | Class and Description |
---|---|
class |
DefaultParentPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S>
Additional abstract implementations for all pieces to be used.
|
class |
Piece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,S>
Piece that should be extended in common usecases, when we want to be:
- sending and then receiving messages from vertices
- sending data to be aggregated from workers to master
- sending values from master, via aggregators, to workers
(basically - we don't want to use WorkerContext)
|
class |
PieceWithWorkerContext<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S>
Piece that should be extended when WorkerContext is used.
|
Modifier and Type | Method and Description |
---|---|
Iterator<AbstractPiece> |
AbstractPiece.iterator() |
Modifier and Type | Method and Description |
---|---|
void |
AbstractPiece.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Modifier and Type | Class and Description |
---|---|
class |
DelegatePiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S>
Delegate Piece which allows combining multiple pieces in same iteration:
new DelegatePiece(new LogicPiece(), new StatsPiece())
You should be careful when doing so, since those pieces must not interact,
and only one can send messages.
|
class |
FilteringPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S>
Piece which uses a provided suppliers to decide whether or not to run
receive/send piece part on a certain vertex.
|
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S> |
FilteringPiece.createReceiveFiltering(SupplierFromVertex<? super I,? super V,? super E,Boolean> toCallReceive,
AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S> innerPiece)
Creates filtering piece, that filters only vertexReceive function,
and always calls vertexSend function.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,WV,WM extends org.apache.hadoop.io.Writable,S> |
FilteringPiece.createSendFiltering(SupplierFromVertex<? super I,? super V,? super E,Boolean> toCallSend,
AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S> innerPiece)
Creates filtering block, that filters only vertexSend function,
and always calls vertexReceive function.
|
Modifier and Type | Method and Description |
---|---|
void |
DelegatePiece.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Constructor and Description |
---|
DelegatePiece(AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S>... innerPieces) |
DelegatePiece(AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S> innerPiece) |
FilteringPiece(SupplierFromVertex<? super I,? super V,? super E,Boolean> toCallSendAndReceive,
AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S> innerPiece)
Creates filtering piece, where both vertexSend and vertexReceive is
filtered based on same supplier.
|
FilteringPiece(SupplierFromVertex<? super I,? super V,? super E,Boolean> toCallSend,
SupplierFromVertex<? super I,? super V,? super E,Boolean> toCallReceive,
AbstractPiece<? super I,? super V,? super E,? super M,? super WV,? super WM,? super S> innerPiece)
Creates filtering piece which uses passed
toCallSend to filter
calls to vertexSend , and passed toCallReceive to filter
calls to vertexReceive , on passed innerPiece . |
Modifier and Type | Class and Description |
---|---|
class |
WorkerGCPiece
Dummy piece to hint System.gc()
|
Modifier and Type | Class and Description |
---|---|
class |
SendMessagePiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Piece that sends a message provided through messageProducer to given set of
neighbors, and passes them to messagesConsumer.
|
class |
SendMessageWithCombinerPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Piece that sends a message provided through messageProducer to given set of
neighbors, uses a message combiner and passes them to messagesConsumer.
|
Modifier and Type | Class and Description |
---|---|
class |
IterationCounterPiece
Piece that increments execution stage iteration.
|
Modifier and Type | Class and Description |
---|---|
class |
MigrationPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,MPrev extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
Piece used when migrating applications to Blocks Framework.
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.