Package | Description |
---|---|
org.apache.giraph.block_app.framework.piece |
Single execution object - Piece, and related classes.
|
org.apache.giraph.block_app.framework.piece.messages |
Utility classes for handling of messages within Pieces
|
org.apache.giraph.block_app.library |
Core library of Pieces and Suppliers, providing most common usages.
|
org.apache.giraph.block_app.library.internal |
Internal implementation of Pieces needed for Pieces utility class.
|
org.apache.giraph.block_app.migration |
Migration utility for transforming standard Giraph applications, into
Block Applications.
|
org.apache.giraph.combiner |
Package of Combiners.
|
org.apache.giraph.comm.messages |
Package of classes for storing messages.
|
org.apache.giraph.comm.messages.primitives |
Package of message stores specialized for a certain type of vertex ids,
messages and combiner.
|
org.apache.giraph.conf |
Package of Giraph configuration related things.
|
org.apache.giraph.jython |
Jython integration.
|
org.apache.giraph.master |
Package of all the master related things.
|
Modifier and Type | Method and Description |
---|---|
protected MessageCombiner<? super I,M> |
DefaultParentPiece.getMessageCombiner(ImmutableClassesGiraphConfiguration conf)
Override to specify message combiner to be used, if any.
|
Modifier and Type | Method and Description |
---|---|
MessageCombiner<? super I,M> |
ObjectMessageClasses.createMessageCombiner(ImmutableClassesGiraphConfiguration<I,? extends org.apache.hadoop.io.Writable,? extends org.apache.hadoop.io.Writable> conf) |
Constructor and Description |
---|
ObjectMessageClasses(Class<M> messageClass,
SupplierFromConf<MessageValueFactory<M>> messageValueFactorySupplier,
SupplierFromConf<? extends MessageCombiner<? super I,M>> messageCombinerSupplier,
MessageEncodeAndStoreType messageEncodeAndStoreType,
boolean ignoreExistingVertices) |
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessage(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all targets provided by targetsSupplier,
and uses given messageCombiner to combine messages together.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessageToNeighbors(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all neighbors of current vertex,
and uses given messageCombiner to combine messages together.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
SendMessageChain.startSend(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier)
Start chain with sending message provided by messageSupplier to all
targets provided by targetsSupplier, and use given messageCombiner to
combine messages together.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
SendMessageChain.startSendToNeighbors(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier)
Start chain with sending message provided by messageSupplier to all
neighbors of a current vertex, and use given messageCombiner to
combine messages together.
|
<M extends org.apache.hadoop.io.Writable> |
SendMessageChain.thenSend(String name,
MessageCombiner<? super I,M> messageCombiner,
FunctionWithVertex<I,V,E,P,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier)
Give previously received message(s) to messageSupplier, and send message
it returns to all targets provided by targetsSupplier, and use given
messageCombiner to combine messages together.
|
<M extends org.apache.hadoop.io.Writable> |
SendMessageChain.thenSendToNeighbors(String name,
MessageCombiner<? super I,M> messageCombiner,
FunctionWithVertex<I,V,E,P,M> messageSupplier)
Give previously received message(s) to messageSupplier, and send message
it returns to all neighbors of current vertex, and use given
messageCombiner to combine messages together.
|
Modifier and Type | Method and Description |
---|---|
MessageCombiner<? super I,M> |
SendMessageWithCombinerPiece.getMessageCombiner(ImmutableClassesGiraphConfiguration conf) |
Constructor and Description |
---|
SendMessageWithCombinerPiece(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer) |
Modifier and Type | Method and Description |
---|---|
Class<? extends MessageCombiner> |
MigrationMasterCompute.MigrationFullMasterCompute.getMessageCombiner() |
Modifier and Type | Method and Description |
---|---|
<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,MR extends org.apache.hadoop.io.Writable,MS extends org.apache.hadoop.io.Writable> |
MigrationFullBlockFactory.createMigrationAppBlock(Class<? extends MigrationAbstractComputation.MigrationFullAbstractComputation<I,V,E,MR,MS>> computationClass,
MigrationMasterCompute.MigrationFullMasterCompute masterCompute,
Class<MS> messageClass,
Class<? extends MessageCombiner<? super I,MS>> messageCombinerClass,
GiraphConfiguration conf) |
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,MR extends org.apache.hadoop.io.Writable,MS extends org.apache.hadoop.io.Writable> |
MigrationPiece.createMigrationPiece(Class<? extends MigrationAbstractComputation<I,V,E,MR,MS>> computationClass,
MigrationMasterCompute masterCompute,
Supplier<Iterable<MR>> previousMessagesSupplier,
Consumer<Iterable<MS>> currentMessagesConsumer,
Class<MS> messageClass,
Class<? extends MessageCombiner<? super I,MS>> messageCombinerClass) |
void |
MigrationMasterCompute.MigrationFullMasterCompute.setMessageCombiner(Class<? extends MessageCombiner> combinerClass) |
Modifier and Type | Class and Description |
---|---|
class |
DoubleSumMessageCombiner
Deprecated.
|
class |
FloatSumMessageCombiner
Deprecated.
|
class |
MaxMessageCombiner<M extends org.apache.hadoop.io.WritableComparable>
Message combiner which calculates max of all messages.
|
class |
MinimumDoubleMessageCombiner
MessageCombiner which finds the minimum of
DoubleWritable . |
class |
MinimumIntMessageCombiner
MessageCombiner that finds the minimum IntWritable |
class |
MinMessageCombiner<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Keeps only the message with minimum value.
|
class |
NullMessageCombiner
Keeps only one NullMessage.
|
class |
SimpleSumMessageCombiner
Deprecated.
|
class |
SumMessageCombiner<M extends org.apache.hadoop.io.Writable>
Message combiner which sums all messages.
|
Modifier and Type | Method and Description |
---|---|
protected MessageStore<I,M> |
InMemoryMessageStoreFactory.newStoreWithCombiner(Class<M> messageClass,
MessageValueFactory<M> messageValueFactory,
MessageCombiner<? super I,M> messageCombiner)
MessageStore to be used when combiner is enabled
|
Constructor and Description |
---|
OneMessagePerVertexStore(MessageValueFactory<M> messageValueFactory,
PartitionSplitInfo<I> partitionInfo,
MessageCombiner<? super I,M> messageCombiner,
ImmutableClassesGiraphConfiguration<I,?,?> config) |
Constructor and Description |
---|
IdOneMessagePerVertexStore(MessageValueFactory<M> messageValueFactory,
PartitionSplitInfo<I> partitionInfo,
MessageCombiner<? super I,M> messageCombiner,
ImmutableClassesGiraphConfiguration<I,?,?> config)
Constructor
|
IntFloatMessageStore(PartitionSplitInfo<org.apache.hadoop.io.IntWritable> partitionInfo,
MessageCombiner<? super org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable> messageCombiner)
Constructor
|
LongDoubleMessageStore(PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo,
MessageCombiner<? super org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable> messageCombiner)
Constructor
|
Modifier and Type | Field and Description |
---|---|
static ClassConfOption<MessageCombiner> |
GiraphConstants.MESSAGE_COMBINER_CLASS
Message combiner class - optional
|
Modifier and Type | Method and Description |
---|---|
MessageCombiner<? super I,M> |
DefaultMessageClasses.createMessageCombiner(ImmutableClassesGiraphConfiguration conf) |
MessageCombiner<? super I,M> |
MessageClasses.createMessageCombiner(ImmutableClassesGiraphConfiguration<I,? extends org.apache.hadoop.io.Writable,? extends org.apache.hadoop.io.Writable> conf)
Create new instance of MessageCombiner
|
<M extends org.apache.hadoop.io.Writable> |
ImmutableClassesGiraphConfiguration.createOutgoingMessageCombiner()
Create a user combiner class
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultMessageClasses.setMessageCombinerClass(Class<? extends MessageCombiner<? super I,M>> messageCombinerClass) |
void |
GiraphConfiguration.setMessageCombinerClass(Class<? extends MessageCombiner> messageCombinerClass)
Set the message combiner class (optional)
|
void |
ImmutableClassesGiraphConfiguration.setMessageCombinerClass(Class<? extends MessageCombiner> messageCombinerClass) |
Constructor and Description |
---|
DefaultMessageClasses(Class<M> messageClass,
Class<? extends MessageValueFactory<M>> messageValueFactoryClass,
Class<? extends MessageCombiner<? super I,M>> messageCombinerClass,
MessageEncodeAndStoreType messageEncodeAndStoreType)
Constructor
|
Modifier and Type | Method and Description |
---|---|
Class<? extends MessageCombiner> |
JythonJob.getMessageCombiner() |
Modifier and Type | Method and Description |
---|---|
void |
JythonJob.setMessageCombiner(Class<? extends MessageCombiner> messageCombiner) |
Modifier and Type | Method and Description |
---|---|
Class<? extends MessageCombiner> |
MasterCompute.getMessageCombiner()
Get MessageCombiner class to be used
|
Class<? extends MessageCombiner> |
SuperstepClasses.getMessageCombinerClass()
Get message combiner class
|
Modifier and Type | Method and Description |
---|---|
void |
MasterCompute.setMessageCombiner(Class<? extends MessageCombiner> combinerClass)
Set MessageCombiner class to be used
|
void |
SuperstepClasses.setMessageCombinerClass(Class<? extends MessageCombiner> messageCombinerClass)
Set message combiner class.
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.