org.apache.giraph.comm.messages.primitives

Class IntFloatMessageStore

java.lang.Object

org.apache.giraph.comm.messages.primitives.IntFloatMessageStore

All Implemented Interfaces:

MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

public class IntFloatMessageStore
extends Object
implements MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Special message store to be used when ids are IntWritable and messages are FloatWritable and messageCombiner is used. Uses fastutil primitive maps in order to decrease number of objects and get better performance.

Constructor Summary

Constructors

Constructor and Description
IntFloatMessageStore(PartitionSplitInfo<org.apache.hadoop.io.IntWritable> partitionInfo, MessageCombiner<? super org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable> messageCombiner) Constructor

Method Summary

Modifier and Type	Method and Description
void	addMessage(org.apache.hadoop.io.IntWritable vertexId, org.apache.hadoop.io.FloatWritable message) Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages
void	addPartitionMessages(int partitionId, VertexIdMessages<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable> messages) Adds messages for partition
void	clearAll() Clears all resources used by this store.
void	clearPartition(int partitionId) Clears messages for a partition.
void	clearVertexMessages(org.apache.hadoop.io.IntWritable vertexId) Clears messages for a vertex.
void	finalizeStore() Called before start of computation in bspworker Since it is run from a single thread while the store is not being accessed by any other thread - this is ensured to be thread-safe
Iterable<org.apache.hadoop.io.IntWritable>	getPartitionDestinationVertices(int partitionId) Gets vertex ids from selected partition which we have messages for
Iterable<org.apache.hadoop.io.FloatWritable>	getVertexMessages(org.apache.hadoop.io.IntWritable vertexId) Gets messages for a vertex.
boolean	hasMessagesForPartition(int partitionId) Check if we have messages for some partition
boolean	hasMessagesForVertex(org.apache.hadoop.io.IntWritable vertexId) Check if we have messages for some vertex
boolean	isPointerListEncoding() True if this message-store encodes messages as a list of long pointers to compact serialized messages
void	readFieldsForPartition(DataInput in, int partitionId) Deserialize messages for one partition
void	writePartition(DataOutput out, int partitionId) Serialize messages for one partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IntFloatMessageStore

public IntFloatMessageStore(PartitionSplitInfo<org.apache.hadoop.io.IntWritable> partitionInfo,
                            MessageCombiner<? super org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable> messageCombiner)

Constructor

Parameters:

partitionInfo - Partition split info

messageCombiner - Message messageCombiner

Method Detail

isPointerListEncoding

public boolean isPointerListEncoding()

Description copied from interface: MessageStore

True if this message-store encodes messages as a list of long pointers to compact serialized messages

Specified by:

isPointerListEncoding in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Returns:

true if we encode messages as a list of pointers

addPartitionMessages

public void addPartitionMessages(int partitionId,
                                 VertexIdMessages<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable> messages)

Description copied from interface: MessageStore

Adds messages for partition

Specified by:

addPartitionMessages in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

partitionId - Id of partition

messages - Collection of vertex ids and messages we want to add

addMessage

public void addMessage(org.apache.hadoop.io.IntWritable vertexId,
                       org.apache.hadoop.io.FloatWritable message)
                throws IOException

Description copied from interface: MessageStore

Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages

Specified by:

addMessage in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

vertexId - Id of target vertex

message - A message to send

Throws:

IOException

finalizeStore

public void finalizeStore()

Description copied from interface: MessageStore

Called before start of computation in bspworker Since it is run from a single thread while the store is not being accessed by any other thread - this is ensured to be thread-safe

Specified by:

finalizeStore in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

clearPartition

public void clearPartition(int partitionId)

Description copied from interface: MessageStore

Clears messages for a partition.

Specified by:

clearPartition in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

partitionId - Partition id for which we want to clear messages

hasMessagesForVertex

public boolean hasMessagesForVertex(org.apache.hadoop.io.IntWritable vertexId)

Description copied from interface: MessageStore

Check if we have messages for some vertex

Specified by:

hasMessagesForVertex in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

vertexId - Id of vertex which we want to check

Returns:

True iff we have messages for vertex with required id

hasMessagesForPartition

public boolean hasMessagesForPartition(int partitionId)

Description copied from interface: MessageStore

Check if we have messages for some partition

Specified by:

hasMessagesForPartition in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

partitionId - Id of partition which we want to check

Returns:

True iff we have messages for the given partition

getVertexMessages

public Iterable<org.apache.hadoop.io.FloatWritable> getVertexMessages(org.apache.hadoop.io.IntWritable vertexId)

Description copied from interface: MessageStore

Gets messages for a vertex. The lifetime of every message is only guaranteed until the iterator's next() method is called. Do not hold references to objects returned by this iterator.

Specified by:

getVertexMessages in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

vertexId - Vertex id for which we want to get messages

Returns:

Iterable of messages for a vertex id

clearVertexMessages

public void clearVertexMessages(org.apache.hadoop.io.IntWritable vertexId)

Description copied from interface: MessageStore

Clears messages for a vertex.

Specified by:

clearVertexMessages in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

vertexId - Vertex id for which we want to clear messages

clearAll

public void clearAll()

Description copied from interface: MessageStore

Clears all resources used by this store.

Specified by:

clearAll in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

getPartitionDestinationVertices

public Iterable<org.apache.hadoop.io.IntWritable> getPartitionDestinationVertices(int partitionId)

Description copied from interface: MessageStore

Gets vertex ids from selected partition which we have messages for

Specified by:

getPartitionDestinationVertices in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

partitionId - Id of partition

Returns:

Iterable over vertex ids which we have messages for

writePartition

public void writePartition(DataOutput out,
                           int partitionId)
                    throws IOException

Description copied from interface: MessageStore

Serialize messages for one partition.

Specified by:

writePartition in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

out - DataOutput to serialize this object into

partitionId - Id of partition

Throws:

IOException

readFieldsForPartition

public void readFieldsForPartition(DataInput in,
                                   int partitionId)
                            throws IOException

Description copied from interface: MessageStore

Deserialize messages for one partition

Specified by:

readFieldsForPartition in interface MessageStore<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.FloatWritable>

Parameters:

in - DataInput to deserialize this object from.

partitionId - Id of partition

Throws:

IOException