Package | Description |
---|---|
org.apache.giraph.comm |
Package of communication related objects, IPC service.
|
org.apache.giraph.comm.messages |
Package of classes for storing messages.
|
org.apache.giraph.comm.messages.primitives |
Package of message stores specialized for a certain type of vertex ids,
messages and combiner.
|
org.apache.giraph.comm.messages.primitives.long_id |
Message store based off of primitives when I = LongWritable
|
org.apache.giraph.comm.messages.queue |
Package for message store queue, that decouples netty threads from
threads processing messages.
|
org.apache.giraph.graph |
Package of all the graph related objects, built on the
org.apache.bsp package.
|
org.apache.giraph.ooc.data |
Package of classes related to data structures used for an out-of-core
mechanism
|
Modifier and Type | Method and Description |
---|---|
<M extends org.apache.hadoop.io.Writable> |
ServerData.getCurrentMessageStore()
Get message store for current messages (messages which we received in
previous super step and which will be consumed in current super step)
|
<M extends org.apache.hadoop.io.Writable> |
ServerData.getIncomingMessageStore()
Get message store for incoming messages (messages which will be consumed
in the next super step)
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractListPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,L extends List>
Abstract Implementation of
SimpleMessageStore where
multiple messages are stored per vertex as a list
Used when there is no combiner provided. |
class |
ByteArrayMessagesPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Implementation of
SimpleMessageStore where multiple messages are
stored per vertex as byte backed datastructures. |
class |
OneMessagePerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Implementation of
SimpleMessageStore where we have a single
message per vertex. |
class |
PointerListPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Implementation of
SimpleMessageStore where multiple messages are
stored as a list of long pointers to extended data output objects
Used when there is no combiner provided. |
class |
SimpleMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,T>
Abstract class for
MessageStore which allows any kind
of object to hold messages for one vertex. |
Modifier and Type | Method and Description |
---|---|
MessageStore<I,M> |
InMemoryMessageStoreFactory.newStore(MessageClasses<I,M> messageClasses) |
MessageStore<I,M> |
ByteArrayMessagesPerVertexStore.Factory.newStore(MessageClasses<I,M> messageClasses) |
protected MessageStore<I,M> |
InMemoryMessageStoreFactory.newStoreWithCombiner(Class<M> messageClass,
MessageValueFactory<M> messageValueFactory,
MessageCombiner<? super I,M> messageCombiner)
MessageStore to be used when combiner is enabled
|
protected MessageStore<I,M> |
InMemoryMessageStoreFactory.newStoreWithoutCombiner(Class<M> messageClass,
MessageValueFactory<M> messageValueFactory,
MessageEncodeAndStoreType encodeAndStore)
MessageStore to be used when combiner is not enabled
|
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable> |
OneMessagePerVertexStore.newFactory(CentralizedServiceWorker<I,?,?> service,
ImmutableClassesGiraphConfiguration<I,?,?> config)
Create new factory for this message store
|
static <I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable> |
ByteArrayMessagesPerVertexStore.newFactory(CentralizedServiceWorker<I,?,?> service,
ImmutableClassesGiraphConfiguration<I,?,?> config)
Create new factory for this message store
|
Modifier and Type | Class and Description |
---|---|
class |
IdByteArrayMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Special message store to be used when IDs are primitive and no combiner is
used.
|
class |
IdOneMessagePerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Special message store to be used when IDs are primitive and message doesn't
need to be, and message combiner is used.
|
class |
IntFloatMessageStore
Special message store to be used when ids are IntWritable and messages
are FloatWritable and messageCombiner is used.
|
class |
LongDoubleMessageStore
Special message store to be used when ids are LongWritable and messages
are DoubleWritable and messageCombiner is used.
|
Modifier and Type | Class and Description |
---|---|
class |
LongAbstractListStore<M extends org.apache.hadoop.io.Writable,L extends List>
Special message store to be used when ids are LongWritable and no combiner
is used.
|
class |
LongAbstractStore<M extends org.apache.hadoop.io.Writable,T>
Special message store to be used when ids are LongWritable and no combiner
is used.
|
class |
LongPointerListPerVertexStore<M extends org.apache.hadoop.io.Writable>
This stores messages in
ExtendedByteArrayOutputBuffer
and stores long pointers that point to serialized messages |
Modifier and Type | Class and Description |
---|---|
class |
AsyncMessageStoreWrapper<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
This class decouples message receiving and processing
into separate threads thus reducing contention.
|
Constructor and Description |
---|
AsyncMessageStoreWrapper(MessageStore<I,M> store,
Iterable<Integer> partitions,
int threadCount)
Constructs async wrapper around existing message store
object.
|
Constructor and Description |
---|
ComputeCallable(org.apache.hadoop.mapreduce.Mapper.Context context,
GraphState graphState,
MessageStore<I,M1> messageStore,
ImmutableClassesGiraphConfiguration<I,V,E> configuration,
CentralizedServiceWorker<I,V,E> serviceWorker)
Constructor
|
Modifier and Type | Class and Description |
---|---|
class |
DiskBackedMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
Implementation of a message store used for out-of-core mechanism.
|
Constructor and Description |
---|
DiskBackedMessageStore(ImmutableClassesGiraphConfiguration<I,?,?> config,
OutOfCoreEngine oocEngine,
MessageStore<I,M> messageStore,
boolean useMessageCombiner,
long superstep)
Constructor
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.