Package | Description |
---|---|
org.apache.giraph.comm.netty |
Package for netty implementations.
|
org.apache.giraph.conf |
Package of Giraph configuration related things.
|
org.apache.giraph.jython |
Jython integration.
|
org.apache.giraph.worker |
Package of all the worker related things
|
Modifier and Type | Field and Description |
---|---|
static BooleanConfOption |
NettyClient.LIMIT_NUMBER_OF_OPEN_REQUESTS
Do we have a limit on number of open requests we can have
|
static BooleanConfOption |
NettyClient.LIMIT_OPEN_REQUESTS_PER_WORKER
Do we have a limit on number of open requests we can have for each worker.
|
Modifier and Type | Field and Description |
---|---|
static BooleanConfOption |
GiraphConstants.AUTHENTICATE
Whether to use SASL with DIGEST and Hadoop Job Tokens to authenticate
and authorize Netty BSP Clients to Servers.
|
static BooleanConfOption |
GiraphConstants.CLEANUP_CHECKPOINTS_AFTER_SUCCESS
Delete checkpoints after a successful job run?
|
static BooleanConfOption |
FacebookConfiguration.CONFIGURE_JAVA_OPTS
Whether to configure java opts.
|
static BooleanConfOption |
GiraphConstants.CREATE_EDGE_SOURCE_VERTICES
This option can be used to specify if a source vertex present in edge
input but not in vertex input can be created
|
static BooleanConfOption |
GiraphConstants.DISABLE_GIRAPH_CLASS_RESOLVER
Whether to disable GiraphClassResolver which is an efficient
implementation of kryo class resolver.
|
static BooleanConfOption |
GiraphConstants.DO_OUTPUT_DURING_COMPUTATION
If you use this option, instead of having saving vertices in the end of
application, saveVertex will be called right after each vertex.compute()
is called.
|
static BooleanConfOption |
GiraphConstants.FAIL_FIRST_IPC_PORT_BIND_ATTEMPT
Fail first IPC port binding attempt, simulate binding failure
on real grid testing
|
static BooleanConfOption |
GiraphConstants.FAIL_ON_EMPTY_INPUT
Whether to fail the job or just warn when input is empty
|
static BooleanConfOption |
GiraphConstants.GIRAPH_TEXT_OUTPUT_FORMAT_REVERSE
Reverse values in the output
|
static BooleanConfOption |
GiraphConstants.IS_PURE_YARN_JOB
Is this a pure YARN job (i.e.
|
static BooleanConfOption |
GiraphConstants.JMAP_ENABLE
Configuration key to enable jmap printing
|
static BooleanConfOption |
GiraphConstants.JMAP_LIVE_ONLY
Configuration key for printing live objects only
This option will trigger Full GC for every jmap dump
and so can significantly hinder performance.
|
static BooleanConfOption |
GiraphConstants.KEEP_ZOOKEEPER_DATA
Keep the zookeeper output for debugging? Default is to remove it.
|
static BooleanConfOption |
GiraphConstants.LOCAL_TEST_MODE
Indicates whether this job is run in an internal unit test
|
static BooleanConfOption |
GiraphConstants.LOG_THREAD_LAYOUT
Use thread level debugging?
|
static BooleanConfOption |
GiraphConstants.METRICS_ENABLE
Enable the Metrics system
|
static BooleanConfOption |
GiraphConstants.NETTY_CLIENT_USE_EXECUTION_HANDLER
Use the execution handler in netty on the client?
|
static BooleanConfOption |
GiraphConstants.NETTY_SERVER_USE_EXECUTION_HANDLER
Use the execution handler in netty on the server?
|
static BooleanConfOption |
GiraphConstants.NETTY_SIMULATE_FIRST_REQUEST_CLOSED
Netty simulate a first request closed
|
static BooleanConfOption |
GiraphConstants.NETTY_SIMULATE_FIRST_RESPONSE_FAILED
Netty simulate a first response failed
|
static BooleanConfOption |
GiraphConstants.NETTY_USE_DIRECT_MEMORY
Use direct memory buffers in netty
|
static BooleanConfOption |
GiraphConstants.NETTY_USE_POOLED_ALLOCATOR
Use netty pooled memory buffer allocator
|
static BooleanConfOption |
GiraphConstants.PREFER_IP_ADDRESSES
For worker to worker communication we can use IPs or host names, by
default prefer IPs.
|
static BooleanConfOption |
GiraphConstants.REACTIVE_JMAP_ENABLE
Option can be used to enable reactively dumping jmap histo when
OOM is imminent
|
static BooleanConfOption |
GiraphConstants.RESEND_TIMED_OUT_REQUESTS
Whether to resend request which timed out or fail the job if timeout
happens
|
static BooleanConfOption |
GiraphConstants.RESOLVER_CREATE_VERTEX_ON_MSGS
Option of whether to create vertexes that were not existent before but
received messages
|
static BooleanConfOption |
GiraphConstants.SPLIT_MASTER_WORKER
Separate the workers and the master tasks.
|
static BooleanConfOption |
GiraphConstants.STATIC_GRAPH
The application will not mutate the graph topology (the edges).
|
static BooleanConfOption |
GiraphConstants.TRACK_JOB_PROGRESS_ON_CLIENT
Whether to track job progress on client or not
|
static BooleanConfOption |
GiraphConstants.USE_BIG_DATA_IO_FOR_MESSAGES
Use BigDataIO for messages? If there are super-vertices in the
graph which receive a lot of messages (total serialized size of messages
goes beyond the maximum size of a byte array), setting this option to true
will remove that limit.
|
static BooleanConfOption |
FacebookConfiguration.USE_G1_COLLECTOR
Note: using G1 is often faster, but we've seen it add off heap memory
overhead which can cause issues.
|
static BooleanConfOption |
GiraphConstants.USE_INPUT_SPLIT_LOCALITY
To minimize network usage when reading input splits,
each worker can prioritize splits that reside on its host.
|
static BooleanConfOption |
GiraphConstants.USE_MESSAGE_SIZE_ENCODING
Use message size encoding (typically better for complex objects,
not meant for primitive wrapped messages)
|
static BooleanConfOption |
GiraphConstants.USE_OUT_OF_CORE_GRAPH
Enable out-of-core graph.
|
static BooleanConfOption |
GiraphConstants.USE_SUPERSTEP_COUNTERS
Use superstep counters? (boolean)
|
static BooleanConfOption |
GiraphConstants.USE_UNSAFE_SERIALIZATION
Use unsafe serialization?
|
static BooleanConfOption |
GiraphConstants.VERTEX_OUTPUT_FORMAT_THREAD_SAFE
Vertex output format thread-safe - if your VertexOutputFormat allows
several vertexWriters to be created and written to in parallel,
you should set this to true.
|
static BooleanConfOption |
GiraphConstants.ZOOKEEPER_FORCE_SYNC
ZooKeeper force sync
|
static BooleanConfOption |
GiraphConstants.ZOOKEEPER_IS_EXTERNAL
Zookeeper List will always hold a value during the computation while
this option provides information regarding whether the zookeeper was
internally started or externally provided.
|
static BooleanConfOption |
GiraphConstants.ZOOKEEPER_SKIP_ACL
ZooKeeper skip ACLs
|
Modifier and Type | Method and Description |
---|---|
BooleanConfOption |
PerGraphTypeBooleanConfOption.get(GraphType graphType)
Get option for given GraphType
|
BooleanConfOption |
PerGraphTypeBooleanConfOption.getEdgeValue() |
BooleanConfOption |
PerGraphTypeBooleanConfOption.getOutgoingMessage() |
BooleanConfOption |
PerGraphTypeBooleanConfOption.getVertexId() |
BooleanConfOption |
PerGraphTypeBooleanConfOption.getVertexValue() |
Modifier and Type | Method and Description |
---|---|
void |
PerGraphTypeBoolean.setEdgeValue(BooleanConfOption option,
org.apache.hadoop.conf.Configuration conf)
Set the edge value data from the option
|
void |
PerGraphTypeBoolean.setOutgoingMessage(BooleanConfOption option,
org.apache.hadoop.conf.Configuration conf)
Set the outgoing message value data from the option
|
void |
PerGraphTypeBoolean.setVertexId(BooleanConfOption option,
org.apache.hadoop.conf.Configuration conf)
Set the vertex id data from the option
|
void |
PerGraphTypeBoolean.setVertexValue(BooleanConfOption option,
org.apache.hadoop.conf.Configuration conf)
Set the vertex value data from the option
|
Modifier and Type | Method and Description |
---|---|
BooleanConfOption |
JythonOptions.JythonGraphTypeOptions.getNeedsWrapperOption() |
Modifier and Type | Field and Description |
---|---|
static BooleanConfOption |
MemoryObserver.USE_MEMORY_OBSERVER
Whether or not to use memory observer
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.