Package | Description |
---|---|
org.apache.giraph.bsp |
Package of generic bulk synchronous processing objects.
|
org.apache.giraph.comm.requests |
Package for requests.
|
org.apache.giraph.graph |
Package of all the graph related objects, built on the
org.apache.bsp package.
|
org.apache.giraph.master |
Package of all the master related things.
|
org.apache.giraph.partition |
Package of partitioning related objects.
|
org.apache.giraph.utils |
Package of all generic utility classes.
|
org.apache.giraph.worker |
Package of all the worker related things
|
Modifier and Type | Method and Description |
---|---|
FinishedSuperstepStats |
CentralizedServiceWorker.finishSuperstep(List<PartitionStats> partitionStatsList,
GiraphTimerContext superstepTimerContext)
Worker is done with its portion of the superstep.
|
Constructor and Description |
---|
PartitionStatsRequest(Collection<PartitionStats> partitionStats)
Constructor
|
Modifier and Type | Method and Description |
---|---|
Collection<PartitionStats> |
ComputeCallable.call() |
Modifier and Type | Method and Description |
---|---|
void |
GlobalStats.addPartitionStats(PartitionStats partitionStats)
Add the stats of a partition to the global stats.
|
Modifier and Type | Method and Description |
---|---|
Iterable<PartitionStats> |
MasterGlobalCommHandler.getAllPartitionStats(int numWorkers,
org.apache.hadoop.util.Progressable progressable)
Get all partition stats.
|
Modifier and Type | Method and Description |
---|---|
void |
MasterGlobalCommHandler.receivedPartitionStats(List<PartitionStats> partitionStats)
Received partition stats from a worker
|
void |
DefaultMasterObserver.superstepMetricsUpdate(long superstep,
AggregatedMetrics aggregatedMetrics,
List<PartitionStats> partitionStatsList) |
void |
MasterObserver.superstepMetricsUpdate(long superstep,
AggregatedMetrics aggregatedMetrics,
List<PartitionStats> partitionStatsList)
Called after each superstep with aggregated metrics from workers
|
Modifier and Type | Method and Description |
---|---|
PartitionStats |
MasterGraphPartitionerImpl.createPartitionStats() |
PartitionStats |
MasterGraphPartitioner.createPartitionStats()
Instantiate the
PartitionStats implementation used to read the
worker stats |
Modifier and Type | Method and Description |
---|---|
Collection<PartitionStats> |
WorkerGraphPartitionerImpl.finalizePartitionStats(Collection<PartitionStats> workerPartitionStats,
PartitionStore<I,V,E> partitionStore) |
Collection<PartitionStats> |
WorkerGraphPartitioner.finalizePartitionStats(Collection<PartitionStats> workerPartitionStats,
PartitionStore<I,V,E> partitionStore)
At the end of a superstep, workers have
PartitionStats generated
for each of their partitions. |
Modifier and Type | Method and Description |
---|---|
static void |
PartitionUtils.analyzePartitionStats(Collection<PartitionOwner> partitionOwnerList,
List<PartitionStats> allPartitionStats)
Check for imbalances on a per worker basis, by calculating the
mean, high and low workers by edges and vertices.
|
static Collection<PartitionOwner> |
PartitionBalancer.balancePartitionsAcrossWorkers(org.apache.hadoop.conf.Configuration conf,
Collection<PartitionOwner> partitionOwners,
Collection<PartitionStats> allPartitionStats,
Collection<WorkerInfo> availableWorkerInfos)
Balance the partitions with an algorithm based on a value.
|
Collection<PartitionStats> |
WorkerGraphPartitionerImpl.finalizePartitionStats(Collection<PartitionStats> workerPartitionStats,
PartitionStore<I,V,E> partitionStore) |
Collection<PartitionStats> |
WorkerGraphPartitioner.finalizePartitionStats(Collection<PartitionStats> workerPartitionStats,
PartitionStore<I,V,E> partitionStore)
At the end of a superstep, workers have
PartitionStats generated
for each of their partitions. |
Collection<PartitionOwner> |
MasterGraphPartitionerImpl.generateChangedPartitionOwners(Collection<PartitionStats> allPartitionStatsList,
Collection<WorkerInfo> availableWorkers,
int maxWorkers,
long superstep) |
Collection<PartitionOwner> |
MasterGraphPartitioner.generateChangedPartitionOwners(Collection<PartitionStats> allPartitionStatsList,
Collection<WorkerInfo> availableWorkers,
int maxWorkers,
long superstep)
After the worker stats have been merged to a single list, the master can
use this information to send commands to the workers for any
Partition changes. |
Modifier and Type | Method and Description |
---|---|
void |
LogVersions.superstepMetricsUpdate(long superstep,
AggregatedMetrics aggregatedMetrics,
List<PartitionStats> partitionStatsList) |
void |
ReactiveJMapHistoDumper.superstepMetricsUpdate(long superstep,
AggregatedMetrics aggregatedMetrics,
List<PartitionStats> partitionStatsList) |
void |
JMapHistoDumper.superstepMetricsUpdate(long superstep,
AggregatedMetrics aggregatedMetrics,
List<PartitionStats> partitionStatsList) |
Modifier and Type | Method and Description |
---|---|
FinishedSuperstepStats |
BspServiceWorker.finishSuperstep(List<PartitionStats> partitionStatsList,
GiraphTimerContext superstepTimerContext) |
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.