org.apache.giraph.partition

Class PartitionUtils

java.lang.Object

org.apache.giraph.partition.PartitionUtils

public class PartitionUtils
extends Object

Helper class for Partition related operations.

Method Summary

Modifier and Type	Method and Description
static void	analyzePartitionStats(Collection<PartitionOwner> partitionOwnerList, List<PartitionStats> allPartitionStats) Check for imbalances on a per worker basis, by calculating the mean, high and low workers by edges and vertices.
static int	computePartitionCount(int availableWorkerCount, ImmutableClassesGiraphConfiguration conf) Compute the number of partitions, based on the configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

analyzePartitionStats

public static void analyzePartitionStats(Collection<PartitionOwner> partitionOwnerList,
                                         List<PartitionStats> allPartitionStats)

Check for imbalances on a per worker basis, by calculating the mean, high and low workers by edges and vertices.

Parameters:

partitionOwnerList - List of partition owners.

allPartitionStats - All the partition stats.

computePartitionCount

public static int computePartitionCount(int availableWorkerCount,
                                        ImmutableClassesGiraphConfiguration conf)

Compute the number of partitions, based on the configuration. If USER_PARTITION_COUNT is set, it will follow that, otherwise it will choose the max of what MIN_PARTITIONS_PER_COMPUTE_THREAD and PARTITION_COUNT_MULTIPLIER settings would choose, capped by max partitions limited constrained by zookeeper.

Parameters:

availableWorkerCount - Number of available workers

conf - Configuration.

Returns:

Number of partitions for the job.