org.apache.pulsar.broker.loadbalance.impl

Class SimpleLoadManagerImpl

java.lang.Object

org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl

All Implemented Interfaces:

LoadManager, ZooKeeperCacheListener<org.apache.pulsar.policies.data.loadbalancer.LoadReport>

public class SimpleLoadManagerImpl
extends Object
implements LoadManager, ZooKeeperCacheListener<org.apache.pulsar.policies.data.loadbalancer.LoadReport>

Field Summary

Fields

Modifier and Type	Field and Description
static String	LOADBALANCER_DYNAMIC_SETTING_STRATEGY_ZPATH
static String	LOADBALANCER_STRATEGY_LEAST_MSG
static String	LOADBALANCER_STRATEGY_LLS
static String	LOADBALANCER_STRATEGY_RAND
static long	RESOURCE_QUOTA_GO_DOWN_TIMEWINDOW
static long	RESOURCE_QUOTA_GO_UP_TIMEWINDOW
static String	SETTING_NAME_STRATEGY

Fields inherited from interface org.apache.pulsar.broker.loadbalance.LoadManager

LOADBALANCE_BROKERS_ROOT

Constructor Summary

Constructors

Constructor and Description
SimpleLoadManagerImpl()
SimpleLoadManagerImpl(PulsarService pulsar)

Method Summary

Modifier and Type	Method and Description
void	disableBroker() Removes visibility of current broker from loadbalancer list so, other brokers can't redirect any request to this broker and this broker won't accept new connection requests.
void	doLoadShedding() Unload a candidate service unit to balance the load
void	doNamespaceBundleSplit() Detect and split hot namespace bundles
org.apache.pulsar.policies.data.loadbalancer.LoadReport	generateLoadReport() Generate the load report
ZooKeeperChildrenCache	getActiveBrokersCache()
Set<String>	getAvailableBrokers() Get list of available brokers in cluster
Optional<ResourceUnit>	getLeastLoaded(org.apache.pulsar.common.naming.ServiceUnitId serviceUnit) Returns the Least Loaded Resource Unit decided by some algorithm or criteria which is implementation specific
List<org.apache.pulsar.common.stats.Metrics>	getLoadBalancingMetrics() Generate load balancing stats metrics
ZooKeeperDataCache<org.apache.pulsar.policies.data.loadbalancer.LoadReport>	getLoadReportCache()
ZooKeeperCache.Deserializer<org.apache.pulsar.policies.data.loadbalancer.LoadReport>	getLoadReportDeserializer() Returns ZooKeeperCache.Deserializer to deserialize load report
com.google.common.collect.Multimap<Long,ResourceUnit>	getResourceAvailabilityFor(org.apache.pulsar.common.naming.ServiceUnitId serviceUnitId)
org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage	getSystemResourceUsage()
void	initialize(PulsarService pulsar) Initialize this LoadManager.
static boolean	isAboveLoadLevel(org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage usage, float thresholdPercentage)
static boolean	isBelowLoadLevel(org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage usage, float thresholdPercentage)
boolean	isCentralized() Is centralized decision making to assign a new bundle.
void	onUpdate(String path, org.apache.pulsar.policies.data.loadbalancer.LoadReport data, org.apache.zookeeper.data.Stat stat)
void	setLoadReportForceUpdateFlag() Set flag to force load report update
void	start()
void	stop()
void	writeLoadReportOnZookeeper() Publish the current load report on ZK
void	writeResourceQuotasToZooKeeper() Update namespace bundle resource quota on ZK.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.pulsar.broker.loadbalance.LoadManager

create, writeLoadReportOnZookeeper

Field Detail

RESOURCE_QUOTA_GO_UP_TIMEWINDOW

public static final long RESOURCE_QUOTA_GO_UP_TIMEWINDOW

RESOURCE_QUOTA_GO_DOWN_TIMEWINDOW

public static final long RESOURCE_QUOTA_GO_DOWN_TIMEWINDOW

LOADBALANCER_DYNAMIC_SETTING_STRATEGY_ZPATH

public static final String LOADBALANCER_DYNAMIC_SETTING_STRATEGY_ZPATH

See Also:

Constant Field Values

SETTING_NAME_STRATEGY

public static final String SETTING_NAME_STRATEGY

See Also:

Constant Field Values

LOADBALANCER_STRATEGY_LLS

public static final String LOADBALANCER_STRATEGY_LLS

See Also:

Constant Field Values

LOADBALANCER_STRATEGY_RAND

public static final String LOADBALANCER_STRATEGY_RAND

See Also:

Constant Field Values

LOADBALANCER_STRATEGY_LEAST_MSG

public static final String LOADBALANCER_STRATEGY_LEAST_MSG

See Also:

Constant Field Values

Constructor Detail

SimpleLoadManagerImpl

public SimpleLoadManagerImpl()

SimpleLoadManagerImpl

public SimpleLoadManagerImpl(PulsarService pulsar)

Method Detail

initialize

public void initialize(PulsarService pulsar)

Description copied from interface: LoadManager

Initialize this LoadManager.

Specified by:

initialize in interface LoadManager

Parameters:

pulsar - The service to initialize this with.

start

public void start()
           throws PulsarServerException

Specified by:

start in interface LoadManager

Throws:

PulsarServerException

disableBroker

public void disableBroker()
                   throws Exception

Description copied from interface: LoadManager

Removes visibility of current broker from loadbalancer list so, other brokers can't redirect any request to this broker and this broker won't accept new connection requests.

Specified by:

disableBroker in interface LoadManager

Throws:

Exception

getLoadReportDeserializer

public ZooKeeperCache.Deserializer<org.apache.pulsar.policies.data.loadbalancer.LoadReport> getLoadReportDeserializer()

Description copied from interface: LoadManager

Returns ZooKeeperCache.Deserializer to deserialize load report

Specified by:

getLoadReportDeserializer in interface LoadManager

Returns:

getActiveBrokersCache

public ZooKeeperChildrenCache getActiveBrokersCache()

getAvailableBrokers

public Set<String> getAvailableBrokers()
                                throws Exception

Description copied from interface: LoadManager

Get list of available brokers in cluster

Specified by:

getAvailableBrokers in interface LoadManager

Returns:

Throws:

Exception

getLoadReportCache

public ZooKeeperDataCache<org.apache.pulsar.policies.data.loadbalancer.LoadReport> getLoadReportCache()

isCentralized

public boolean isCentralized()

Description copied from interface: LoadManager

Is centralized decision making to assign a new bundle.

Specified by:

isCentralized in interface LoadManager

writeResourceQuotasToZooKeeper

public void writeResourceQuotasToZooKeeper()
                                    throws Exception

Description copied from interface: LoadManager

Update namespace bundle resource quota on ZK.

Specified by:

writeResourceQuotasToZooKeeper in interface LoadManager

Throws:

Exception

getLoadBalancingMetrics

public List<org.apache.pulsar.common.stats.Metrics> getLoadBalancingMetrics()

Description copied from interface: LoadManager

Generate load balancing stats metrics

Specified by:

getLoadBalancingMetrics in interface LoadManager

getLeastLoaded

public Optional<ResourceUnit> getLeastLoaded(org.apache.pulsar.common.naming.ServiceUnitId serviceUnit)
                                      throws Exception

Description copied from interface: LoadManager

Returns the Least Loaded Resource Unit decided by some algorithm or criteria which is implementation specific

Specified by:

getLeastLoaded in interface LoadManager

Throws:

Exception

getResourceAvailabilityFor

public com.google.common.collect.Multimap<Long,ResourceUnit> getResourceAvailabilityFor(org.apache.pulsar.common.naming.ServiceUnitId serviceUnitId)
                                                                                 throws Exception

Throws:

Exception

onUpdate

public void onUpdate(String path,
                     org.apache.pulsar.policies.data.loadbalancer.LoadReport data,
                     org.apache.zookeeper.data.Stat stat)

Specified by:

onUpdate in interface ZooKeeperCacheListener<org.apache.pulsar.policies.data.loadbalancer.LoadReport>

isAboveLoadLevel

public static boolean isAboveLoadLevel(org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage usage,
                                       float thresholdPercentage)

isBelowLoadLevel

public static boolean isBelowLoadLevel(org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage usage,
                                       float thresholdPercentage)

getSystemResourceUsage

public org.apache.pulsar.policies.data.loadbalancer.SystemResourceUsage getSystemResourceUsage()
                                                                                        throws IOException

Throws:

IOException

generateLoadReport

public org.apache.pulsar.policies.data.loadbalancer.LoadReport generateLoadReport()
                                                                           throws Exception

Description copied from interface: LoadManager

Generate the load report

Specified by:

generateLoadReport in interface LoadManager

Throws:

Exception

setLoadReportForceUpdateFlag

public void setLoadReportForceUpdateFlag()

Description copied from interface: LoadManager

Set flag to force load report update

Specified by:

setLoadReportForceUpdateFlag in interface LoadManager

writeLoadReportOnZookeeper

public void writeLoadReportOnZookeeper()
                                throws Exception

Description copied from interface: LoadManager

Publish the current load report on ZK

Specified by:

writeLoadReportOnZookeeper in interface LoadManager

Throws:

Exception

doLoadShedding

public void doLoadShedding()

Description copied from interface: LoadManager

Unload a candidate service unit to balance the load

Specified by:

doLoadShedding in interface LoadManager

doNamespaceBundleSplit

public void doNamespaceBundleSplit()
                            throws Exception

Detect and split hot namespace bundles

Specified by:

doNamespaceBundleSplit in interface LoadManager

Throws:

Exception

stop

public void stop()
          throws PulsarServerException

Specified by:

stop in interface LoadManager

Throws:

PulsarServerException