org.apache.pulsar.broker.service.nonpersistent

Class NonPersistentTopic

java.lang.Object

org.apache.pulsar.broker.service.AbstractTopic

org.apache.pulsar.broker.service.nonpersistent.NonPersistentTopic

All Implemented Interfaces:

Topic

public class NonPersistentTopic
extends AbstractTopic
implements Topic

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pulsar.broker.service.Topic

Topic.PublishContext

Field Summary

Fields

Modifier and Type	Field and Description
protected static AtomicLongFieldUpdater<NonPersistentTopic>	USAGE_COUNT_UPDATER

Fields inherited from class org.apache.pulsar.broker.service.AbstractTopic

addEntryLatencyStatsUsec, brokerService, hasBatchMessagePublished, inactiveTopicPolicies, isAllowAutoUpdateSchema, isEncryptionRequired, isFenced, lastActive, lock, maxSubscriptionsPerTopic, maxUnackedMessagesOnConsumer, POLICY_UPDATE_FAILURE_RETRY_TIME_SECONDS, preciseTopicPublishRateLimitingEnable, producers, replicatorPrefix, schemaCompatibilityStrategy, schemaValidationEnforced, topic, topicPublishRateLimiter, transactionBuffer, transactionBufferLock

Constructor Summary

Constructors

Constructor and Description
NonPersistentTopic(String topic, BrokerService brokerService)

Method Summary

Modifier and Type	Method and Description
void	addProducer(Producer producer)
protected boolean	addReplicationCluster(String remoteCluster, NonPersistentTopic nonPersistentTopic, String localCluster)
CompletableFuture<Void>	addSchemaIfIdleOrCheckCompatible(org.apache.pulsar.common.protocol.schema.SchemaData schema) If the topic is idle (no producers, no entries, no subscribers and no existing schema), add the passed schema to the topic.
void	checkBackloggedCursors() Activate cursors those caught up backlog-threshold entries and deactivate slow cursors which are creating backlog.
void	checkDeduplicationSnapshot()
void	checkGC()
void	checkInactiveSubscriptions()
void	checkMessageDeduplicationInfo()
void	checkMessageExpiry()
CompletableFuture<Void>	checkReplication()
CompletableFuture<Void>	close(boolean closeWithoutWaitingClientDisconnect) Close this topic - close all producers and subscriptions associated with this topic
CompletableFuture<Subscription>	createSubscription(String subscriptionName, org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.InitialPosition initialPosition, boolean replicateSubscriptionState)
CompletableFuture<Void>	delete()
CompletableFuture<Void>	deleteForcefully() Forcefully close all producers/consumers/replicators and deletes the topic.
CompletableFuture<Void>	endTxn(org.apache.pulsar.client.api.transaction.TxnID txnID, int txnAction, List<org.apache.pulsar.common.api.proto.PulsarApi.MessageIdData> sendMessageIdList) End the transaction in this topic.
org.apache.pulsar.common.policies.data.BacklogQuota	getBacklogQuota()
CompletableFuture<org.apache.pulsar.common.policies.data.PersistentTopicInternalStats>	getInternalStats(boolean includeLedgerMetadata)
CompletableFuture<org.apache.pulsar.client.api.MessageId>	getLastMessageId()
Position	getLastPosition()
int	getNumberOfConsumers()
Replicator	getPersistentReplicator(String remoteCluster)
org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<String,NonPersistentReplicator>	getReplicators()
org.apache.pulsar.common.policies.data.NonPersistentTopicStats	getStats(boolean getPreciseBacklog, boolean subscriptionBacklogSize)
Subscription	getSubscription(String subscription)
org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<String,NonPersistentSubscription>	getSubscriptions()
CompletableFuture<TransactionBuffer>	getTransactionBuffer(boolean createIfMissing) Get the $TransactionBuffer of this Topic.
void	handleProducerRemoved(Producer producer)
boolean	isActive()
boolean	isBacklogQuotaExceeded(String producerName)
boolean	isReplicated()
CompletableFuture<Void>	onPoliciesUpdate(org.apache.pulsar.common.policies.data.Policies data)
void	publishMessage(io.netty.buffer.ByteBuf data, Topic.PublishContext callback)
void	publishTxnMessage(org.apache.pulsar.client.api.transaction.TxnID txnID, io.netty.buffer.ByteBuf headersAndPayload, Topic.PublishContext publishContext) Publish Transaction message to this Topic's TransactionBuffer
void	removeProducer(Producer producer)
CompletableFuture<Void>	stopReplProducers()
CompletableFuture<Consumer>	subscribe(TransportCnx cnx, String subscriptionName, long consumerId, org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.SubType subType, int priorityLevel, String consumerName, boolean isDurable, org.apache.pulsar.client.api.MessageId startMessageId, Map<String,String> metadata, boolean readCompacted, org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.InitialPosition initialPosition, long resetStartMessageBackInSec, boolean replicateSubscriptionState, org.apache.pulsar.common.api.proto.PulsarApi.KeySharedMeta keySharedMeta)
CompletableFuture<Void>	unsubscribe(String subscriptionName)
void	updateRates(NamespaceStats nsStats, org.apache.pulsar.policies.data.loadbalancer.NamespaceBundleStats bundleStats, StatsOutputStream topicStatsStream, ClusterReplicationMetrics replStats, String namespace, boolean hydratePublishers)

Methods inherited from class org.apache.pulsar.broker.service.AbstractTopic

addConsumerToSubscription, addSchema, checkSchemaCompatibleForConsumer, checkTopicFenced, checkTopicPublishThrottlingRate, deletePartitionedTopicMetadataWhileInactive, deleteSchema, disableCnxAutoRead, disableProducerRead, enableCnxAutoRead, enableProducerReadForPublishBufferLimiting, enableProducerReadForPublishRateLimiting, getBrokerPublishRateLimiter, getBrokerService, getBytesInCounter, getBytesOutCounter, getInactiveTopicPolicies, getMsgInCounter, getMsgOutCounter, getName, getProducers, getReplicatorPrefix, getSchemaValidationEnforced, getTopicPolicies, getTopicPublishRateLimiter, hasLocalProducers, hasSchema, incrementPublishCount, internalAddProducer, isBrokerPublishRateExceeded, isConsumersExceededOnTopic, isDeleteWhileInactive, isEncryptionRequired, isExceedMaximumMessageSize, isProducersExceeded, isPublishRateExceeded, isTopicPublishRateExceeded, markBatchMessagePublished, recordAddLatency, resetBrokerPublishCountAndEnableReadIfRequired, resetInactiveTopicPolicies, resetTopicPublishCountAndEnableReadIfRequired, setDeleteWhileInactive, setSchemaCompatibilityStrategy, toString, updateMaxPublishRate, updatePublishDispatcher

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.pulsar.broker.service.Topic

addSchema, checkSchemaCompatibleForConsumer, checkTopicPublishThrottlingRate, deleteSchema, disableCnxAutoRead, enableCnxAutoRead, getDispatchRateLimiter, getName, getProducers, getSchemaValidationEnforced, hasSchema, incrementPublishCount, isBrokerPublishRateExceeded, isEncryptionRequired, isPublishRateExceeded, isSystemTopic, isTopicPublishRateExceeded, recordAddLatency, resetBrokerPublishCountAndEnableReadIfRequired, resetTopicPublishCountAndEnableReadIfRequired

Field Detail

USAGE_COUNT_UPDATER

protected static final AtomicLongFieldUpdater<NonPersistentTopic> USAGE_COUNT_UPDATER

Constructor Detail

NonPersistentTopic

public NonPersistentTopic(String topic,
                          BrokerService brokerService)

Method Detail

publishMessage

public void publishMessage(io.netty.buffer.ByteBuf data,
                           Topic.PublishContext callback)

Specified by:

publishMessage in interface Topic

addProducer

public void addProducer(Producer producer)
                 throws BrokerServiceException

Specified by:

addProducer in interface Topic

Throws:

BrokerServiceException

checkMessageDeduplicationInfo

public void checkMessageDeduplicationInfo()

Specified by:

checkMessageDeduplicationInfo in interface Topic

removeProducer

public void removeProducer(Producer producer)

Specified by:

removeProducer in interface Topic

handleProducerRemoved

public void handleProducerRemoved(Producer producer)

Specified by:

handleProducerRemoved in class AbstractTopic

subscribe

public CompletableFuture<Consumer> subscribe(TransportCnx cnx,
                                             String subscriptionName,
                                             long consumerId,
                                             org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.SubType subType,
                                             int priorityLevel,
                                             String consumerName,
                                             boolean isDurable,
                                             org.apache.pulsar.client.api.MessageId startMessageId,
                                             Map<String,String> metadata,
                                             boolean readCompacted,
                                             org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.InitialPosition initialPosition,
                                             long resetStartMessageBackInSec,
                                             boolean replicateSubscriptionState,
                                             org.apache.pulsar.common.api.proto.PulsarApi.KeySharedMeta keySharedMeta)

Specified by:

subscribe in interface Topic

createSubscription

public CompletableFuture<Subscription> createSubscription(String subscriptionName,
                                                          org.apache.pulsar.common.api.proto.PulsarApi.CommandSubscribe.InitialPosition initialPosition,
                                                          boolean replicateSubscriptionState)

Specified by:

createSubscription in interface Topic

delete

public CompletableFuture<Void> delete()

Specified by:

delete in interface Topic

deleteForcefully

public CompletableFuture<Void> deleteForcefully()

Forcefully close all producers/consumers/replicators and deletes the topic.

Specified by:

deleteForcefully in interface Topic

Returns:

close

public CompletableFuture<Void> close(boolean closeWithoutWaitingClientDisconnect)

Close this topic - close all producers and subscriptions associated with this topic

Specified by:

close in interface Topic

Parameters:

closeWithoutWaitingClientDisconnect - don't wait for client disconnect and forcefully close managed-ledger

Returns:

Completable future indicating completion of close operation

stopReplProducers

public CompletableFuture<Void> stopReplProducers()

checkReplication

public CompletableFuture<Void> checkReplication()

Specified by:

checkReplication in interface Topic

addReplicationCluster

protected boolean addReplicationCluster(String remoteCluster,
                                        NonPersistentTopic nonPersistentTopic,
                                        String localCluster)

checkMessageExpiry

public void checkMessageExpiry()

Specified by:

checkMessageExpiry in interface Topic

getNumberOfConsumers

public int getNumberOfConsumers()

Specified by:

getNumberOfConsumers in class AbstractTopic

getSubscriptions

public org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<String,NonPersistentSubscription> getSubscriptions()

Specified by:

getSubscriptions in interface Topic

getReplicators

public org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<String,NonPersistentReplicator> getReplicators()

Specified by:

getReplicators in interface Topic

getSubscription

public Subscription getSubscription(String subscription)

Specified by:

getSubscription in interface Topic

getPersistentReplicator

public Replicator getPersistentReplicator(String remoteCluster)

updateRates

public void updateRates(NamespaceStats nsStats,
                        org.apache.pulsar.policies.data.loadbalancer.NamespaceBundleStats bundleStats,
                        StatsOutputStream topicStatsStream,
                        ClusterReplicationMetrics replStats,
                        String namespace,
                        boolean hydratePublishers)

Specified by:

updateRates in interface Topic

getStats

public org.apache.pulsar.common.policies.data.NonPersistentTopicStats getStats(boolean getPreciseBacklog,
                                                                               boolean subscriptionBacklogSize)

Specified by:

getStats in interface Topic

getInternalStats

public CompletableFuture<org.apache.pulsar.common.policies.data.PersistentTopicInternalStats> getInternalStats(boolean includeLedgerMetadata)

Specified by:

getInternalStats in interface Topic

isActive

public boolean isActive()

checkGC

public void checkGC()

Specified by:

checkGC in interface Topic

checkInactiveSubscriptions

public void checkInactiveSubscriptions()

Specified by:

checkInactiveSubscriptions in interface Topic

checkBackloggedCursors

public void checkBackloggedCursors()

Description copied from interface: Topic

Activate cursors those caught up backlog-threshold entries and deactivate slow cursors which are creating backlog.

Specified by:

checkBackloggedCursors in interface Topic

checkDeduplicationSnapshot

public void checkDeduplicationSnapshot()

Specified by:

checkDeduplicationSnapshot in interface Topic

onPoliciesUpdate

public CompletableFuture<Void> onPoliciesUpdate(org.apache.pulsar.common.policies.data.Policies data)

Specified by:

onPoliciesUpdate in interface Topic

getBacklogQuota

public org.apache.pulsar.common.policies.data.BacklogQuota getBacklogQuota()

Specified by:

getBacklogQuota in interface Topic

Returns:

Backlog quota for topic

isBacklogQuotaExceeded

public boolean isBacklogQuotaExceeded(String producerName)

Specified by:

isBacklogQuotaExceeded in interface Topic

Returns:

quota exceeded status for blocking producer creation

isReplicated

public boolean isReplicated()

Specified by:

isReplicated in interface Topic

unsubscribe

public CompletableFuture<Void> unsubscribe(String subscriptionName)

Specified by:

unsubscribe in interface Topic

getLastPosition

public Position getLastPosition()

Specified by:

getLastPosition in interface Topic

getLastMessageId

public CompletableFuture<org.apache.pulsar.client.api.MessageId> getLastMessageId()

Specified by:

getLastMessageId in interface Topic

addSchemaIfIdleOrCheckCompatible

public CompletableFuture<Void> addSchemaIfIdleOrCheckCompatible(org.apache.pulsar.common.protocol.schema.SchemaData schema)

Description copied from interface: Topic

If the topic is idle (no producers, no entries, no subscribers and no existing schema), add the passed schema to the topic. Otherwise, check that the passed schema is compatible with what the topic already has.

Specified by:

addSchemaIfIdleOrCheckCompatible in interface Topic

getTransactionBuffer

public CompletableFuture<TransactionBuffer> getTransactionBuffer(boolean createIfMissing)

Description copied from interface: Topic

Get the $TransactionBuffer of this Topic.

Specified by:

getTransactionBuffer in interface Topic

Parameters:

createIfMissing - Create the TransactionBuffer if missing.

Returns:

TransactionBuffer CompletableFuture

publishTxnMessage

public void publishTxnMessage(org.apache.pulsar.client.api.transaction.TxnID txnID,
                              io.netty.buffer.ByteBuf headersAndPayload,
                              Topic.PublishContext publishContext)

Description copied from interface: Topic

Publish Transaction message to this Topic's TransactionBuffer

Specified by:

publishTxnMessage in interface Topic

Parameters:

txnID - Transaction Id

headersAndPayload - Message data

publishContext - Publish context

endTxn

public CompletableFuture<Void> endTxn(org.apache.pulsar.client.api.transaction.TxnID txnID,
                                      int txnAction,
                                      List<org.apache.pulsar.common.api.proto.PulsarApi.MessageIdData> sendMessageIdList)

Description copied from interface: Topic

End the transaction in this topic.

Specified by:

endTxn in interface Topic

Parameters:

txnID - Transaction id

txnAction - Transaction action.

Returns: