org.apache.pulsar.broker.service

Class AbstractReplicator

java.lang.Object

org.apache.pulsar.broker.service.AbstractReplicator

Direct Known Subclasses:

NonPersistentReplicator, PersistentReplicator

public abstract class AbstractReplicator
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	AbstractReplicator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected Backoff	backOff
protected BrokerService	brokerService
protected PulsarClientImpl	client
protected String	localCluster
protected ProducerImpl	producer
protected org.apache.pulsar.client.api.ProducerBuilder<byte[]>	producerBuilder
protected int	producerQueueSize
protected String	remoteCluster
static String	REPL_PRODUCER_NAME_DELIMITER
protected PulsarClientImpl	replicationClient
protected String	replicatorPrefix
protected static AtomicReferenceFieldUpdater<AbstractReplicator,AbstractReplicator.State>	STATE_UPDATER
protected String	topicName

Constructor Summary

Constructors

Constructor and Description
AbstractReplicator(String topicName, String replicatorPrefix, String localCluster, String remoteCluster, BrokerService brokerService, PulsarClientImpl replicationClient)

Method Summary

Modifier and Type	Method and Description
protected CompletableFuture<Void>	closeProducerAsync()
protected abstract void	disableReplicatorRead()
CompletableFuture<Void>	disconnect()
CompletableFuture<Void>	disconnect(boolean failIfHasBacklog)
protected abstract long	getNumberOfEntriesInBacklog()
String	getRemoteCluster()
static String	getRemoteCluster(String remoteCursor)
static String	getReplicatorName(String replicatorPrefix, String cluster)
protected abstract Position	getReplicatorReadPosition()
protected boolean	isWritable()
protected abstract void	readEntries(org.apache.pulsar.client.api.Producer<byte[]> producer)
CompletableFuture<Void>	remove()
void	startProducer()
static CompletableFuture<Void>	validatePartitionedTopicAsync(String topic, BrokerService brokerService) Replication can't be started on root-partitioned-topic to avoid producer startup conflict.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

brokerService

protected final BrokerService brokerService

topicName

protected final String topicName

localCluster

protected final String localCluster

remoteCluster

protected final String remoteCluster

replicationClient

protected final PulsarClientImpl replicationClient

client

protected final PulsarClientImpl client

producer

protected volatile ProducerImpl producer

REPL_PRODUCER_NAME_DELIMITER

public static final String REPL_PRODUCER_NAME_DELIMITER

See Also:

Constant Field Values

producerQueueSize

protected final int producerQueueSize

producerBuilder

protected final org.apache.pulsar.client.api.ProducerBuilder<byte[]> producerBuilder

backOff

protected final Backoff backOff

replicatorPrefix

protected final String replicatorPrefix

STATE_UPDATER

protected static final AtomicReferenceFieldUpdater<AbstractReplicator,AbstractReplicator.State> STATE_UPDATER

Constructor Detail

AbstractReplicator

public AbstractReplicator(String topicName,
                          String replicatorPrefix,
                          String localCluster,
                          String remoteCluster,
                          BrokerService brokerService,
                          PulsarClientImpl replicationClient)
                   throws PulsarServerException

Throws:

PulsarServerException

Method Detail

readEntries

protected abstract void readEntries(org.apache.pulsar.client.api.Producer<byte[]> producer)

getReplicatorReadPosition

protected abstract Position getReplicatorReadPosition()

getNumberOfEntriesInBacklog

protected abstract long getNumberOfEntriesInBacklog()

disableReplicatorRead

protected abstract void disableReplicatorRead()

getRemoteCluster

public String getRemoteCluster()

startProducer

public void startProducer()

closeProducerAsync

protected CompletableFuture<Void> closeProducerAsync()

disconnect

public CompletableFuture<Void> disconnect()

disconnect

public CompletableFuture<Void> disconnect(boolean failIfHasBacklog)

remove

public CompletableFuture<Void> remove()

isWritable

protected boolean isWritable()

getRemoteCluster

public static String getRemoteCluster(String remoteCursor)

getReplicatorName

public static String getReplicatorName(String replicatorPrefix,
                                       String cluster)

validatePartitionedTopicAsync

public static CompletableFuture<Void> validatePartitionedTopicAsync(String topic,
                                                                    BrokerService brokerService)

Replication can't be started on root-partitioned-topic to avoid producer startup conflict.

 eg:
 if topic : persistent://prop/cluster/ns/my-topic is a partitioned topic with 2 partitions then
 broker explicitly creates replicator producer for: "my-topic-partition-1" and "my-topic-partition-2".

 However, if broker tries to start producer with root topic "my-topic" then client-lib internally
 creates individual producers for "my-topic-partition-1" and "my-topic-partition-2" which creates
 conflict with existing
 replicator producers.
 

Therefore, replicator can't be started on root-partition topic which can internally create multiple partitioned producers.

Parameters:

topic -

brokerService -