A C D G H I K O P R S

A

addTopicPartition(String, int) - Method in interface co.cask.cdap.kafka.flow.KafkaConsumerConfigurer

Adds a topic partition to consume message from.

addTopicPartition(String, int, int) - Method in interface co.cask.cdap.kafka.flow.KafkaConsumerConfigurer

Adds a topic partition to consumer message from, using the given fetch size for each fetch request.

C

co.cask.cdap.kafka.flow - package co.cask.cdap.kafka.flow

configureKafka(KafkaConfigurer) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Configure Kafka consumer.

D

decodeKey(ByteBuffer) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override this method to provide custom decoding of a message key.

decodePayload(ByteBuffer) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override this method to provide custom decoding of a message payload.

DEFAULT_FETCH_SIZE - Static variable in interface co.cask.cdap.kafka.flow.KafkaConsumerConfigurer

Default message fetch size in bytes when making Kafka fetch request.

G

getBeginOffset(TopicPartition) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Returns the read offsets to start with for the given TopicPartition.

getBrokers() - Method in class co.cask.cdap.kafka.flow.KafkaConfig

Returns brokers information as set through KafkaConsumerConfigurer#setBrokers(String) or null.

getFetchSize() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerInfo

getKafkaConfig() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Returns a Kafka configuration.

getKey() - Method in class co.cask.cdap.kafka.flow.KafkaMessage

getNextOffset() - Method in class co.cask.cdap.kafka.flow.KafkaMessage

getOffsetStore() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override to return a KeyValueTable for storing consumer offsets.

getPayload() - Method in class co.cask.cdap.kafka.flow.KafkaMessage

getReadOffset() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerInfo

getStoreKey(TopicPartition) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Returns the key to be used when persisting offsets into a KeyValueTable.

getTopicPartition() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerInfo

getTopicPartition() - Method in class co.cask.cdap.kafka.flow.KafkaMessage

getZookeeper() - Method in class co.cask.cdap.kafka.flow.KafkaConfig

Returns the ZooKeeper connection string as set through KafkaConsumerConfigurer#setZooKeeper(String) or null.

H

handleInstancesChanged(KafkaConsumerConfigurer) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override to handle changes in flowlet instances.

I

initialize(FlowletContext) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Initialize this Flowlet.

K

KafkaBrokerConfigurer - Interface in co.cask.cdap.kafka.flow

This class is for configuring Kafka broker information for KafkaConsumerFlowlet.

KafkaConfig - Class in co.cask.cdap.kafka.flow

Contains information about Kafka cluster as configured by user.

KafkaConfig(String, String) - Constructor for class co.cask.cdap.kafka.flow.KafkaConfig

KafkaConfigurer - Interface in co.cask.cdap.kafka.flow

This class is for configuring both Kafka broker and consumer information for KafkaConsumerFlowlet.

KafkaConsumerConfigurer - Interface in co.cask.cdap.kafka.flow

This class is for configuring Kafka consumer information for KafkaConsumerFlowlet.

KafkaConsumerFlowlet<KEY,PAYLOAD,OFFSET> - Class in co.cask.cdap.kafka.flow

Abstract base class for implementing consuming data from a Kafka cluster.

KafkaConsumerFlowlet() - Constructor for class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

KafkaConsumerInfo<OFFSET> - Class in co.cask.cdap.kafka.flow

Helper class to carry information about a Kafka consumer of a particular topic partition.

KafkaConsumerInfo(TopicPartition, int, OFFSET) - Constructor for class co.cask.cdap.kafka.flow.KafkaConsumerInfo

KafkaMessage<OFFSET> - Class in co.cask.cdap.kafka.flow

Represents a Kafka message.

KafkaMessage(TopicPartition, OFFSET, ByteBuffer, ByteBuffer) - Constructor for class co.cask.cdap.kafka.flow.KafkaMessage

O

onFailure(Object, InputContext, FailureReason) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

onSuccess(Object, InputContext) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

P

pollMessages() - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

A Tick method that triggered periodically by the Flow system to poll messages from Kafka.

processMessage(KafkaMessage<OFFSET>) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Overrides this method if interested in the raw Kafka message.

processMessage(KEY, PAYLOAD) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override this method if interested in both the key and payload of a message read from Kafka.

processMessage(PAYLOAD) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Override this method if only interested in the payload of a message read from Kafka.

R

readMessages(KafkaConsumerInfo<OFFSET>) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Read messages from Kafka.

S

saveReadOffsets(Map<TopicPartition, OFFSET>) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Persists read offsets for all topic-partition that this Flowlet consumes from Kafka.

setBrokers(String) - Method in interface co.cask.cdap.kafka.flow.KafkaBrokerConfigurer

Sets the Kafka broker list.

setReadOffset(OFFSET) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerInfo

setZooKeeper(String) - Method in interface co.cask.cdap.kafka.flow.KafkaBrokerConfigurer

Sets the ZooKeeper quorum string that Kafka is running with.

SO_TIMEOUT - Static variable in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

stopService(Service) - Method in class co.cask.cdap.kafka.flow.KafkaConsumerFlowlet

Stops a Service and waits for the completion.

A C D G H I K O P R S