Consumer

Simple Consumer (legacy)

A simple non-balanced, non-group-aware, consumer.

Constructors

this
this(GlobalConf conf)

Creates a new Kafka consumer handle.

Destructor

~this
~this()
Undocumented in source.

Members

Static functions

consume
void consume(Topic topic, int partition, int timeout_ms, Message msg)

Consume a single message from \p topic and \p partition.

consume
void consume(Queue queue, int timeout_ms, Message msg)

Consume a single message from the specified queue.

consumeCallback
int consumeCallback(Topic topic, int partition, int timeout_ms, ConsumeCb consume_cb)

Consumes messages from \p topic and \p partition, calling the provided callback for each consumed messsage.

consumeCallback
int consumeCallback(Queue queue, int timeout_ms, ConsumeCb consume_cb)

Consumes messages from \p queue, calling the provided callback for each consumed messsage.

offsetTail
long offsetTail(long offset)

Converts an offset into the logical offset from the tail of a topic.

seek
ErrorCode seek(Topic topic, int partition, long offset, int timeout_ms)

Seek consumer for topic+partition to \p offset which is either an absolute or logical offset.

start
ErrorCode start(Topic topic, int partition, long offset, Queue queue)

Start consuming messages for topic and \p partition at offset \p offset which may either be a proper offset (0..N) or one of the the special offsets: \p OFFSET_BEGINNING or \p OFFSET_END.

stop
ErrorCode stop(Topic topic, int partition)

Stop consuming messages for topic and \p partition, purging all messages currently in the local queue.

Inherited Members

From Handle

memberid
auto memberid()

Returns the client's broker-assigned group member id

metadata
Metadata metadata(bool all_topics, Topic only_rkt, int timeout_ms)

Request Metadata from broker.

setCommonConfig
void setCommonConfig(GlobalConf conf)
Undocumented in source. Be warned that the author may not have intended to support it.
queryWatermarkOffsets
auto queryWatermarkOffsets(const(char)* topic, int partition, long low, long high, int timeout_ms)

Query broker for low (oldest/beginning) and high (newest/end) offsets for partition.

rk_
rd_kafka_t* rk_;
Undocumented in source.
event_cb_
EventCb event_cb_;
Undocumented in source.
socket_cb_
SocketCb socket_cb_;
Undocumented in source.
open_cb_
OpenCb open_cb_;
Undocumented in source.
dr_cb_
DeliveryReportCb dr_cb_;
Undocumented in source.
partitioner_cb_
PartitionerCb partitioner_cb_;
Undocumented in source.
partitioner_kp_cb_
PartitionerKeyPointerCb partitioner_kp_cb_;
Undocumented in source.
rebalance_cb_
RebalanceCb rebalance_cb_;
Undocumented in source.
offset_commit_cb_
OffsetCommitCb offset_commit_cb_;
Undocumented in source.
name
const(char)[] name()

the name of the handle

poll
int poll(int timeout_ms)

Polls the provided kafka handle for events.

outqLen
int outqLen()

Returns the current out queue length

free_partition_vector
void free_partition_vector(TopicPartition[] v)
Undocumented in source. Be warned that the author may not have intended to support it.
pause
ErrorCode pause(TopicPartition[] partitions)

Pause producing or consumption for the provided list of partitions.

resume
ErrorCode resume(TopicPartition[] partitions)

Resume producing or consumption for the provided list of partitions.

getWatermarkOffsets
ErrorCode getWatermarkOffsets(const(char)* topic, int partition, long low, long high)

Get last known low (oldest/beginning) and high (newest/end) offsets for partition.

Meta