Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
deserializer
kwarg to consumer components to facilitate unicode supportreset_offset_on_fetch
kwarg to consumer components to support read-only
consumptionconsumer_group
kwarg to str
from bytes
TopicDict.__getitem__
's parameter to str
from bytes
pending_timeout_ms
kwarg to Producer.__init__
to allow delivery report
wait timeoutsserializer
kwarg to Producer.__init__
to facilitate unicode supportgeneration_id
and consumer_id
parameters on SimpleConsumer
partition_offsets
kwarg to consumers' commit_offsets
method to decouple
the notions of "committed" vs "consumed" messagesattempts
kwarg to Broker.connect
that controls retries during broker
connectionqueue_empty_timeout_ms
kwarg to Producer.__init__
that creates an "empty
wait" state in the Producer
when no messages are available to producezookeeper_hosts
kwarg to BalancedConsumer
to standardize kwarg namingListOffsetRequest
reset_offsets
NoNodeException
during consumer ZK node releasesapi_versions
to select the version-appropriate implementation for
OffsetFetchRequest
FetchResponseV1
causing throttle_time
to be returned as a tuple
instead of an integerOffsetFetchRequest
and
OffsetFetchResponse
cli.print_managed_consumer_groups
to be Py3 compatibleCluster.get_group_coordinator
BrokerConnection.connect
handlers.py
threading.Event
instance to Producer
indicating the presence of at least
one message in the queue to enable nonbusy "empty waiting"SimpleConsumer.commit_offsets
and
OwnedPartition.build_offset_commit_request
that handles user-specified offset
information and sends it in requestsreset_offsets
to be more predictable and user-friendly,
and to better handle the case where the topic has a single log segmentoffsets_before
arguments across the APIproduce()
retriesutils
Topic.fetch_offset_limits
clarifying how the
ListOffsets
API worksgevent
dependency to avoid breaking change in kazoo
, which depends on itzookeeper_connect
kwarg on BalancedConsumer
protocol.py
file into multiple smaller files via the protocol
moduleInvalidTopic
to the list of supported exceptionstest_update_cluster
, since it occasionally failsThis is a multi-tagging of 2.8.0-dev.5
for the purpose of indicating that this release is slated to become 2.8.0
after a bit of testing.
Changes since 2.7.0
deserializer
kwarg to consumer components to facilitate unicode supportreset_offset_on_fetch
kwarg to consumer components to support read-only
consumptionconsumer_group
kwarg to str
from bytes
TopicDict.__getitem__
's parameter to str
from bytes
pending_timeout_ms
kwarg to Producer.__init__
to allow delivery report
wait timeoutsserializer
kwarg to Producer.__init__
to facilitate unicode supportgeneration_id
and consumer_id
parameters on SimpleConsumer
partition_offsets
kwarg to consumers' commit_offsets
method to decouple
the notions of "committed" vs "consumed" messagesattempts
kwarg to Broker.connect
that controls retries during broker
connectionqueue_empty_timeout_ms
kwarg to Producer.__init__
that creates an "empty
wait" state in the Producer
when no messages are available to producezookeeper_hosts
kwarg to BalancedConsumer
to standardize kwarg namingListOffsetRequest
reset_offsets
NoNodeException
during consumer ZK node releasesapi_versions
to select the version-appropriate implementation for
OffsetFetchRequest
FetchResponseV1
causing throttle_time
to be returned as a tuple
instead of an integerOffsetFetchRequest
and
OffsetFetchResponse
cli.print_managed_consumer_groups
to be Py3 compatibleCluster.get_group_coordinator
BrokerConnection.connect
handlers.py
threading.Event
instance to Producer
indicating the presence of at least
one message in the queue to enable nonbusy "empty waiting"SimpleConsumer.commit_offsets
and
OwnedPartition.build_offset_commit_request
that handles user-specified offset
information and sends it in requestsreset_offsets
to be more predictable and user-friendly,
and to better handle the case where the topic has a single log segmentoffsets_before
arguments across the APIproduce()
retriesutils
Topic.fetch_offset_limits
clarifying how the
ListOffsets
API worksgevent
dependency to avoid breaking change in kazoo
, which depends on itzookeeper_connect
kwarg on BalancedConsumer
protocol.py
file into multiple smaller files via the protocol
moduleInvalidTopic
to the list of supported exceptionstest_update_cluster
, since it occasionally fails(Duplicate of 2.8.0-dev.4)
zookeeper_hosts
kwarg to BalancedConsumer
to standardize kwarg namingListOffsetRequest
reset_offsets
reset_offsets
to be more predictable and user-friendly,
and to better handle the case where the topic has a single log segmentoffsets_before
arguments across the APIproduce()
retrieszookeeper_connect
kwarg on BalancedConsumer
protocol.py
file into multiple smaller files via the protocol
moduleInvalidTopic
to the list of supported exceptionspartition_offsets
kwarg to consumers' commit_offsets
method to decouple
the notions of "committed" vs "consumed" messagesattempts
kwarg to Broker.connect
that controls retries during broker
connectionqueue_empty_timeout_ms
kwarg to Producer.__init__
that creates an "empty
wait" state in the Producer
when no messages are available to producecli.print_managed_consumer_groups
to be Py3 compatibleCluster.get_group_coordinator
BrokerConnection.connect
handlers.py
threading.Event
instance to Producer
indicating the presence of at least
one message in the queue to enable nonbusy "empty waiting"SimpleConsumer.commit_offsets
and
OwnedPartition.build_offset_commit_request
that handles user-specified offset
information and sends it in requestsTopic.fetch_offset_limits
clarifying how the
ListOffsets
API worksgevent
dependency to avoid breaking change in kazoo
, which depends on itdeserializer
kwarg to consumer components to facilitate unicode supportreset_offset_on_fetch
kwarg to consumer components to support read-only
consumptionconsumer_group
kwarg to str
from bytes
TopicDict.__getitem__
's parameter to str
from bytes
pending_timeout_ms
kwarg to Producer.__init__
to allow delivery report
wait timeoutsserializer
kwarg to Producer.__init__
to facilitate unicode supportgeneration_id
and consumer_id
parameters on SimpleConsumer
NoNodeException
during consumer ZK node releasesapi_versions
to select the version-appropriate implementation for
OffsetFetchRequest
FetchResponseV1
causing throttle_time
to be returned as a tuple
instead of an integerOffsetFetchRequest
and
OffsetFetchResponse
utils
broker_version
kwarg to Broker.__init__
for the purpose of setting
api_version
in FetchResponse
topic_name
argument to Broker.join_group
for use in protocol metadata,
visible via the Administrative APIprint_managed_consumer_groups
to the CLItimestamp
kwarg to Producer.produce
to pass on messages when the broker
supports newer message formatsProducer.produce
to return the produced Message
instanceprotocol_version
and timestamp
kwargs to Message
fetch_error_backoff_ms
kwarg on SimpleConsumer
unblock_event
kwarg to SimpleConsumer.consume
used to notify the consumer
that its parent BalancedConsumer
is in the process of rebalancingcleanup
function to SimpleConsumer
membership_protocol
kwarg to BalancedConsumer
that allows switchable and
user-defined membership protocols to be usedGroupMembershipProtocol
objects for the two standard partition assignment
strategiesapi_versions
kwarg to Broker
to facilitate switchable API protocol versionsMetadataRequest
to Broker
controller_broker
attribute to Cluster
create_topics
and delete_topics
to Broker
fetch_api_versions
to Broker
and Cluster
kafka_tools
Producer
and SimpleConsumer
Event
that notifies the internal SimpleConsumer
of a BalancedConsumer
that a rebalance is in progress, fixing a bug causing partitions to be unreleasedBalancedConsumer
when there are no partitions
availableGroupMembershipProtocol
objects and become compatible with the Administrative APIkafka_tools.reset_offsets
not to work in python 3MessageSet
compression scheme in API v1rdkafka.SimpleConsumer
causing exceptions not to be raised from worker
threadsfetch_offsets
not to raise exceptions under certain conditions
when it shouldCluster
to become aware of supported API versions immediately upon
instantiationCluster
related to metadata requests to make logic reusable for
pre-bootstrap communication with the clusterprotocol.Response
instances when waiting
on a futureRandomPartitioner
to avoid actually calling random.choice
to improve
performanceProducer.procuce
to isinstance
to improve performanceSimpleConsumer.fetch_offsets
__main__
rdkafka
extension on platforms that don't support itsudo: required
to get around dead Travis machineskafka_instance
fetch its binary from archive.apache.org
instead of
mirror.reverse.net
because the latter removed old versions of Kafkamembership_protocol
kwarg to BalancedConsumer
that allows switchable and
user-defined membership protocols to be usedGroupMembershipProtocol
objects for the two standard partition assignment
strategiesapi_versions
kwarg to Broker
to facilitate switchable API protocol versionsMetadataRequest
to Broker
controller_broker
attribute to Cluster
create_topics
and delete_topics
to Broker
fetch_api_versions
to Broker
and Cluster
kafka_tools
Producer
and SimpleConsumer
Cluster
to become aware of supported API versions immediately upon
instantiationCluster
related to metadata requests to make logic reusable for
pre-bootstrap communication with the clusterprotocol.Response
instances when waiting
on a futureRandomPartitioner
to avoid actually calling random.choice
to improve
performanceProducer.procuce
to isinstance
to improve performanceSimpleConsumer.fetch_offsets
sudo: required
to get around dead Travis machineskafka_instance
fetch its binary from archive.apache.org
instead of
mirror.reverse.net
because the latter removed old versions of Kafka