Kafka multiple consumers for a partition -
i have producer writes messages topic/partition. maintain ordering, go single partition , want 12 consumers read messages single partition(no consumer group, messages should go consumers). achievable? read forums 1 consumer can read per partition.
you may use simpleconsumer
achieve asking - no consumer groups, consumers can read single partition. approach means have handle offset storing , broker failure handling yourself.
another option use high level consumer different consumer groups (you assign random uuid each consumer). way you'll able consume 1 topic/partition consumers , able commit offsets , handle broker outage.
the rule "only single consumer can consume topic/partition" applies consumer groups, e.g. 1 consumer in group can consume 1 topic/partition simultaneously.
Comments
Post a Comment