distributed system - kafka log.retention.hours inconsistency in multiple brokers -
i trying run multiple kafka brokers. there file named server.properties , there field "log.retention.hours" set 168 in server.properties file. if change kafka brokers properties file , set different values of "log.retention.hours" in each properties file how act in distributed environment. mean kafka brokers in single cluster replicates partitions, happen if log.retention.hours in broker-1 differs log.retention.hours in broker-2. how replication of partitions take place. data has been deleted in server-1 replicated again other brokers(assuming (server-1 log.retention.period) < (server-2 log.retention.period)).
one of basic assumptions in design of kafka brokers in cluster will, few exceptions (e.g. port), have same configuration described in kafka improvement proposal. result, scenario inconsistent configurations have described in question should avoided.
Comments
Post a Comment