Rapids Kafka Client

Kafka Client is a vanilla java library that makes it easy to consume data from kafka, a list of features:

• Parallel consuming
• Consuming retry
• Consuming failover
• Designed to be easy to mock and test
• Designed to support slow consumers without kafka re balancing
• Designed to high throughput usage
• Individual record consuming
• Batch records consuming
• Frameworkless, but easily configurable to someone
• Commits are managed for you based on behavior

Getting Started

compile 'com.mageddo.kafka-client:rapids-kafka-client:1.0.2'

Consumers.<String, String>builder()
.prop(KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class.getName())
.prop(VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class.getName())
.prop(GROUP_ID_CONFIG, "stocks")
.topics("stock_changed")
.recoverCallback(ctx -> {
  // here you can send the message to another topic, send a SMS, etc.
  log.info("status=recovering, value={}", ctx.record().value());
})
.callback((ctx, record) -> {
  log.info("status=consumed, value={}", record.value());
})
.build()
.consume()
.waitFor();

Examples

• Vanilla
• Spring Framework
• Micronaut
• Quarkus