Connect to multiple Kafka Cluster’s using spring Kafka

I have a spring boot application that consumes messages from a topic(say topic1) in a Kafka cluster. This is how my code looks like currently. @Configuration public class KafkaTopicConfig { @…

Kafka consumer showing numbers in unreadable format

I am trying out the kafka streaming. I am reading messages from one topic and doing groupByKey and then doing the count of groups. But the problem is that the messages count is coming as unreadable “…

SpringBoot, Kafka : java.lang.NoSuchMethodError: org.apache.kafka.clients.producer.Producer.close(Ljava/time/Duration;)V

I’m using spring boot v2.2.4 and Apache Kafka in my project. Below is my pom.xml file: org.springframework.boot</groupId&…

Understanding Number of StreamProcessor instances created and do stream task share same streamprocessor instance?

I want to understand a little more details on the relationship between StreamThread, StreamTask and how many instances of StreamProcessor is created when we have: a source kafka topic with multiple …

Flink Avro Serialization shows “not serializable” error when working with GenericRecords

I’m really having a hard time making Flink to communicate properly with a running Kafka instance making use of an Avro schema from the Confluent Schema Registry (for both key and value). After a …

@KafkaListener is not consuming messages – issue with deserialization

Message Producer using Kafka bindings of Spring cloud streams @Component public static class PageViewEventSource implements ApplicationRunner { private final MessageChannel pageViewsOut; private …