I’ve built an Avro schema that I’ve stored on the Confluent Schema Registry (version 5.5.1) running locally. However it seems that the schema that is being used to serialize the record is actually different than what I expect it to be. The schema definition is several hundred lines long, so I̵…
Tag: confluent-schema-registry
Deserialization of JSON and Avro without Schema
I have been trying to implement Avro deserialization without confluent schema registry. A quick research shows that I can embed the schema in header before sending the record to topic. But the schema again has to be serialized to bytes before embedding on the header which again makes this problematic. Is ther…
How to use avro native decoder when using a PollableMessageSource input in spring cloud stream?
I’m using a PollableMessageSource input to read from a Kafka topic. Messages on that topic are in Avro. use-native-decoding was set to true when those messages were published. This is how I’m polling: pollableChannels is just an injected instance of this interface: After seeing that the TypeClassN…
Is there a need of seperate Key Schema(other than a schema for fields) while writing Avro producer?
I am writing Java Avro Producer code for my project. I have registered an Avro schema for all the fields which need to be passed. My Registered Schema- { “name”: “Claim”, “type”: “record”, “namespace”: “com.schema.avro”, “fieldsR…
Flink Avro Serialization shows “not serializable” error when working with GenericRecords
I’m really having a hard time making Flink to communicate properly with a running Kafka instance making use of an Avro schema from the Confluent Schema Registry (for both key and value). After a while of thinking and restructuring my programm, I was able to push my implementation so far: Producer Method…
Kafka Stream with Avro in JAVA , schema.registry.url” which has no default value
I have the following configuration for my Kafka Stream application And I got the following error: I have tried to replace the line with but with the same error I have followed the instruction from this url when preparing my Stream application. Any suggestion? Answer If you have keys and values in Avro format …