Member-only story
How to boost the efficiency of Kafka message driven services
AVRO — The secret recipe of data serialization
The transmission of computer records can be done in various formats such as CSV, text and even byte binary format. JSON, without a doubt, is one of the prevalent data formats nowadays. It is extensively adopted in REST APIs. It is so popular because data can be presented in a hierarchical structure and in text format that is easily readable.
The use of JSON is widespread. Just go to walmart.com and search for something, you will see the search results which are in fact rendered based on a response in JSON format.
As JSON has become a commonly used data format, people are naturally using it for message driven services as well. However, Just because JSON is a common data format does not mean it fits for all use cases.
AVRO is a serialization framework and an Apache open source project. Originally, it was designed for the exchange of big data. The usage has been extended to message driven services for its efficiency and robust support for data schema. People claim that processing of data in AVRO format is faster and more…
