Avro

non-cncf

Tech Writing Pass

GitHub Repository Official Website

Content Lifecycle & Evolution State

1

Initial Seed

Metadata Loaded

2

First Research

Automated Gathering

3

Tech Writing

Content Structured

4

Approval

Editorial Verified

Tech Writing Pass Completed: The technical overview and features have been structured by our autonomous content agents. Final editorial approval is pending.

Overview

Apache Avro is a data serialization system that provides rich data structures, a compact, fast, binary data format, and simple integration with dynamic languages.

Key Features

Rich data structures defined using JSON.
Compact, fast, binary data format.
Container file format for storing persistent data.
Remote procedure call (RPC).
Simple integration with dynamic languages with no code generation required to read or write data files.

Use Cases

Often used as the leading serialization format for record data and the first choice for streaming data pipelines, commonly integrating with Apache Hadoop and Apache Kafka.

Getting Started

Get started by defining a schema in JSON format, then generate code or dynamically (de)serialize data using one of the many supported language SDKs (Java, Python, C++, etc).

Recent Updates

The 1.12.2 release includes a broad round of hardening against malformed and adversarial input across the Java and Python SDKs, plus security fixes in C#, C++, and JavaScript.

Did You Know?

Avro relies on schemas that are always present when data is read, permitting data to be written with no per-value overheads, making serialization both fast and small.