Skip to content

Experiments around schemas, gdpr and schema evolution specially protobuf and its new schema support for confluent schema registry.

Notifications You must be signed in to change notification settings

gustavomonarin/schema-evolution-experiments

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Experiments around schemas and schema evolution specially protobuf and its new schema support in the confluent schema registry.

Background

The opportunity to experiment / review schema decisions made in the past are unfortunately rare in the day to day work.

This repo intends to review some limitations faced in the past with avro schema specially when using it with multiple domain events from the same aggregate in the same topic to avoid unnecessary reordering complexity.

On the other extreme I would like to review the early experience of using using pure CloudEvents + json which brings flexibility of json schema or no schema at all with some other constraints.

For a more detailed comparison on the schema evolution and domain evolution comparing avro and protobuf, see the sub-project readme

Going beyond the previously faced problems, while starting a new project (specially personal project), one has new challenges as GDPR, ids/urns, documentation as code which can be seen as opportunity to do it right from the design.

Please feel free to reach me out by mail / twitter / issues in case of any suggestions as well as way to push me to publish more in this shared repo regarding the other points that are only superficially mentioned (This repo intends to double validate/discuss with the community my approach. There is a separated repo with a personal project which in some areas already have further development).

Next

  • GDPR, LGPD schema following the privacy by design principle, from the beginning with a clear contract and transparent for impl
  • Urn schema for resource identification ref pcalcado
  • Event Modeling Adam Dymitruk as a code / executable specification
  • Recent developments in the CloudEvents specification, including Re-Introducing protobuf

About

Experiments around schemas, gdpr and schema evolution specially protobuf and its new schema support for confluent schema registry.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages