Open Data Fabric: A Decentralized Data Exchange and Transformation Protocol With Complete Reproducibility and Provenance
Despite the exponentially growing volumes of data generated in the world, putting it to effective use still presents many challenges.
We believe that the fundamental reason lies in the modern data management processes being entirely at odds with the basic principles ofcollaboration and trust.
In this paper, we present the open data fabric, a new decentralized data exchange and transformation protocol designed from the ground up to simplify data managementand enable collaboration around data on a similar scale as currently seen in open-source software.
Our field needs a fundamental shift of approach in how data is viewed, how it is shared and transformed.
We must transition away from treating data as static, from exchanging it as anemic binary blobs, and instead focus on making multi-party data management more sustainable: such as reproducibility, verifiability, provenance, autonomy, and low latency.