Erasure coding is the idea that we can take a blob of data, break it up into M parts, in such a way that we can reconstruct it from any k of those M parts2. They're pretty ubiquitous in storage systems, block storage, object storage, higher RAID levels, and so on. When storage systems think about erasure codes, they're usually thinking about durability: the ability of the system to tolerate disk or host failures without losing data, while still having only storage overhead. The general idea is also widely used in modern communication and radio protocols3
Erasure Coding versus Tail Latency
from marcbrooker@gmail.com (Marc Brooker)
Filed under:
Same Source
Related Notes
- In Eliyahu M. Goldratt's "Theory of Constraints", you...from ycombinator.com
- Deep and shallow modules: The best modules are deep: they allow a ...from John Ousterhout
- Often, people who don’t have access to the raw data expect one narr...from Josh Beckman
- The upshot for the industry at large, is: the **LLM-as-Moat model h...from Steve Yegge
- The first image ever transmitted to Earth from another planet was r...from Instagram
- My experience is companies do not anticipate that the cost of monit...from Mathew Duggan
- Nathan's four Laws of Software: 1. **Software is a gas** ...from Jeff Atwood
- > Software with fewer concepts composes, scales, and evolves mor...from oilshell