Erasure Coding Techniques for Distributed Storage Systems

Summary

Erasure coding has emerged as a cornerstone of modern distributed storage, replacing simple replication with more space‐efficient schemes that fragment data into redundant pieces. By encoding an original object into a greater number of fragments than are strictly required for reconstruction, erasure codes enable a system to tolerate node failures while minimising storage overhead. Early implementations relied on classical Reed–Solomon codes, valued for their optimal storage‐versus‐reliability trade‐off but challenged by high decoding complexity and network load during repair. To address these drawbacks, new families of codes have been devised. Locally recoverable codes (LRCs) reduce the number of fragments accessed during a single node repair, thus lowering repair bandwidth and accelerating recovery. Regenerating codes shift some of the decoding burden to the network, achieving lower total repair traffic at the cost of more complex subpacketisation. Fractional repetition and hybrid schemes combine replication and erasure coding for simplified repair management. Recent attention has focused on balancing stripe width, field‐size requirements and update efficiency, with practitioners tuning code parameters to the failure patterns and performance profiles of large‐scale cloud and edge environments. Practical deployments now leverage code constructions that offer configurable locality, multiple recovery sets and flexible trade‐offs between storage savings and repair speed.

Research from Nature Portfolio

No recent Nature Portfolio content available.

Erasure Coding Techniques for Distributed Storage Systems publication trend

The graph below shows the total number of articles in erasure coding techniques for distributed storage systems across all publications each year (not limited to Nature Index journals).

Technical terms

Erasure code: A method that transforms data into multiple redundant fragments to tolerate losses without full replication.

Reed–Solomon code: A class of maximum‐distance-separable codes offering optimal data reconstruction from a minimal set of fragments.

Locally recoverable code (LRC): A code designed so that any single fragment can be rebuilt by accessing only a small subset of other fragments.

Regenerating code: An erasure code that minimises repair bandwidth by allowing new fragments to be generated from sub-symbols transmitted by surviving nodes.

Stripe: A grouping of data and parity fragments across storage nodes over which erasure coding is applied.

Repair bandwidth: The total volume of data transferred during the repair of a lost fragment.

References

  1. Practical Design Considerations for Wide Locally Recoverable Codes (LRCs). ACM Transactions on Storage (2023).
  2. Erasure-Coding-Based Storage and Recovery for Distributed Exascale Storage Systems. Applied Sciences (2021).
  3. Performance Analysis of Distributed File System Based on RAID Storage for Tapeless Storage. IEEE Access (2023).

About these summaries

This Nature Research Intelligence Topic summary is created with the cited references and a large language model. We take care to ground generated text with facts, and have systems in place to gain human feedback on the overall quality of the process in line with our AI principles. We strive to create accurate and useful summaries for people unfamiliar with the research topic and that supports this goal. These pages are a beta release and will be updated as we learn how best to help people gain value from a research topic summary.

Nature Strategy Reports
Turn complex research questions into confident strategic decisions 

When you're under pressure to set direction, justify investment, or understand your competitive position, you need more than raw data — you need trusted insights you can act on.

  • Benchmark your performance against global peers using robust, methodologically sound analysis.

  • Combine quantitative metrics with qualitative expert insight to uncover strengths, gaps and emerging opportunities.

  • Gain tailored, decision-ready recommendations aligned to your strategic priorities.

Talk to us to learn more about our data dashboards and bespoke strategy reports.

Nature Masterclasses
Grow research skills, confidence and careers with training built for every stage of the research lifecycle.

Developed with Nature Portfolio journal Editors and internationally renowned experts. Discover three ways to learn:

  • Self-paced, online courses in convenient bite-sized units, covering key skills across scientific writing, publishing, grant writing, data analysis, and more.

  • Expert trainer-led workshops with hands-on exercises and real-time feedback across core research skills, delivered via interactive group sessions.

  • Editor-led workshops combining core principles in writing and publishing, personalised 1:1 feedback from Nature Portfolio Editors and hands-on exercises.

Explore course catalogues and workshop agendas, enquire about the options or request institutional pricing.