Tony Asleson: Honey, I Shrunk the Model (Maybe): blk-archive vs AI Data

Tony Asleson: Honey, I Shrunk the Model (Maybe): blk-archive vs AI Data

Exploring storage savings of blk-archive across AI-style datasets, compared against tar + gzip.

Because It Should Work Isnt Data After reading about the billions spent on AI infrastructure, I kept wondering: how much of that storage is just… the same bytes over and over? So I decided to find … [+21144 chars]
Tony Asleson: Honey, I Shrunk the Model (Maybe): blk-archive vs AI Data - FHMnews