Summary
Nvidia has unveiled NVHBM, a custom high-bandwidth memory architecture that promises increased bandwidth and lower power consumption by moving the memory controller off the accelerator die, with Amazon's Annapurna Labs named as the first partner, though its widespread availability remains uncertain.