Communications of the ACMOpinion

The Golden Rule of Big Memory: Persistence Is Not Harmful

Large-scale applications, such as generative AI, recommendation systems, big data, and HPC systems, require large-capacity ...
IEEE

BlockPIM: Optimizing Memory Management for PIM-enabled Long-Context LLM Inference

Abstract: Processing-In-Memory (PIM) architectures alleviate the memory bottleneck in the decode phase of large language model (LLM) inference by performing operations like GEMV and Softmax in memory.
Geeky Gadgets

Meet AutoDream : Claude Code’s Clever New Trick for Memory Management

Anthropic’s new AutoDream feature introduces a fresh approach to memory management in Claude AI, aiming to address the challenges of cluttered and inefficient data storage. As explained by Nate Herk | ...
IEEE

Efficient KV Cache Spillover Management on Memory-Constrained GPU for LLM Inference

Abstract: The rapid growth of model parameters presents a significant challenge when deploying large generative models on GPU. Existing LLM runtime memory management solutions tend to maximize batch ...
CNBC

Memory crisis latest: What we learned from the world's top producers this week

Micron, Samsung and SK Hynix, the world's top memory makers, all made headlines this week. Micron's stock fell after it blew away earnings expectations and raised spending expectations, while Samsung ...