Dynamic memory allocation tends to be non-deterministic; the time taken to allocate memory may not be predictable and the memory pool may become fragmented, resulting in unexpected allocation failures ...

According to the C++ Standard, these four variants of operator new (new, new [] , nothrow new , and nothrow new [] ) are the only replaceable memory allocation functions. If you really want to prevent ...

But the general takeaway seems to be that Dynamic Caching allows the GPU to have more efficient memory allocation. Simple enough, right?