Memory Limitations #340

Activity

1. Nucs

   self-assigned this

   on Aug 8, 2019
2. Nucs commented on Aug 8, 2019

   

   Nucs

   on Aug 8, 2019

   MemberAuthor

   More actions

   Unit test

   [TestMethod]
   public void MyTestMethod()
   {
       NDArray x = np.zeros(new Shape(600, 1000, 1000), np.float32);
   }
3. Nucs commented on Aug 12, 2019

   

   Nucs

   on Aug 12, 2019

   Last edited by Nucs

   MemberAuthor

   More actions

   Ported UnmanagedMemoryBlock and ArraySlice to use long in commit 539683f .
   Next is to port Shape to use long and all the algorithms with it. Mainly refactoring job
4. Nucs

   added

   enhancementNew feature or requestNew feature or request

   on Aug 12, 2019
5. Nucs

   added

   coreInternal engine: Shape, Storage, TensorEngine, iteratorsInternal engine: Shape, Storage, TensorEngine, iterators

   architectureCross-cutting structural changes affecting multiple componentsCross-cutting structural changes affecting multiple components

   on Feb 14, 2026
6. Nucs commented on Sep 7, 2026

   

   Nucs

   on Sep 7, 2026

   MemberAuthor

   More actions

   Done via the int→long rewrite (#596, in 0.70.0 #628). The int/IntPtr allocation cap is gone: Shape size/dimensions/strides/offset are long (npy_intp parity) and the sort/select core is 64-bit, so arrays past int.MaxValue elements work:

   var a = np.arange(6).reshape(2, 3);
   Console.WriteLine(string.Join(",", a.strides));   // 24,8  (bytes per axis, npy_intp)

   The >2 GB / >int.MaxValue paths are gated by the [HighMemory] NpyLargeFileTests and a >int.MaxValue byte oracle. Closing.
7. Nucs

   closed this as completedon Sep 7, 2026