Numpy serialization tests

sys:1: MatplotlibDeprecationWarning: The 'warn' parameter of use() is deprecated since Matplotlib 3.1 and will be removed in 3.3.  If any parameter follows 'warn', they should be pass as keyword, not positionally.

Integer test

For testing, we create a 1000x10 array, which is typical in our use cases. This could represent the result of a 1s simulation with 10 units and 1ms time bins.

A = 
 [[8 2 1 ... 5 6 3]
 [0 5 0 ... 0 6 2]
 [1 5 8 ... 1 6 4]
 ...
 [3 3 5 ... 5 5 1]
 [6 6 8 ... 5 3 3]
 [3 6 2 ... 7 5 1]]

Length of the unencoded byte sequences:

no compression  :  80128 
zlib compressed :  7196 
blosc compressed:  10150

Length of base64 encoded bytes:

no compression  :  106840   —  b'k05VTVBZAQ' 
zlib compressed :    9596   —  b'eJyd2ssS5L' 
blosc compressed:   13536   —  b'AgEBCIA4AQ'

Length of base85 encoded bytes: (First 10 encoded caracters shown)

no compression  :  100160   —  b'lTKAlP+0*0' 
zlib compressed :    8995   —  b'c$}Tu%M#?a' 
blosc compressed:   12688   —  b'0s#RCfH(mF'

zlib  compression: 61.148ms ± 0.138ms
blosc compression:  2.843ms ± 0.034ms

Floating-point test

We use the same sized array as in above, again with values within \([0,10)\), but this time with floats.

A = 
 [[3.06494772 5.63011501 8.80872879 ... 4.19862322 8.46604461 9.28346815]
 [2.82931997 3.8741498  3.18255026 ... 0.68741562 5.25392405 0.76466769]
 [7.42212217 4.98484434 8.98859852 ... 6.32017619 7.81633824 5.96741584]
 ...
 [7.3292064  4.57112954 4.36508642 ... 0.24867652 7.51388454 1.5938669 ]
 [6.92609606 3.3784268  7.78978262 ... 6.15603552 0.85188765 4.90133344]
 [9.1425061  7.12119729 9.41918639 ... 2.12476174 8.11798919 7.61706681]]

Length of the unencoded byte sequences:

no compression  :  80128 
zlib compressed :  76293 
blosc compressed:  73540

Length of base64 encoded bytes:

no compression  :  106840   —  b'k05VTVBZAQ' 
zlib compressed :  101724   —  b'eJwUl3k01G' 
blosc compressed:   98056   —  b'AgEBCIA4AQ'

Length of base85 encoded bytes: (First 10 encoded caracters shown)

no compression  :  100160   —  b'lTKAlP+0*0' 
zlib compressed :   95367   —  b'c$^fMc{J2-' 
blosc compressed:   91925   —  b'0s#RCfH(mF'

zlib  compression: 84.534ms ± 0.460ms
blosc compression:  3.151ms ± 0.026ms