list - Python pickle dump memory error -


i have large list want write file. list 2 dimensional, , each element of list 1 dimensional list. different elements of 2 dimensional list has 1 dimensional lists of varying size.

when 2d list small, pickle dump worked great. gives me memory error.

any suggestions on how store , reload such arrays disk?

thanks!

if want keep simple , use pickle, best thing use cpickle. library written in c , can handle bigger files , faster pickle.


Comments