Unpack msgpack with Python in chunks

Question

I have a huge msgpack file (approx. 50 Gb) which I want to unpack with Python. Obviously, I do not want to load everything into memory, thats why I want to unpack in chunks / batches. Is this possible using for example the pip msgpack module?

I tested out the streaming unpacker, but this one is unpacking the entire file in one chunk.

question from:https://stackoverflow.com/questions/65904638/unpack-msgpack-with-python-in-chunks

Answer 1

Waitting for answers