Streaming

Instead of pagination, it is possible to get a streaming response by adding stream=true to the URL query parameters. This is more efficient than pagination because the server does not generate the whole response before sending it to the client, so memory consumption remains low even when the response is very large.

To take full advantage of the streaming response on the client side, it is recommended to use an iterative JSON parser such as ijson.

Notes: