State pickle compression

[benedikt-bartscher]

Turns out, state compression can make a big difference. Of course depending on the circumstances (Redis Bandwidth, Latency, State Size, ...). You can run REDIS_URL=redis_host:redis_port pytest benchmarks/benchmark_pickle.py to test it on your machine.

Will probably evaluate other compression algorithms (especially those integrated into python) in a followup and introduce a ReflexCompressor Interface.

[benedikt-bartscher]

@masenf we could add a compression threshold for small payloads. WDYT?

Edit: I just implemented it

[benedikt-bartscher]

While this can help a lot with big states, I think frontend payload compression could have an even bigger impact. Especially with slow connections, f.e. on mobile. Pickle payloads already benefit from referential serialization, json/ws does nothing similar. In fact, currently, the ws payloads are not compressed at all. Socketio only compresses in long-polling mode, which is only used for the initial connection and incompatible with gunicorn (I disabled it in #4441)

[masenf]

In fact, currently, the ws payloads are not compressed at all.

how did you determine this? i'm looking at a packet capture of the websocket traffic and almost every message seems compressed

Frame

Decompressed payload

[benedikt-bartscher]

@masenf i was just brainstorming in that comment and only read some docs. I did not test it. Just confirmed your wireshark capture, seems to be compressed by default. Interesting, i wonder where this happens, maybe i'll need to scroll trough some code to understand it.

[benedikt-bartscher]

It is just not documented very well. python-socketio uses python-engineio which uses simple-websocket, which has compression enabled with hardcoded default settings since miguelgrinberg/simple-websocket@9277e67

[masenf]

In the JS version of socket.io, perMessageDeflate is now disabled by default: https://socket.io/docs/v4/server-options/#permessagedeflate

This extension is known to add a significant overhead in terms of performance and memory consumption, so we suggest to only enable it if it is really needed.

[benedikt-bartscher]

Very intersting, thanks for sharing. Maybe some (optimized) reflex apps could even benefit from disabling that compression. For big states/apps it's probably good that it's enabled. However with python-socketio reflex has no way to control this. Maybe we can adress that in the future. However we are getting a bit off-topic in this PR which is about pickle compression. Maybe i'll create an Issue to further discuss our performance impact and ideas for websocket compression.

[codspeed-hq]

CodSpeed Performance Report

Merging #4430 will not alter performance

_{Comparing benedikt-bartscher:state-compression (86342c7) with main (8b2c729)}

Summary

✅ 8 untouched benchmarks

[masenf]

Thank you for contributing to Reflex. I am closing this old or stale PR for now, but please refresh and reopen it if you believe this issue is still relevant.