celery使用redis做backend问题记录

1. redis.exceptions.ConnectionError: Connection closed by server

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/celery/app/trace.py", line 520, in trace_task
    task.backend.mark_as_done(
  File "/usr/local/lib/python3.10/site-packages/celery/backends/base.py", line 157, in mark_as_done
    self.store_result(task_id, result, state, request=request)
  File "/usr/local/lib/python3.10/site-packages/celery/backends/base.py", line 526, in store_result
    self._store_result(task_id, result, state, traceback,
  File "/usr/local/lib/python3.10/site-packages/celery/backends/base.py", line 973, in _store_result
    current_meta = self._get_task_meta_for(task_id)
  File "/usr/local/lib/python3.10/site-packages/celery/backends/base.py", line 995, in _get_task_meta_for
    meta = self.get(self.get_key_for_task(task_id))
  File "/usr/local/lib/python3.10/site-packages/celery/backends/redis.py", line 376, in get
    return self.client.get(key)
  File "/usr/local/lib/python3.10/site-packages/redis/commands/core.py", line 1830, in get
    return self.execute_command("GET", name)
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 545, in execute_command
    return conn.retry.call_with_retry(
  File "/usr/local/lib/python3.10/site-packages/redis/retry.py", line 49, in call_with_retry
    fail(error)
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 549, in <lambda>
    lambda error: self._disconnect_raise(conn, error),
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 535, in _disconnect_raise
    raise error
  File "/usr/local/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
    return do()
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 546, in <lambda>
    lambda: self._send_command_parse_response(
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 522, in _send_command_parse_response
    return self.parse_response(conn, command_name, **options)
  File "/usr/local/lib/python3.10/site-packages/redis/client.py", line 562, in parse_response
    response = connection.read_response()
  File "/usr/local/lib/python3.10/site-packages/redis/connection.py", line 512, in read_response
    response = self._parser.read_response(disable_decoding=disable_decoding)
  File "/usr/local/lib/python3.10/site-packages/redis/_parsers/resp2.py", line 15, in read_response
    result = self._read_response(disable_decoding=disable_decoding)
  File "/usr/local/lib/python3.10/site-packages/redis/_parsers/resp2.py", line 25, in _read_response
    raw = self._buffer.readline()
  File "/usr/local/lib/python3.10/site-packages/redis/_parsers/socket.py", line 115, in readline
    self._read_from_socket()
  File "/usr/local/lib/python3.10/site-packages/redis/_parsers/socket.py", line 68, in _read_from_socket
    raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
redis.exceptions.ConnectionError: Connection closed by server.

celery version:5.40
kombu:5.3.7
redis: 5.0.5

这个问题是kombu引起的，可以参考这个inssue https://github.com/celery/celery/issues/8990
解决方案：升级kombu或者降到5.2.2

后续：
升降kombu版本之后，还是这个问题。然后在github上看到说可能是redis版本的问题，升了redis==6.2.0,问题解决了，redis不在重启了

最终的版本是：
celery5.40
kombu5.2.2
redis==6.2.0