Update to 4.0.0 broke the system (502 Bad Gateway)

Infos:

  • Used Zammad version: 4.0.0
  • Used Zammad installation source: package
  • Operating system: Debian 10
  • Browser + version: Some (Chrome 89.04389, Edge 89.0.774)

Expected behavior:

  • System working as before update

Actual behavior:

  • The “502 bad Gateway”

Steps to reproduce the behavior:

  • Update the system using package manager (apt update -y && apt upgrade -y)

Log Files:

  • /var/log/zammad/production.log

xxxx@domain.org:~$ tail -n 30 /var/log/zammad/production.log
I, [2021-04-06T14:14:38.226082 #15328-47255907006880] INFO – : Running job thread for ‘Check Channels’ (Channel.fetch) status is: sleep
I, [2021-04-06T14:14:38.226169 #15328-47255907006880] INFO – : Running job thread for ‘Process escalation tickets’ (Ticket.process_escalation) status is: sleep
I, [2021-04-06T14:14:38.226620 #15328-47255907006880] INFO – : Running job thread for ‘Check streams for Channel’ (Channel.stream) status is: sleep
I, [2021-04-06T14:14:38.227170 #15328-47255907006880] INFO – : Running job thread for ‘Execute jobs’ (Job.run) status is: sleep
I, [2021-04-06T14:15:02.482895 #15328-47255985366220] INFO – : execute Channel.fetch (try_count 0)…
I, [2021-04-06T14:15:02.484474 #15328-47255985366220] INFO – : fetching imap (Working... port=993,ssl=true,starttls=false,folder=INBOX,keep_on _server=false,auth_type=LOGIN)
I, [2021-04-06T14:15:03.194690 #15328-47255985366220] INFO – : - no message
I, [2021-04-06T14:15:03.194782 #15328-47255985366220] INFO – : done
I, [2021-04-06T14:15:03.204157 #15328-47255985366220] INFO – : fetching imap (Working... port=993,ssl=true,starttls=false,folder=INBOX,ke ep_on_server=false,auth_type=LOGIN)
I, [2021-04-06T14:15:03.916112 #15328-47255985366220] INFO – : - no message
I, [2021-04-06T14:15:03.916187 #15328-47255985366220] INFO – : done
I, [2021-04-06T14:15:03.924762 #15328-47255985366220] INFO – : ended Channel.fetch took: 1.445964455 seconds.
I, [2021-04-06T14:15:10.798438 #15328-47255986110080] INFO – : execute Import::OTRS.diff_worker (try_count 0)…
I, [2021-04-06T14:15:10.798774 #15328-47255986110080] INFO – : ended Import::OTRS.diff_worker took: 0.004212527 seconds.
I, [2021-04-06T14:15:33.931851 #15328-47255985366220] INFO – : execute Channel.fetch (try_count 0)…
I, [2021-04-06T14:15:33.934207 #15328-47255985366220] INFO – : fetching imap (Working... port=993,ssl=true,starttls=false,folder=INBOX,keep_on _server=false,auth_type=LOGIN)
I, [2021-04-06T14:15:34.676241 #15328-47255985366220] INFO – : - no message
I, [2021-04-06T14:15:34.676342 #15328-47255985366220] INFO – : done
I, [2021-04-06T14:15:34.688302 #15328-47255985366220] INFO – : fetching imap (Working... port=993,ssl=true,starttls=false,folder=INBOX,ke ep_on_server=false,auth_type=LOGIN)
I, [2021-04-06T14:15:35.389134 #15328-47255985366220] INFO – : - no message
I, [2021-04-06T14:15:35.389232 #15328-47255985366220] INFO – : done
I, [2021-04-06T14:15:35.425663 #15328-47255985366220] INFO – : ended Channel.fetch took: 1.499165681 seconds.
I, [2021-04-06T14:15:38.278382 #15328-47255907006880] INFO – : Scheduler running…
I, [2021-04-06T14:15:38.285862 #15328-47255907006880] INFO – : Running job thread for ‘Generate Session data’ (Sessions.jobs) status is: sleep
I, [2021-04-06T14:15:38.285974 #15328-47255907006880] INFO – : Running job thread for ‘Process escalation tickets’ (Ticket.process_escalation) status is: sleep
I, [2021-04-06T14:15:38.286050 #15328-47255907006880] INFO – : Running job thread for ‘Import OTRS diff load’ (Import::OTRS.diff_worker) status is: sleep
I, [2021-04-06T14:15:38.286121 #15328-47255907006880] INFO – : Running job thread for ‘Check Channels’ (Channel.fetch) status is: sleep
I, [2021-04-06T14:15:38.286513 #15328-47255907006880] INFO – : Running job thread for ‘Check streams for Channel’ (Channel.stream) status is: sleep
I, [2021-04-06T14:15:38.286935 #15328-47255907006880] INFO – : Running job thread for ‘Execute jobs’ (Job.run) status is: sleep
I, [2021-04-06T14:15:40.269028 #15328-47255907006880] INFO – : script/scheduler.rb stopped.

  • /var/log/nginx/zammad.error.log

tail -n 30 /var/log/nginx/zammad.error.log
2021/04/06 15:57:26 [error] 6510#6510: *740 no live upstreams while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:28 [error] 6510#6510: *741 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:28 [error] 6510#6510: *741 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:30 [error] 6510#6510: *744 no live upstreams while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:31 [error] 6510#6510: *745 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:31 [error] 6510#6510: *745 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:33 [error] 6510#6510: *748 no live upstreams while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:36 [error] 6510#6510: *749 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:36 [error] 6510#6510: *749 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:36 [error] 6510#6510: *752 no live upstreams while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:38 [error] 6510#6510: *753 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:38 [error] 6510#6510: *753 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:41 [error] 6510#6510: *756 no live upstreams while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:41 [error] 6510#6510: *757 connect() failed (111: Connection refused) while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:41 [error] 6510#6510: *757 connect() failed (111: Connection refused) while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:43 [error] 6510#6510: *760 no live upstreams while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:46 [error] 6510#6510: *761 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:46 [error] 6510#6510: *761 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:46 [error] 6510#6510: *764 no live upstreams while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:48 [error] 6510#6510: *765 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:48 [error] 6510#6510: *765 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:51 [error] 6510#6510: *768 no live upstreams while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:51 [error] 6510#6510: *769 connect() failed (111: Connection refused) while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:51 [error] 6510#6510: *769 connect() failed (111: Connection refused) while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:54 [error] 6510#6510: *772 no live upstreams while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:56 [error] 6510#6510: *773 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:56 [error] 6510#6510: *773 connect() failed (111: Connection refused) while connecting to upstream, client: B.B.B.B, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org
2021/04/06 15:57:58 [error] 6510#6510: *776 no live upstreams while connecting to upstream, client: C.C.C.C, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://zammad-websocket/ws”, host: “domain.org
2021/04/06 15:57:59 [error] 6510#6510: *777 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://[::1]:6042/ws”, host: “domain.org
2021/04/06 15:57:59 [error] 6510#6510: *777 connect() failed (111: Connection refused) while connecting to upstream, client: A.A.A.A, server: domain.org, request: “GET /ws HTTP/1.1”, upstream: “http://127.0.0.1:6042/ws”, host: “domain.org

So, 'ive tried to uninstall and re-install the Zammad using package manager, and some errors are shown:

Configurando zammad (4.0.0-1617678167.2e3acf80.buster) …
(Re)creating init scripts
Nothing to do.
Nothing to do.
Nothing to do.
Enabling Zammad on boot
Stopping Zammad
database.yml found. Updating db…
ruby: /lib/x86_64-linux-gnu/libc.so.6: version GLIBC_2.25' not found (required by ruby)** Updating translations... **ruby: /lib/x86_64-linux-gnu/libc.so.6: version GLIBC_2.25’ not found (required by ruby)
ruby: /lib/x86_64-linux-gnu/libc.so.6: version GLIBC_2.25' not found (required by ruby)** Configuring Elasticsearch... **ruby: /lib/x86_64-linux-gnu/libc.so.6: version GLIBC_2.25’ not found (required by ruby)
– Nevermind, no es_url is set, leaving Elasticsearch untouched …!
– The above is all right if you don’t want to use Elasticsearch (locally) - if this is not intended, consult https://docs.zammad.org !
ruby: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.25’ not found (required by ruby)
Starting Zammad
Creating webserver bootstart
Synchronizing state of nginx.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable nginx
Restarting webserver nginx
####################################################################################

Add your fully qualified domain name or public IP to servername directive of
nginx, if this installation is done on a remote server. You have to change:
/etc/nginx/sites-available/zammad.conf and restart nginx process.
Otherwise just open http://localhost/ in your browser to start using Zammad.

####################################################################################

Any suggestion to fix this problem?

The problem was solved. For any reason, when updating the system the Debian updater the Postgresql to 9.6 and changed the file /etc/postgres/9.6/main/pg_hba.conf to another user.

So i’ve CHOWN -R postgres:postgres pg_hba.conf and it’s working again

2 Likes

This topic was automatically closed 120 days after the last reply. New replies are no longer allowed.