Hey @rolfschmidt
Thanks for for taking a look at this. We are actually running this with an Ubuntu package install now because the k8s cluster we have was experiencing too many issues with zammad. Here is what I was able to get for you:
- Events when viewing the WS connections.
- It just repeats this same thing and about every couple minutes gets a close code of 1006 and repeats:
-
Is the scheduler running in general. Are pending tickets flipped to open. Are Admin > Scheduler executed:
- I’m not sure, maybe? The monitoring > current status is showing no issues
- Pending tickets are flipped to open when our ticket master goes through them.
- There is nothing in the scheduler section of the settings
-
Error lines in production log.
There are quite a few, but nothing that I would know how to fix.
E, [2024-03-21T15:24:07.324194#1146-382526400] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:07.590811#1146-382561200] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:07.842485#1146-382769260] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:08.067293#1146-382674160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:08.123562#1146-382769340] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:08.435867#1147-383171660] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:08.621554#1146-382612480] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:13.289680#1147-383051620] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:13.917119#1146-382561200] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:18.021129#1146-382674160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:19.224116#1146-382769260] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:32.833037#1146-382561320] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:34.236927#1146-382854580] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:40.114668#1146-382674160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:40.808651#1146-382711700] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:41.054942#1147-383174860] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:41.390753#1147-383363820] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:41.526294#1147-383212760] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:52.396158#1146-382769340] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:53.001641#1146-382408140] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:24:58.183906#1146-382786780] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:24:58.413464#1146-382711700] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:05.305819#1147-383316820] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:05.564939#1147-382671280] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:11.324505#1146-382674160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:11.479808#1147-383316820] ERROR -- : No route matches [PUT] /testing-put.txt (ActionController::RoutingError)
E, [2024-03-21T15:25:11.538802#1146-382769260] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:11.588048#1146-382674360] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:11.775520#1147-383331300] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:12.062133#1147-383171660] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:12.353649#1147-383172160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:12.832863#1146-382612520] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:15.400585#1147-383212760] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:15.566816#1146-382487920] ERROR -- : No route matches [GET] /testing-put.txt (ActionController::RoutingError)
E, [2024-03-21T15:25:16.679536#1146-382561200] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:19.996351#1146-382854420] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:20.225981#1146-382711700] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:21.564989#1146-382699500] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:21.682205#1147-382825400] ERROR -- : Failed to upgrade to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: )
E, [2024-03-21T15:25:29.694514#1146-382535580] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:47.231271#1147-383172160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:51.193983#1146-382769340] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:25:57.205309#1147-383303200] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:00.781332#1146-382854400] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:04.111123#1146-382408140] ERROR -- : No route matches [GET] /actuator/env (ActionController::RoutingError)
E, [2024-03-21T15:26:05.597525#1146-382561320] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:09.412230#1147-383303200] ERROR -- : No route matches [GET] /env (ActionController::RoutingError)
E, [2024-03-21T15:26:09.946890#1146-382854400] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:09.955441#1146-382678040] ERROR -- : No route matches [GET] /mydomain.zip (ActionController::RoutingError)
E, [2024-03-21T15:26:09.984520#1146-382769560] ERROR -- : No route matches [GET] /zammad.mydomain.com.rar (ActionController::RoutingError)
E, [2024-03-21T15:26:10.076484#1146-382854380] ERROR -- : No route matches [GET] /mydomain.com.rar (ActionController::RoutingError)
E, [2024-03-21T15:26:10.095549#1146-382786780] ERROR -- : No route matches [GET] /zammad.mydomain.com.zip (ActionController::RoutingError)
E, [2024-03-21T15:26:10.122576#1146-382674360] ERROR -- : No route matches [GET] /mydomain.com.tar.gz (ActionController::RoutingError)
E, [2024-03-21T15:26:10.128098#1146-382880160] ERROR -- : No route matches [GET] /mydomain.tar.gz (ActionController::RoutingError)
E, [2024-03-21T15:26:10.529838#1146-382854400] ERROR -- : No route matches [GET] /mydomain.com.zip (ActionController::RoutingError)
E, [2024-03-21T15:26:10.749239#1147-383174860] ERROR -- : No route matches [GET] /mydomain.rar (ActionController::RoutingError)
E, [2024-03-21T15:26:10.752169#1147-383375920] ERROR -- : No route matches [GET] /zammad.mydomain.com.tar.gz (ActionController::RoutingError)
E, [2024-03-21T15:26:15.963292#1147-382988420] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:16.499308#1147-383375920] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:16.737665#1147-382824580] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:17.032454#1146-382769160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:20.032175#1147-382825400] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:22.991618#1147-383331300] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:25.975539#1146-382487920] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:28.653441#1146-382674360] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:28.884327#1146-382786780] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:29.074616#1146-382854580] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:29.277834#1146-382534560] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:29.475676#1146-382526400] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:29.884334#1146-382561320] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:34.258356#1146-382678040] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:43.086201#1147-383173200] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:48.678657#1146-382884040] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:53.801053#1147-383392900] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:26:58.495467#1146-382535580] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:01.331620#1147-383329960] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:02.976245#1147-383069140] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:04.330163#1146-382854380] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:05.584985#1146-382674260] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:07.050904#1146-382884040] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:07.329139#1146-382769160] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:27:08.053352#1146-382534560] ERROR -- : No route matches [GET] /api/v1 (ActionController::RoutingError)
E, [2024-03-21T15:28:04.191595#1146-382871880] ERROR -- : No route matches [POST] / (ActionController::RoutingError)
E, [2024-03-21T15:28:28.568687#1147-383069140] ERROR -- : No route matches [GET] /backup.sql (ActionController::RoutingError)
E, [2024-03-21T15:28:29.177320#1147-383316820] ERROR -- : No route matches [GET] /database.sql (ActionController::RoutingError)
E, [2024-03-21T15:28:29.767940#1146-382699500] ERROR -- : No route matches [GET] /db.sql (ActionController::RoutingError)
E, [2024-03-21T15:28:30.357704#1146-382884040] ERROR -- : No route matches [GET] /dump.sql (ActionController::RoutingError)
E, [2024-03-21T15:28:30.946823#1146-382880160] ERROR -- : No route matches [GET] /zammad.mydomain.com.sql (ActionController::RoutingError)
E, [2024-03-21T15:28:36.083241#1147-383172160] ERROR -- : No route matches [GET] /wp-content/force-download.php (ActionController::RoutingError)
E, [2024-03-21T15:29:00.556247#1147-383329960] ERROR -- : No route matches [GET] /%252e%252e%255c%252e%252e%255c%252e%252e%255c%252e%252e%255c%252e%252e%255c%252e%252e%255c%252e%252e%255c%252e%252e%255cwindows%255c%252e%255cwin%252eini (ActionController::RoutingError)
E, [2024-03-21T15:31:11.965838#1146-382920600] ERROR -- : No route matches [POST] / (ActionController::RoutingError)
- Jobs Scheduler.
#<Scheduler:0x00007f2178111a48
id: 7,
name: "Generate 'Session' data.",
method: "Sessions.jobs",
period: 60,
running: 0,
last_run: Fri, 09 Feb 2024 06:35:54.008000000 UTC +00:00,
prio: 1,
pid: "148780",
note: nil,
error_message: "",
status: "ok",
active: true,
updated_by_id: 39,
created_by_id: 1,
created_at: Thu, 19 Mar 2020 21:02:31.057000000 UTC +00:00,
updated_at: Fri, 09 Feb 2024 06:35:54.008000000 UTC +00:00,
timeplan: {}>
- Does it have any impact if you unset your ENVs and restart?
-
I can test this after hours today when its not in use
-
I actually just deployed a staging env that is an exact match of the prod and got to test this. It seems to have worked! I will test on prod tonight and report back tomorrow on if it solved the issue or not
-
EDIT: It did not work on the prod deployment for some reason
Hopefully this is useful to you