Hello I have a problem with ElasticSearch index.
i search here in the forum and try already everything but not successfull so i hope somebody can give me the correct tip.
U have installed Zammad Version 3.1.x on CentOs
everything runs fine exept the elasticsearch.
elasticsearch is installed, including the ingest-attachment plugin
i can get the elasticsearch statusinfo localhost:9200:
version: "7.3.2"
build_type: "rpm"
lucene_version: "8.1.0"
if i try to rebuild the index i get the following error:
E, [2019-09-18T17:05:23.272733 #27890-47027212506520] ERROR -- : Retrying SearchIndexJob in #<Proc:0x0000558abff52220@/opt/zammad/app/jobs/search_index_job.rb:3 (lambda)> seconds, due to a StandardError. The original exception was nil.
I, [2019-09-18T17:05:23.273899 #27886-69833754397460] INFO -- : # 0
E, [2019-09-18T17:05:23.274368 #27886-69833754397460] ERROR -- : Unable to process GET request to elasticsearch URL 'http://127.0.0.1:9200/zammad_production_user/_doc/_search'. Check the response and payload for detailed information:
Response:
#<UserAgent::Result:0x00007f06d42cfbf0 @success=false, @body=nil, @data=nil, @code=0, @content_type=nil, @error="#<RuntimeError: Unable to process http call '#<Net::HTTPServiceUnavailable 503 Service Unavailable readbody=true>'>">
Payload:
{:from=>0, :size=>50, :sort=>[{"created_at"=>{:order=>"desc"}}, "_score"], :query=>{:bool=>{:must=>[{:query_string=>{:default_field=>"role_ids", :query=>"\"2\" OR \"3\""}}, {"query_string"=>{"query"=>"**", "default_operator"=>"AND", "analyze_wildcard"=>true}}]}}}
Payload size: 0M
E, [2019-09-18T17:05:23.274424 #27886-69833754397460] ERROR -- : Unable to process GET request to elasticsearch URL 'http://127.0.0.1:9200/zammad_production_user/_doc/_search'. Check the response and payload for detailed information:
Response:
#<UserAgent::Result:0x00007f06d42cfbf0 @success=false, @body=nil, @data=nil, @code=0, @content_type=nil, @error="#<RuntimeError: Unable to process http call '#<Net::HTTPServiceUnavailable 503 Service Unavailable readbody=true>'>">
Payload:
{:from=>0, :size=>50, :sort=>[{"created_at"=>{:order=>"desc"}}, "_score"], :query=>{:bool=>{:must=>[{:query_string=>{:default_field=>"role_ids", :query=>"\"2\" OR \"3\""}}, {"query_string"=>{"query"=>"**", "default_operator"=>"AND", "analyze_wildcard"=>true}}]}}}
Payload size: 0M
I, [2019-09-18T17:05:23.276486 #27886-69833754397460] INFO -- : Completed 200 OK in 40ms (Views: 0.3ms | ActiveRecord: 2.8ms)
I, [2019-09-18T17:05:23.286254 #27890-47027212506520] INFO -- : Enqueued SearchIndexJob (Job ID: 356cbb53-8371-4bfa-ae83-cca355ce4bd9) to DelayedJob(default) at 2019-09-18 15:06:43 UTC with arguments: "StatsStore", 5
I, [2019-09-18T17:05:23.290000 #27890-47027212506520] INFO -- : 2019-09-18T17:05:23+0200: [Worker(host:zammand.local pid:27890)] Job SearchIndexJob [356cbb53-8371-4bfa-ae83-cca355ce4bd9] from DelayedJob(default) with arguments: ["StatsStore", 5] (id=56212) (queue=default) COMPLETED after 0.0911
I, [2019-09-18T17:05:23.293924 #27890-47027212506520] INFO -- : 2019-09-18T17:05:23+0200: [Worker(host:zammand.local pid:27890)] Job SearchIndexJob [dad8a5f5-93c2-4eb4-b083-10b5a67069ba] from DelayedJob(default) with arguments: ["StatsStore", 6] (id=56213) (queue=default) RUNNING
I, [2019-09-18T17:05:23.342531 #27890-47027212506520] INFO -- : Performing SearchIndexJob (Job ID: dad8a5f5-93c2-4eb4-b083-10b5a67069ba) from DelayedJob(default) with arguments: "StatsStore", 6
I, [2019-09-18T17:05:23.367354 #27890-47027212506520] INFO -- : # curl -X POST "http://127.0.0.1:9200/zammad_production_stats_store/_doc/6?pipeline=zammad537802081995" \
I, [2019-09-18T17:05:23.376841 #27890-47027212506520] INFO -- : # 400
E, [2019-09-18T17:05:23.379154 #27890-47027212506520] ERROR -- : Unable to process POST request to elasticsearch URL 'http://127.0.0.1:9200/zammad_production_stats_store/_doc/6?pipeline=zammad537802081995'. Check the response and payload for detailed information:
Response:
#<UserAgent::Result:0x0000558abe668f48 @success=false, @body="{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"pipeline with id [zammad537802081995] does not exist\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"pipeline with id [zammad537802081995] does not exist\"},\"status\":400}", @data=nil, @code="400", @content_type=nil, @error="Client Error: #<Net::HTTPBadRequest 400 Bad Request readbody=true>!">
Payload:
{"id"=>6, "stats_store_object_id"=>1, "o_id"=>10, "key"=>"dashboard", "related_o_id"=>nil, "related_stats_store_object_id"=>nil, "data"=>{"StatsTicketLoadMeasure"=>{"used_for_average"=>0.0, "average_per_agent"=>0.4, "percent"=>0.0, "state"=>"superbad", "own"=>0, "total"=>3, "average_per_agent_in_percent"=>0.0}, "StatsTicketWaitingTime"=>{"handling_time"=>0, "average_per_agent"=>0, "state"=>"supergood", "percent"=>0.0}, "StatsTicketEscalation"=>{"used_for_average"=>0, "average_per_agent"=>0.0, "state"=>"supergood", "own"=>0, "total"=>0}, "StatsTicketChannelDistribution"=>{"channels"=>{"email"=>{"icon"=>"email", "inbound"=>6, "outbound"=>5, "inbound_in_percent"=>85, "outbound_in_percent"=>100}, "phone"=>{"icon"=>"phone", "inbound"=>1, "outbound"=>0, "inbound_in_percent"=>14, "outbound_in_percent"=>0}, "twitter"=>{"icon"=>"twitter", "inbound"=>0, "outbound"=>0, "inbound_in_percent"=>0, "outbound_in_percent"=>0}, "facebook"=>{"icon"=>"facebook", "inbound"=>0, "outbound"=>0, "inbound_in_percent"=>0, "outbound_in_percent"=>0}}}, "StatsTicketInProcess"=>{"used_for_average"=>100.0, "average_per_agent"=>37.5, "state"=>"supergood", "in_process"=>1, "percent"=>100.0, "total"=>1}, "StatsTicketReopen"=>{"used_for_average"=>100.0, "percent"=>100.0, "average_per_agent"=>18.8, "state"=>"superbad", "count"=>1, "total"=>1}}, "created_by_id"=>1, "created_at"=>Fri, 13 Sep 2019 07:46:43 UTC +00:00, "updated_at"=>Wed, 18 Sep 2019 14:48:54 UTC +00:00, "stats_store_object"=>"User", "stats_store_object_ref"=>{"id"=>10, "organization_id"=>1, "login"=>"nick.hugentobler@osotec.ch", "firstname"=>"Nick", "lastname"=>"Hugentobler", "email"=>"nick.hugentobler@osotec.ch", "web"=>"", "phone"=>"", "fax"=>"", "mobile"=>"", "department"=>"", "street"=>"", "zip"=>"", "city"=>"", "country"=>"", "address"=>"", "vip"=>false, "verified"=>false, "active"=>true, "note"=>"", "last_login"=>Wed, 18 Sep 2019 11:26:11 UTC +00:00, "out_of_office"=>false, "out_of_office_start_at"=>nil, "out_of_office_end_at"=>nil, "out_of_office_replacement_id"=>nil, "preferences"=>{"notification_config"=>{"matrix"=>{"create"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>true, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "update"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>true, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "reminder_reached"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>false, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "escalation"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>false, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}}}, "locale"=>"de-de", "intro"=>true}, "updated_by_id"=>1, "created_by_id"=>6, "created_at"=>Fri, 13 Sep 2019 07:40:24 UTC +00:00, "updated_at"=>Wed, 18 Sep 2019 14:38:40 UTC +00:00, "organization"=>"osoTec GmbH", "permissions"=>["user_preferences", "user_preferences.password", "user_preferences.notifications", "user_preferences.access_token", "user_preferences.language", "user_preferences.linked_accounts", "user_preferences.device", "user_preferences.avatar", "user_preferences.calendar", "user_preferences.out_of_office", "ticket.agent", "chat.agent", "cti.agent", "knowledge_base.reader"], "role_ids"=>[2]}}
Payload size: 0M
E, [2019-09-18T17:05:23.379507 #27890-47027212506520] ERROR -- : Error performing SearchIndexJob (Job ID: dad8a5f5-93c2-4eb4-b083-10b5a67069ba) from DelayedJob(default) in 36.76ms: RuntimeError (Unable to process POST request to elasticsearch URL 'http://127.0.0.1:9200/zammad_production_stats_store/_doc/6?pipeline=zammad537802081995'. Check the response and payload for detailed information:
Response:
#<UserAgent::Result:0x0000558abe668f48 @success=false, @body="{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"pipeline with id [zammad537802081995] does not exist\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"pipeline with id [zammad537802081995] does not exist\"},\"status\":400}", @data=nil, @code="400", @content_type=nil, @error="Client Error: #<Net::HTTPBadRequest 400 Bad Request readbody=true>!">
Payload:
{"id"=>6, "stats_store_object_id"=>1, "o_id"=>10, "key"=>"dashboard", "related_o_id"=>nil, "related_stats_store_object_id"=>nil, "data"=>{"StatsTicketLoadMeasure"=>{"used_for_average"=>0.0, "average_per_agent"=>0.4, "percent"=>0.0, "state"=>"superbad", "own"=>0, "total"=>3, "average_per_agent_in_percent"=>0.0}, "StatsTicketWaitingTime"=>{"handling_time"=>0, "average_per_agent"=>0, "state"=>"supergood", "percent"=>0.0}, "StatsTicketEscalation"=>{"used_for_average"=>0, "average_per_agent"=>0.0, "state"=>"supergood", "own"=>0, "total"=>0}, "StatsTicketChannelDistribution"=>{"channels"=>{"email"=>{"icon"=>"email", "inbound"=>6, "outbound"=>5, "inbound_in_percent"=>85, "outbound_in_percent"=>100}, "phone"=>{"icon"=>"phone", "inbound"=>1, "outbound"=>0, "inbound_in_percent"=>14, "outbound_in_percent"=>0}, "twitter"=>{"icon"=>"twitter", "inbound"=>0, "outbound"=>0, "inbound_in_percent"=>0, "outbound_in_percent"=>0}, "facebook"=>{"icon"=>"facebook", "inbound"=>0, "outbound"=>0, "inbound_in_percent"=>0, "outbound_in_percent"=>0}}}, "StatsTicketInProcess"=>{"used_for_average"=>100.0, "average_per_agent"=>37.5, "state"=>"supergood", "in_process"=>1, "percent"=>100.0, "total"=>1}, "StatsTicketReopen"=>{"used_for_average"=>100.0, "percent"=>100.0, "average_per_agent"=>18.8, "state"=>"superbad", "count"=>1, "total"=>1}}, "created_by_id"=>1, "created_at"=>Fri, 13 Sep 2019 07:46:43 UTC +00:00, "updated_at"=>Wed, 18 Sep 2019 14:48:54 UTC +00:00, "stats_store_object"=>"User", "stats_store_object_ref"=>{"id"=>10, "organization_id"=>1, "login"=>"nick.hugentobler@osotec.ch", "firstname"=>"Nick", "lastname"=>"Hugentobler", "email"=>"nick.hugentobler@osotec.ch", "web"=>"", "phone"=>"", "fax"=>"", "mobile"=>"", "department"=>"", "street"=>"", "zip"=>"", "city"=>"", "country"=>"", "address"=>"", "vip"=>false, "verified"=>false, "active"=>true, "note"=>"", "last_login"=>Wed, 18 Sep 2019 11:26:11 UTC +00:00, "out_of_office"=>false, "out_of_office_start_at"=>nil, "out_of_office_end_at"=>nil, "out_of_office_replacement_id"=>nil, "preferences"=>{"notification_config"=>{"matrix"=>{"create"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>true, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "update"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>true, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "reminder_reached"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>false, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}, "escalation"=>{"criteria"=>{"owned_by_me"=>true, "owned_by_nobody"=>false, "no"=>false}, "channel"=>{"email"=>true, "online"=>true}}}}, "locale"=>"de-de", "intro"=>true}, "updated_by_id"=>1, "created_by_id"=>6, "created_at"=>Fri, 13 Sep 2019 07:40:24 UTC +00:00, "updated_at"=>Wed, 18 Sep 2019 14:38:40 UTC +00:00, "organization"=>"osoTec GmbH", "permissions"=>["user_preferences", "user_preferences.password", "user_preferences.notifications", "user_preferences.access_token", "user_preferences.language", "user_preferences.linked_accounts", "user_preferences.device", "user_preferences.avatar", "user_preferences.calendar", "user_preferences.out_of_office", "ticket.agent", "chat.agent", "cti.agent", "knowledge_base.reader"], "role_ids"=>[2]}}
Payload size: 0M):
/opt/zammad/lib/search_index_backend.rb:230:in `add'
/opt/zammad/app/models/concerns/has_search_index_backend.rb:66:in `search_index_update_backend'
/opt/zammad/app/jobs/search_index_job.rb:14:in `perform'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/execution.rb:39:in `block in perform_now'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:109:in `block in run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/i18n-1.6.0/lib/i18n.rb:297:in `with_locale'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in <module:Translation>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `instance_exec'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `block in run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/logging.rb:26:in `block (4 levels) in <module:Logging>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/notifications.rb:168:in `block in instrument'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/notifications/instrumenter.rb:23:in `instrument'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/notifications.rb:168:in `instrument'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/logging.rb:25:in `block (3 levels) in <module:Logging>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/logging.rb:46:in `block in tag_logger'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/tagged_logging.rb:71:in `block in tagged'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/tagged_logging.rb:28:in `tagged'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/tagged_logging.rb:71:in `tagged'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/logging.rb:46:in `tag_logger'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/logging.rb:22:in `block (2 levels) in <module:Logging>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `instance_exec'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `block in run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:136:in `run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/execution.rb:38:in `perform_now'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/execution.rb:24:in `block in execute'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:109:in `block in run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/railtie.rb:28:in `block (4 levels) in <class:Railtie>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/reloader.rb:73:in `block in wrap'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/reloader.rb:72:in `wrap'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/railtie.rb:27:in `block (3 levels) in <class:Railtie>'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `instance_exec'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:118:in `block in run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.3/lib/active_support/callbacks.rb:136:in `run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/execution.rb:22:in `execute'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/activejob-5.2.3/lib/active_job/queue_adapters/delayed_job_adapter.rb:42:in `perform'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/backend/base.rb:81:in `block in invoke_job'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:61:in `block in initialize'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:66:in `execute'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:40:in `run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/backend/base.rb:78:in `invoke_job'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:230:in `block (2 levels) in run'
/opt/zammad/vendor/ruby-2.5.5/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout'
/opt/zammad/vendor/ruby-2.5.5/lib/ruby/2.5.0/timeout.rb:103:in `timeout'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:230:in `block in run'
/opt/zammad/vendor/ruby-2.5.5/lib/ruby/2.5.0/benchmark.rb:308:in `realtime'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:229:in `run'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:312:in `block in reserve_and_run_one_job'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:61:in `block in initialize'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:66:in `execute'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/lifecycle.rb:40:in `run_callbacks'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:312:in `reserve_and_run_one_job'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:213:in `block in work_off'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:212:in `times'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/delayed_job-4.1.7/lib/delayed/worker.rb:212:in `work_off'
/opt/zammad/app/models/scheduler.rb:367:in `block (3 levels) in worker'
/opt/zammad/vendor/ruby-2.5.5/lib/ruby/2.5.0/benchmark.rb:308:in `realtime'
/opt/zammad/app/models/scheduler.rb:365:in `block (2 levels) in worker'
/opt/zammad/app/models/scheduler.rb:361:in `loop'
/opt/zammad/app/models/scheduler.rb:361:in `block in worker'
/opt/zammad/vendor/bundle/ruby/2.5.0/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
E, [2019-09-18T17:05:23.379633 #27890-47027212506520] ERROR -- : Retrying SearchIndexJob in #<Proc:0x0000558abff52220@/opt/zammad/app/jobs/search_index_job.rb:3 (lambda)> seconds, due to a StandardError. The original exception was nil.
so the index is not builded and elasticsearch is not working, i not see any users ect.
what can i do to fix this problem?
thanks for any help in advance!
