I am working through the Siren/Senzing integration guide here:
https://docs.support.siren.io/siren-er/2.0.0/siren-er/siren-er-getting-started.html
At the point where the second logstash pipeline must be run, I see the logstash pipeline container run but these errors appear in the docker logs:
[2025-01-31T06:33:39,715][ERROR][logstash.filters.ruby ][main][c45f8902770b2707e8132312acf1789eb1f5a5742310b2346f78afa597aa9348] Ruby exception occurred: undefined method `each' for nil:NilClass {:class=>"NoMethodError", :backtrace=>["(ruby filte
r code):31:in `block in filter_method'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1.8/lib/logstash/filters/ruby.rb:96:in `inline_script'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1
.8/lib/logstash/filters/ruby.rb:89:in `filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:159:in `do_filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:178:in `block in multi_filter'", "org/jruby/RubyArr
ay.java:1821:in `each'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:175:in `multi_filter'", "org/logstash/config/ir/compiler/AbstractFilterDelegatorExt.java:134:in `multi_filter'", "/usr/share/logstash/logstash-core/lib/logstash
/java_pipeline.rb:299:in `block in start_workers'"]}
Please let me know what this error means and how I can troubleshoot further?
More complete log:
[2025-01-31T06:33:17,239][WARN ][logstash.outputs.elasticsearch][main] You have enabled encryption but DISABLED certificate verification, to make sure your data is secure remove `ssl_certificate_verification => false`
[2025-01-31T06:33:17,252][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[https://sirenadmin:xxxxxx@host.docker.internal:9220/]}}
[2025-01-31T06:33:17,293][INFO ][logstash.outputs.elasticsearch][main] Using a default mapping template {:es_version=>7, :ecs_compatibility=>:v8}
[2025-01-31T06:33:17,303][WARN ][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"https://sirenadmin:xxxxxx@host.docker.internal:9220/"}
[2025-01-31T06:33:17,312][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch version determined (7.17.1) {:es_version=>7}
[2025-01-31T06:33:17,312][WARN ][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}
[2025-01-31T06:33:17,340][INFO ][logstash.outputs.elasticsearch][main] Config is not compliant with data streams. `data_stream => auto` resolved to `false`
[2025-01-31T06:33:17,340][INFO ][logstash.outputs.elasticsearch][main] Config is not compliant with data streams. `data_stream => auto` resolved to `false`
[2025-01-31T06:33:17,341][WARN ][logstash.outputs.elasticsearch][main] Elasticsearch Output configured with `ecs_compatibility => v8`, which resolved to an UNRELEASED preview of version 8.0.0 of the Elastic Common Schema. Once ECS v8 and an updated
release of this plugin are publicly available, you will need to update this plugin to resolve this warning.
[2025-01-31T06:33:17,342][INFO ][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["https://host.docker.internal:9220"]}
[2025-01-31T06:33:17,343][WARN ][logstash.outputs.elasticsearch][main] You have enabled encryption but DISABLED certificate verification, to make sure your data is secure remove `ssl_certificate_verification => false`
[2025-01-31T06:33:17,354][INFO ][logstash.outputs.elasticsearch][main] Using a default mapping template {:es_version=>7, :ecs_compatibility=>:v8}
[2025-01-31T06:33:17,354][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[https://sirenadmin:xxxxxx@host.docker.internal:9220/]}}
[2025-01-31T06:33:17,387][WARN ][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"https://sirenadmin:xxxxxx@host.docker.internal:9220/"}
[2025-01-31T06:33:17,392][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch version determined (7.17.1) {:es_version=>7}
[2025-01-31T06:33:17,393][WARN ][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}
[2025-01-31T06:33:17,426][INFO ][logstash.outputs.elasticsearch][main] Config is not compliant with data streams. `data_stream => auto` resolved to `false`
[2025-01-31T06:33:17,426][INFO ][logstash.outputs.elasticsearch][main] Config is not compliant with data streams. `data_stream => auto` resolved to `false`
[2025-01-31T06:33:17,426][WARN ][logstash.outputs.elasticsearch][main] Elasticsearch Output configured with `ecs_compatibility => v8`, which resolved to an UNRELEASED preview of version 8.0.0 of the Elastic Common Schema. Once ECS v8 and an updated
release of this plugin are publicly available, you will need to update this plugin to resolve this warning.
[2025-01-31T06:33:17,438][INFO ][logstash.outputs.elasticsearch][main] Using a default mapping template {:es_version=>7, :ecs_compatibility=>:v8}
[2025-01-31T06:33:18,292][WARN ][logstash.javapipeline ][main] 'pipeline.ordered' is enabled and is likely less efficient, consider disabling if preserving event order is not necessary
[2025-01-31T06:33:18,351][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>1, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>1, "pipeline.sources"=>["/usr/share/logs
tash/pipeline/siren_senzing_updater.conf"], :thread=>"#<Thread:0x52a3ea69 run>"}
[2025-01-31T06:33:19,346][INFO ][logstash.javapipeline ][main] Pipeline Java execution initialization time {"seconds"=>0.99}
[2025-01-31T06:33:19,372][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"}
[2025-01-31T06:33:19,439][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2025-01-31T06:33:19,614][INFO ][logstash.inputs.rabbitmq ][main][siren_senzing_updater] Connected to RabbitMQ {:url=>"amqp://user:XXXXXX@localhost:5672/"}
[2025-01-31T06:33:19,680][INFO ][logstash.inputs.rabbitmq ][main][siren_senzing_updater] Declaring exchange 'senzing-rabbitmq-exchange' with type direct
[2025-01-31T06:33:39,715][ERROR][logstash.filters.ruby ][main][c45f8902770b2707e8132312acf1789eb1f5a5742310b2346f78afa597aa9348] Ruby exception occurred: undefined method `each' for nil:NilClass {:class=>"NoMethodError", :backtrace=>["(ruby filte
r code):31:in `block in filter_method'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1.8/lib/logstash/filters/ruby.rb:96:in `inline_script'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1
.8/lib/logstash/filters/ruby.rb:89:in `filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:159:in `do_filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:178:in `block in multi_filter'", "org/jruby/RubyArr
ay.java:1821:in `each'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:175:in `multi_filter'", "org/logstash/config/ir/compiler/AbstractFilterDelegatorExt.java:134:in `multi_filter'", "/usr/share/logstash/logstash-core/lib/logstash
/java_pipeline.rb:299:in `block in start_workers'"]}
[2025-01-31T06:38:14,435][ERROR][logstash.filters.ruby ][main][c45f8902770b2707e8132312acf1789eb1f5a5742310b2346f78afa597aa9348] Ruby exception occurred: undefined method `each' for nil:NilClass {:class=>"NoMethodError", :backtrace=>["(ruby filte
r code):31:in `block in filter_method'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1.8/lib/logstash/filters/ruby.rb:96:in `inline_script'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-ruby-3.1
.8/lib/logstash/filters/ruby.rb:89:in `filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:159:in `do_filter'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:178:in `block in multi_filter'", "org/jruby/RubyArr
ay.java:1821:in `each'", "/usr/share/logstash/logstash-core/lib/logstash/filters/base.rb:175:in `multi_filter'", "org/logstash/config/ir/compiler/AbstractFilterDelegatorExt.java:134:in `multi_filter'", "/usr/share/logstash/logstash-core/lib/logstash
/java_pipeline.rb:299:in `block in start_workers'"]}
Thanks in advance.