I am currently working through evaluation of the Siren+Senzing Integration as shown here:
https://docs.support.siren.io/siren-er/2.0.0/siren-er/siren-er-getting-started.html
Everything seems fine until step 6:
" 6. Run Logstash to update Elasticsearch with updated data from PostgreSQL"
When I carry out the chec: “Check there are entity records in Elasticsearch:” in the Dev Tools section of the Siren Investigate dashboard:
“GET entity2record/_search”
I don’t see any of the data being returned from elasticsearch, just an empty data structure json:
{
"took" : 0,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : {
"value" : 1,
"relation" : "eq"
},
"max_score" : 1.0,
"hits" : [
{
"_index" : "entity2record",
"_type" : "_doc",
"_id" : "%{entityid}",
"_score" : 1.0,
"_ignored" : [
"entity_rels_deletes_query.keyword"
],
"_source" : {
"@version" : "1",
"entity_rels_deletes_query_response" : {
"retries" : {
"bulk" : 0,
"search" : 0
},
"timed_out" : false,
"deleted" : 0,
"noops" : 0,
"throttled_until_millis" : 0,
"total" : 0,
"batches" : 0,
"failures" : [ ],
"throttled_millis" : 0,
"requests_per_second" : -1.0,
"version_conflicts" : 0,
"took" : 1
},
"newevents" : { },
"entity_ids" : [ ],
"tags" : [
"_jdbcstreamingdefaultsused",
"_rubyexception"
],
"@timestamp" : "2025-01-31T05:13:40.258544Z",
"task_id" : "senzing",
"entity_rels_deletes_query" : """{"query": {"bool": {"should": [ {"bool": {"should": [ {"terms":{"min_res_ent_id": [ ] }}, {"terms": {"max_res_ent_id": [ ]}} ]}}, {"bool": { "should": [ {"terms": {"min_res_ent_id": [ ]}}, {"terms": {"max_res_ent_id": [ ]}}], "must_not": {"ids": {"values": [ "-" ]}}}}]}}}"""
}
}
]
}
}
Please can you provide some steps I could use to troubleshoot in more detail why the data hasn’t ended up in this index?