We’re happy to announce today the release of Siren Federate version 28 for Elasticsearch version 8.2.3. This release includes the following enhancements and fixes:
New features:
- Added support for runtime fields defined at query time.
- Added support to join on _id metadata field for semi-join queries. The projection of _id metadata field is not supported in the context of an inner join.
Enhancements:
- Upgraded to {es} 8.2.3
- Upgraded Arrow to version 7.0.0.
- Added various optimizations to the vectorized processing pipeline. Most noticeably:
- When processing local transfer requests, data packets are directly serialized using arrowBuf.
- Improved vectorization performance when projecting single-valued columns.
- Added index-based scan strategy for keyword field type.
- Implemented vectorization of distributed hash semi-join operations.
- Implemented vectorization of distributed inner join operations.
- Added support for a placeholder to represent the Elasticsearch configuration directory in the JDBC properties of a datasource configuration.
Bug fixes:
- Fixed an issue that could prevent queries containing joins to be executed after a redistribution of shards in a cluster.
- Fixed an issue that could cause a node to crash when handling an out of memory error during packet serialization.
- Fixed an issue that could prevent joins on keyword fields across virtual indices from being executed.
- Fixed fingerprinting of search request executions to match the result of explain requests.
Download it here.