OpenSearch Versions Save

🔎 Open source distributed and RESTful search engine.

2.7.0

1 year ago

2023-04-18 Version 2.7.0 Release Notes

[2.7]

Added

  • Add GeoTile and GeoHash Grid aggregations on GeoShapes. (#5589)
  • Disallow multiple data paths for search nodes (#6427)
  • [Segment Replication] Allocation and rebalancing based on average primary shard count per index (#6422)
  • The truncation limit of the OpenSearchJsonLayout logger is now configurable (#6569)
  • Add 'base_path' setting to File System Repository (#6558)
  • Return success on DeletePits when no PITs exist. (#6544)
  • Add initial search pipelines (#6587)
  • Add node repurpose command for search nodes (#6517)
  • Add wait_for_completion parameter to resize, open, and forcemerge APIs (#6434)
  • [Segment Replication] Apply backpressure when replicas fall behind (#6563)
  • [Remote Store] Integrate remote segment store in peer recovery flow (#6664)
  • Enable sort optimization for all NumericTypes (#6464
  • Remove 'cluster_manager' role attachment when using 'node.master' deprecated setting (#6331)
  • Add new cluster settings to ignore weighted round-robin routing and fallback to default behaviour. (#6834)
  • Add experimental support for ZSTD compression. (#3577)
  • [Segment Replication] Add point in time and scroll query compatibility. (#6644)
  • Add retry delay as dynamic setting for cluster maanger throttling. (#6998)
  • Introduce full support for searchable snapshots (#5087)
  • Introduce full support for Segment Replication (#5147)

Dependencies

  • Bump org.apache.logging.log4j:log4j-core from 2.18.0 to 2.20.0 (#6490)
  • Bump com.azure:azure-storage-common from 12.19.3 to 12.20.0 (#6492
  • Bump snakeyaml from 1.33 to 2.0 (#6511)
  • Bump io.projectreactor.netty:reactor-netty from 1.1.3 to 1.1.4
  • Bump com.avast.gradle:gradle-docker-compose-plugin from 0.15.2 to 0.16.11
  • Bump net.minidev:json-smart from 2.4.8 to 2.4.9
  • Bump com.google.protobuf:protobuf-java to 3.22.2 (#6994)
  • Bump Netty to 4.1.90.Final (#6677
  • Bump com.diffplug.spotless from 6.15.0 to 6.17.0
  • Bump org.apache.zookeeper:zookeeper from 3.8.0 to 3.8.1
  • Bump net.minidev:json-smart from 2.4.7 to 2.4.10
  • Bump org.apache.maven:maven-model from 3.6.2 to 3.9.1
  • Bump org.codehaus.jettison:jettison from 1.5.3 to 1.5.4 (#6878)
  • Add com.github.luben:zstd-jni:1.5.5-1 (#3577)
  • Bump: Netty from 4.1.90.Final to 4.1.91.Final , ASM 9.4 to ASM 9.5, ByteBuddy 1.14.2 to 1.14.3 (#6981)
  • Bump com.azure:azure-storage-blob from 12.15.0 to 12.21.1
  • Bump org.gradle.test-retry from 1.5.1 to 1.5.2
  • Bump org.apache.hadoop:hadoop-minicluster from 3.3.4 to 3.3.5

Changed

  • Require MediaType in Strings.toString API (#6009)
  • [Refactor] XContent base classes from xcontent to core library (#5902)
  • Added a new field type: flat_object (#6507)
  • Changed opensearch-env to respect already set OPENSEARCH_HOME environment variable (#6956)
  • Increased visibility of BaseRestHandler’s unrecognized method using a new public unrecognizedStrings method. (#7125)

Deprecated

  • Map, List, and Set in org.opensearch.common.collect (#6609)

Fixed

  • Added depth check in doc parser for deep nested document (#5199)
  • Added equals/hashcode for named DocValueFormat.DateTime inner class (#6357)
  • Fixed bug for searchable snapshot to take 'base_path' of blob into account (#6558)
  • Fix fuzziness validation (#5805)
  • Avoid negative memory result in IndicesQueryCache stats calculation (#6917)
  • Fix GetSnapshots to not return non-existent snapshots with ignore_unavailable=true (#6839)
  • Fix GlobalAggregation with profile option enabled returns incorrect result (#7114)

2.6.0

1 year ago

2023-02-22 Version 2.6.0 Release Notes

[2.6]

Added

  • Add index create block when all nodes have breached high disk watermark (#5852)
  • Add cluster manager throttling stats in nodes/stats API (#5790)
  • Add support for feature flags in opensearch.yml (#4959)
  • Add query for initialized extensions (#5658)
  • Add update-index-settings allowlist for searchable snapshot (#5907)
  • Add new cat/segment_replication API to surface Segment Replication metrics (#5718).
  • Replace latches with CompletableFutures for extensions (#5646)
  • Add support to disallow search request with preference parameter with strict weighted shard routing(#5874)
  • Add support to apply index create block (#4603)
  • Add support for minimum compatible version for extensions (#6003)
  • Add a guardrail to limit maximum number of shard on the cluster (#6143)
  • Add cancellation of in-flight SearchTasks based on resource consumption (#5606)
  • Add support for ppc64le architecture (#5459)
  • Add a setting to control auto release of OpenSearch managed index creation block (#6277)
  • Fix timeout error when adding a document to an index with extension running (#6275)
  • Handle translog upload during primary relocation for remote-backed indexes (#5804)
  • Batch translog sync/upload per x ms for remote-backed indexes (#5854)

Dependencies

  • Update nebula-publishing-plugin to 19.2.0 (#5704)
  • Bump reactor-netty from 1.1.1 to 1.1.2 (#5878)
  • OpenJDK Update (January 2023 Patch releases) (#6075)
  • Bump Mockito from 4.7.0 to 5.1.0, ByteBuddy from 1.12.18 to 1.12.22 (#6088)
  • Bump joda from 2.10.13 to 2.12.2 (#6095)
  • Upgrade to Lucene 9.5.0 (#6078)
  • Bump antlr4 from 4.9.3 to 4.11.1 (#6116)
  • Bump Netty from 4.1.86.Final to 4.1.87.Final (#6130)
  • Bump Jackson from 2.14.1 to 2.14.2 (#6129)
  • Bump org.apache.ant:ant from 1.10.12 to 1.10.13 (#6306)
  • Bump azure-core-http-netty from 1.12.7 to 1.12.8 (#6304)
  • Bump com.azure:azure-storage-common from 12.18.1 to 12.19.3 (#6304)
  • Bump reactor-netty-http from 1.0.24 to 1.1.2 (#6309)
  • Bump com.google.protobuf:protobuf-java from 3.21.12 to 3.22.0 (#6387)
  • Bump io.projectreactor.netty:reactor-netty from 1.1.2 to 1.1.3 (#6386)
  • Bump com.diffplug.spotless from 6.10.0 to 6.15.0 (#6385)
  • Bump jettison from 1.5.1 to 1.5.3 (#6391)

Changed

  • Use ReplicationFailedException instead of OpensearchException in ReplicationTarget (#4725)
  • [Refactor] Use local opensearch.common.SetOnce instead of lucene's utility class (#5947)
  • Cluster health call to throw decommissioned exception for local decommissioned node(#6008)
  • [Refactor] core.common to new opensearch-common library (#5976)
  • Update API spec for cluster health API (#6399)

Removed

  • Remove deprecated org.gradle.util.DistributionLocator usage (#6212)

Fixed

  • [Segment Replication] Fix for peer recovery (#5344)
  • Fix weighted shard routing state across search requests(#6004)
  • [Segment Replication] Fix bug where inaccurate sequence numbers are sent during replication (#6122)
  • Enable numeric sort optimisation for few numerical sort types (#6321)
  • Fix Opensearch repository-s3 plugin cannot read ServiceAccount token (#6390

2.5.0

1 year ago

2023-01-10 Version 2.5.0 Release Notes

[2.5]

Added

  • Prevent deletion of snapshots that are backing searchable snapshot indexes (#5365)
  • Reject bulk requests with invalid actions (#5384)
  • Add max_shard_size parameter for shrink API (#5229)
  • Add experimental support for extensions (#5347), (#5518), (#5597), (#5615))
  • Add support to register settings dynamically (#5495)
  • Add auto release workflow (#5582)
  • Add CI bundle pattern to distribution download (#5348)
  • Experimental support for extended backward compatiblity in searchable snapshots (#5429)
  • Add support of default replica count cluster setting (#5610)
  • Add support for refresh level durability (#5253)
  • Add Request level Durability using Remote Translog functionality (#5757)
  • Support to fail open requests on search shard failures with weighted traffic routing (#5072)
  • Support versioning for Weighted routing apis(#5255)
  • Add support for discovered cluster manager and remove local weights (#5680)
  • Add new level to get health per awareness attribute in _cluster/health (#5694)

Changed

  • Change http code for DecommissioningFailedException from 500 to 400 (#5283)
  • Pre conditions check before updating weighted routing metadata (#4955)
  • Support remote translog transfer for request level durability (#4480)
  • Gracefully handle concurrent zone decommission action (#5542)

Deprecated

  • Refactor fuzziness interface on query builders (#5433)

Fixed

  • Fix case sensitivity for wildcard queries (#5462)
  • Apply cluster manager throttling settings during bootstrap (#5524)
  • Update thresholds map when cluster manager throttling setting is removed (#5524)
  • Fix backward compatibility for static cluster manager throttling threshold setting (#5633)
  • Fix index exclusion behavior in snapshot restore and clone APIs (#5626)
  • Fix graph filter error in search (#5665)

Dependencies

  • Bumps bcpg-fips from 1.0.5.1 to 1.0.7.1 (#5148)
  • Bumps commons-compress from 1.21 to 1.22 (#5104)
  • Bumps geoip2 from 3.0.1 to 3.0.2 in /modules/ingest-geoip (#5201)
  • Bumps gson from 2.9.0 to 2.10 in /plugins/repository-hdfs (#5184)
  • Bumps protobuf-java from 3.21.8 to 3.21.9 in /test/fixtures/hdfs-fixture (#5185)
  • Bumps gradle-extra-configurations-plugin from 7.0.0 to 8.0.0 (#5330)
  • Bumps jcodings from 1.0.57 to 1.0.58 (#5330)
  • Bumps google-http-client-jackson2 from 1.35.0 to 1.42.3 (#5330)
  • Bumps azure-core from 1.33.0 to 1.34.0 (#5330)
  • Bumps azure-core-http-netty from 1.12.4 to 1.12.7 (#5330)
  • Bumps maxmind-db from 2.0.0 to 2.1.0 (#5330)
  • Bumps json-schema-validator from 1.0.69 to 1.0.73 (#5330)
  • Bumps proto-google-common-protos from 2.8.0 to 2.10.0 (#5330)
  • Bumps protobuf-java from 3.21.7 to 3.21.9 (#5330)
  • Bumps gradle from 7.5 to 7.6 (#5382)
  • Bumps jackson from 2.14.0 to 2.14.1 (#5355)
  • Bumps apache-rat from 0.13 to 0.15 (#5686)
  • Bumps reactor-netty from 1.0.18 to 1.1.1 (#5685)
  • Bumps gradle-info-plugin from 7.1.3 to 12.0.0 (#5684)