Metarank Versions Save

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

0.7.8

1 month ago

Bugfixes

fix slash and semicolon field value crashes by @shuttie in https://github.com/metarank/metarank/pull/1280
add retry in case of broken iterator for kinesis by @shuttie in https://github.com/metarank/metarank/pull/1283

What's Changed

add jvm21 and mac-m1 to CI by @shuttie in https://github.com/metarank/metarank/pull/1274
ci: bump redis to 7.2.4 by @shuttie in https://github.com/metarank/metarank/pull/1277
ci: bump localstack to 3.2.0 by @shuttie in https://github.com/metarank/metarank/pull/1276
bump kinesis-mock to 0.4.6 by @shuttie in https://github.com/metarank/metarank/pull/1275
Update rocksdbjni to 9.0.0 by @scala-steward in https://github.com/metarank/metarank/pull/1278
update http4s to 1.0.0-m41 by @shuttie in https://github.com/metarank/metarank/pull/1281

Full Changelog: https://github.com/metarank/metarank/compare/0.7.7...0.7.8

0.7.7

1 month ago

Bugfixes

fix native memleak in model cache by @shuttie in https://github.com/metarank/metarank/pull/1259
add guards for closed booster by @shuttie in https://github.com/metarank/metarank/pull/1266
fix CI for redis 7.2+ due to client|setinfo being blocked by @shuttie in https://github.com/metarank/metarank/pull/1267

Docs

- warmup reference by @vgoloviznin in https://github.com/metarank/metarank/pull/1236

Other

Update docs by @vgoloviznin in https://github.com/metarank/metarank/pull/1221
Docs update by @vgoloviznin in https://github.com/metarank/metarank/pull/1235
Doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/1237
Update lucene-analysis-common, ... to 9.9.2 by @scala-steward in https://github.com/metarank/metarank/pull/1240
Update scalafmt-core to 3.8.0 by @scala-steward in https://github.com/metarank/metarank/pull/1244
Update scalatest to 3.2.18 by @scala-steward in https://github.com/metarank/metarank/pull/1245
Update jcl-over-slf4j to 2.0.12 by @scala-steward in https://github.com/metarank/metarank/pull/1246
Update sbt to 1.9.9 by @scala-steward in https://github.com/metarank/metarank/pull/1249
Update rocksdbjni to 8.10.2 by @scala-steward in https://github.com/metarank/metarank/pull/1250
Update kafka-clients to 3.7.0 by @scala-steward in https://github.com/metarank/metarank/pull/1252
Update scala-library to 2.13.13 by @scala-steward in https://github.com/metarank/metarank/pull/1253
Update sentry-logback to 7.5.0 by @scala-steward in https://github.com/metarank/metarank/pull/1256
Update logback-classic to 1.5.3 by @scala-steward in https://github.com/metarank/metarank/pull/1258
Update pulsar-client, pulsar-client-admin to 3.2.0 by @scala-steward in https://github.com/metarank/metarank/pull/1243
Update kinesis, s3 to 2.23.21 by @scala-steward in https://github.com/metarank/metarank/pull/1247
Update pulsar-client, pulsar-client-admin to 3.2.1 by @scala-steward in https://github.com/metarank/metarank/pull/1265
Update sentry-logback to 7.6.0 by @scala-steward in https://github.com/metarank/metarank/pull/1264
Update s3 to 2.25.3 by @scala-steward in https://github.com/metarank/metarank/pull/1263
Update cats-effect to 3.5.4 by @scala-steward in https://github.com/metarank/metarank/pull/1262
Update rocksdbjni to 8.11.3 by @scala-steward in https://github.com/metarank/metarank/pull/1261
Update lucene-analysis-common, ... to 9.10.0 by @scala-steward in https://github.com/metarank/metarank/pull/1260
Update kinesis to 2.25.15 by @scala-steward in https://github.com/metarank/metarank/pull/1273
Update lettuce-core to 6.3.2.RELEASE by @scala-steward in https://github.com/metarank/metarank/pull/1271
Update guava to 33.1.0-jre by @scala-steward in https://github.com/metarank/metarank/pull/1270
Update sbt-assembly to 2.2.0 by @scala-steward in https://github.com/metarank/metarank/pull/1269
Update onnxruntime to 1.17.1 by @scala-steward in https://github.com/metarank/metarank/pull/1251
Update scallop to 5.1.0 by @scala-steward in https://github.com/metarank/metarank/pull/1272

Full Changelog: https://github.com/metarank/metarank/compare/0.7.6...0.7.7

0.7.6

3 months ago

Major changes

support query+item scoped rates by @shuttie in https://github.com/metarank/metarank/pull/1227
support custom eval metric names by @shuttie in https://github.com/metarank/metarank/pull/1230
API Warmup support by @shuttie in https://github.com/metarank/metarank/pull/1233
GCP Memstore redis: add extra toggle to disable CLIENT TRACKING cache invalidation by @shuttie in https://github.com/metarank/metarank/pull/1231

What's Changed

clamp xgboost weights to 31 by @shuttie in https://github.com/metarank/metarank/pull/1223
Update rocksdbjni to 8.10.0 by @scala-steward in https://github.com/metarank/metarank/pull/1224
doc: remove relative_number as superceded by regular number by @shuttie in https://github.com/metarank/metarank/pull/1228
do not allow to use reserved feature names used by rocksdb backend by @shuttie in https://github.com/metarank/metarank/pull/1229
fix match error on analytics payload with unknown feature type by @shuttie in https://github.com/metarank/metarank/pull/1232

Full Changelog: https://github.com/metarank/metarank/compare/0.7.5...0.7.6

0.7.5

3 months ago

Major changes

Unbiased LTR support for XGBoost/LightGBM by @shuttie in https://github.com/metarank/metarank/pull/1214
speed-up the NDCG calculation on eval by @shuttie in https://github.com/metarank/metarank/pull/1215
document a train-test splitting strategy by @shuttie in https://github.com/metarank/metarank/pull/1216

Bugfixes

fix validate crash on clicks on non-existent ranking by @shuttie in https://github.com/metarank/metarank/pull/1192

Dependencies

Update logback-classic to 1.4.13 by @scala-steward in https://github.com/metarank/metarank/pull/1189
Update logback-classic to 1.4.14 by @scala-steward in https://github.com/metarank/metarank/pull/1193
Update kinesis to 2.21.42 by @scala-steward in https://github.com/metarank/metarank/pull/1199
Update kinesis, s3 to 2.21.46 by @scala-steward in https://github.com/metarank/metarank/pull/1212
Update jcl-over-slf4j to 2.0.11 by @scala-steward in https://github.com/metarank/metarank/pull/1211
Update rocksdbjni to 8.9.1 by @scala-steward in https://github.com/metarank/metarank/pull/1209
Update pulsar-client, pulsar-client-admin to 3.1.2 by @scala-steward in https://github.com/metarank/metarank/pull/1207
Update sentry-logback to 7.2.0 by @scala-steward in https://github.com/metarank/metarank/pull/1205
Update lettuce-core to 6.3.1.RELEASE by @scala-steward in https://github.com/metarank/metarank/pull/1204
Update tokenizers to 0.26.0 by @scala-steward in https://github.com/metarank/metarank/pull/1201
Update kafka-clients to 3.6.1 by @scala-steward in https://github.com/metarank/metarank/pull/1196
Update commons-io to 2.15.1 by @scala-steward in https://github.com/metarank/metarank/pull/1194
Update sbt to 1.9.8 by @scala-steward in https://github.com/metarank/metarank/pull/1210
Update hnswlib-core to 1.1.2 by @scala-steward in https://github.com/metarank/metarank/pull/1202
Update lucene-analysis-common, ... to 9.9.1 by @scala-steward in https://github.com/metarank/metarank/pull/1206
Update api to 0.26.0 by @scala-steward in https://github.com/metarank/metarank/pull/1200
Update guava to 33.0.0-jre by @scala-steward in https://github.com/metarank/metarank/pull/1203
Update s3 to 2.23.3 by @scala-steward in https://github.com/metarank/metarank/pull/1213
migrate to http4s ember backend by @shuttie in https://github.com/metarank/metarank/pull/1217
uap-parser and circe-yaml upgrade by @shuttie in https://github.com/metarank/metarank/pull/1218
Update mapdb to 3.1.0 by @shuttie in https://github.com/metarank/metarank/pull/1219
update http4s to M40 by @shuttie in https://github.com/metarank/metarank/pull/1220

Full Changelog: https://github.com/metarank/metarank/compare/0.7.4...0.7.5

0.7.4

5 months ago

Major changes

fix crash in divers feature when data is yet missing in redis by @shuttie in https://github.com/metarank/metarank/pull/1172
rocksdb state store impl by @shuttie in https://github.com/metarank/metarank/pull/1180
add support for custom loggers by @shuttie in https://github.com/metarank/metarank/pull/1183
add check for data=out on sort by @shuttie in https://github.com/metarank/metarank/pull/1185
fix file backend options are not used in init, trigger a rocksdb compaction on end by @shuttie in https://github.com/metarank/metarank/pull/1184
add check for termfreq command that out file does not exist by @shuttie in https://github.com/metarank/metarank/pull/1186

Dependencies

Update s3 to 2.21.25 by @scala-steward in https://github.com/metarank/metarank/pull/1168
Update lettuce-core to 6.2.7.RELEASE by @scala-steward in https://github.com/metarank/metarank/pull/1166
Update sentry-logback to 6.34.0 by @scala-steward in https://github.com/metarank/metarank/pull/1176
Update lettuce-core to 6.3.0.RELEASE by @scala-steward in https://github.com/metarank/metarank/pull/1175
Update onnxruntime to 1.16.3 by @scala-steward in https://github.com/metarank/metarank/pull/1174
Update sbt-assembly to 2.1.5 by @scala-steward in https://github.com/metarank/metarank/pull/1173

Full Changelog: https://github.com/metarank/metarank/compare/0.7.3...0.7.4

0.7.3

5 months ago

What's Changed

fix: Metarank gets killed (oomkiller): not closed outputstream in binary format with compress enabled by @tomsquest in https://github.com/metarank/metarank/pull/1150

Dependencies

Doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/1036
Doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/1068
Update kinesis, s3 to 2.20.142 by @scala-steward in https://github.com/metarank/metarank/pull/1119
Update scalafmt-core to 3.7.14 by @scala-steward in https://github.com/metarank/metarank/pull/1118
Update sbt-scalafmt to 2.5.2 by @scala-steward in https://github.com/metarank/metarank/pull/1117
Update sentry-logback to 6.29.0 by @scala-steward in https://github.com/metarank/metarank/pull/1116
Update rocksdbjni to 8.3.3 by @scala-steward in https://github.com/metarank/metarank/pull/1122
Update scala-library to 2.13.12 by @scala-steward in https://github.com/metarank/metarank/pull/1123
Update scalatest to 3.2.17 by @scala-steward in https://github.com/metarank/metarank/pull/1124
Update s3 to 2.20.145 by @scala-steward in https://github.com/metarank/metarank/pull/1125
Update cross-encoders.md by @vgoloviznin in https://github.com/metarank/metarank/pull/1132
Stabledoc by @vgoloviznin in https://github.com/metarank/metarank/pull/1133
Update sbt-assembly to 2.1.3 by @scala-steward in https://github.com/metarank/metarank/pull/1127
Update onnxruntime to 1.16.0 by @scala-steward in https://github.com/metarank/metarank/pull/1128
Update sbt to 1.9.6 by @scala-steward in https://github.com/metarank/metarank/pull/1130
Update api to 0.24.0 by @scala-steward in https://github.com/metarank/metarank/pull/1134
Update commons-io to 2.14.0 by @scala-steward in https://github.com/metarank/metarank/pull/1136
Update sentry-logback to 6.30.0 by @scala-steward in https://github.com/metarank/metarank/pull/1137
Update kafka-clients to 3.6.0 by @scala-steward in https://github.com/metarank/metarank/pull/1138
Update lucene-analysis-common, ... to 9.8.0 by @scala-steward in https://github.com/metarank/metarank/pull/1139
Update rocksdbjni to 8.5.4 by @scala-steward in https://github.com/metarank/metarank/pull/1140
Update kinesis to 2.20.162 by @scala-steward in https://github.com/metarank/metarank/pull/1143
Update cats-effect to 3.5.2 by @scala-steward in https://github.com/metarank/metarank/pull/1141
Update tokenizers to 0.24.0 by @scala-steward in https://github.com/metarank/metarank/pull/1135
Update sbt-assembly to 2.1.4 by @scala-steward in https://github.com/metarank/metarank/pull/1155
Update scalafmt-core to 3.7.15 by @scala-steward in https://github.com/metarank/metarank/pull/1154
Update sbt to 1.9.7 by @scala-steward in https://github.com/metarank/metarank/pull/1153
Update pulsar-client, pulsar-client-admin to 3.1.1 by @scala-steward in https://github.com/metarank/metarank/pull/1152
Update commons-io to 2.15.0 by @scala-steward in https://github.com/metarank/metarank/pull/1151
Update onnxruntime to 1.16.1 by @scala-steward in https://github.com/metarank/metarank/pull/1147
Update s3 to 2.21.2 by @scala-steward in https://github.com/metarank/metarank/pull/1149
Update sentry-logback to 6.32.0 by @scala-steward in https://github.com/metarank/metarank/pull/1148
Update api to 0.25.0 by @scala-steward in https://github.com/metarank/metarank/pull/1156
Update guava to 32.1.3-jre by @scala-steward in https://github.com/metarank/metarank/pull/1146
Update tokenizers to 0.25.0 by @scala-steward in https://github.com/metarank/metarank/pull/1157
Update scallop to 5.0.1 by @scala-steward in https://github.com/metarank/metarank/pull/1160
Update sentry-logback to 6.33.1 by @scala-steward in https://github.com/metarank/metarank/pull/1161
Update kinesis to 2.21.17 by @scala-steward in https://github.com/metarank/metarank/pull/1162
Update rocksdbjni to 8.6.7 by @scala-steward in https://github.com/metarank/metarank/pull/1163
Update onnxruntime to 1.16.2 by @scala-steward in https://github.com/metarank/metarank/pull/1164
Update scalafmt-core to 3.7.16 by @scala-steward in https://github.com/metarank/metarank/pull/1165

Full Changelog: https://github.com/metarank/metarank/compare/0.7.2...0.7.3

0.7.2

8 months ago

Major changes

support for Redis TTLs by @shuttie in https://github.com/metarank/metarank/pull/1114
use DJL tokenizers for HF tokenization support by @shuttie in https://github.com/metarank/metarank/pull/1112

Fixes

set default api timeout to 5 minutes by @shuttie in https://github.com/metarank/metarank/pull/1113

Docs

Added inference model overview by @vgoloviznin in https://github.com/metarank/metarank/pull/1039
Fix/api doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/1035
doc: add note on db config for redis by @shuttie in https://github.com/metarank/metarank/pull/1115

Dependencies

Update onnxruntime to 1.15.0 by @scala-steward in https://github.com/metarank/metarank/pull/1040
Update commons-io to 2.12.0 by @scala-steward in https://github.com/metarank/metarank/pull/1041
Update lucene-analysis-common, ... to 9.6.0 by @scala-steward in https://github.com/metarank/metarank/pull/1043
Update sbt to 1.8.3 by @scala-steward in https://github.com/metarank/metarank/pull/1045
Update scalatest to 3.2.16 by @scala-steward in https://github.com/metarank/metarank/pull/1046
Update cats-effect to 3.4.11 by @scala-steward in https://github.com/metarank/metarank/pull/1049
Update sentry-logback to 6.21.0 by @scala-steward in https://github.com/metarank/metarank/pull/1052
Update scalafmt-core to 3.7.4 by @scala-steward in https://github.com/metarank/metarank/pull/1053
Fix/api doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/1067
dependency updates by @shuttie in https://github.com/metarank/metarank/pull/1111

Full Changelog: https://github.com/metarank/metarank/compare/0.7.1...0.7.2

0.7.1

1 year ago

Important changes

Embedding API by @shuttie in https://github.com/metarank/metarank/pull/1016
Dont compute unused features by @shuttie in https://github.com/metarank/metarank/pull/1031

Bugfixes

unbreak e2e tests for kafka by @shuttie in https://github.com/metarank/metarank/pull/1018
create dir when not-exists for mapdb by @shuttie in https://github.com/metarank/metarank/pull/1019
use ubuntu mirror for ci by @shuttie in https://github.com/metarank/metarank/pull/1020
fix crash on scalar codec with long numeric lists by @shuttie in https://github.com/metarank/metarank/pull/1021
fix flaky FileFreqEstimatorTest by @shuttie in https://github.com/metarank/metarank/pull/1022
file cts should accept only bin files by @shuttie in https://github.com/metarank/metarank/pull/1023
fix crash on reopening existing file state db by @shuttie in https://github.com/metarank/metarank/pull/1024
add took field to all api responses by @shuttie in https://github.com/metarank/metarank/pull/1025
expose all bi/cross encoder features in the /inference endpoint by default by @shuttie in https://github.com/metarank/metarank/pull/1026
make lm.backend and lm.weights optional by @shuttie in https://github.com/metarank/metarank/pull/1027
implement file-based model store by @shuttie in https://github.com/metarank/metarank/pull/1028
expose /inference api by @shuttie in https://github.com/metarank/metarank/pull/1029
unbreak mpnet onnx inference by @shuttie in https://github.com/metarank/metarank/pull/1030
ignore missing cache files by @shuttie in https://github.com/metarank/metarank/pull/1032
TermFreqDict gzipped file loading by @shuttie in https://github.com/metarank/metarank/pull/1033
add warning for single cts dataset by @shuttie in https://github.com/metarank/metarank/pull/1034

Dependencies

Update pulsar-client, pulsar-client-admin to 2.11.1 by @scala-steward in https://github.com/metarank/metarank/pull/1007
Update api to 0.22.0 by @scala-steward in https://github.com/metarank/metarank/pull/1003
Update rocksdbjni to 8.1.1.1 by @scala-steward in https://github.com/metarank/metarank/pull/1015
Update s3 to 2.20.48 by @scala-steward in https://github.com/metarank/metarank/pull/1008
Update logback-classic to 1.4.7 by @scala-steward in https://github.com/metarank/metarank/pull/1010
Update api to 0.22.1 by @scala-steward in https://github.com/metarank/metarank/pull/1009
Update sentry-logback to 6.18.1 by @scala-steward in https://github.com/metarank/metarank/pull/1013
Update cats-effect to 3.4.10 by @scala-steward in https://github.com/metarank/metarank/pull/1014

Full Changelog: https://github.com/metarank/metarank/compare/0.7.0...0.7.1

0.7.0

1 year ago

New features

Semantic content recommendations by @shuttie in https://github.com/metarank/metarank/pull/969
Qdrant support for recommendations vector knn search by @shuttie in https://github.com/metarank/metarank/pull/971
Bi-encoder feature extractor by @shuttie in https://github.com/metarank/metarank/pull/981
explicit relevance judgments support by @shuttie in https://github.com/metarank/metarank/pull/983
BM25 field matching support by @shuttie in https://github.com/metarank/metarank/pull/987
Cross-encoder support by @shuttie in https://github.com/metarank/metarank/pull/1002

Minor changes

Docs update by @vgoloviznin in https://github.com/metarank/metarank/pull/853
Doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/855
Fix link by @vgoloviznin in https://github.com/metarank/metarank/pull/857
New release by @vgoloviznin in https://github.com/metarank/metarank/pull/862
Fixes #963 by @vgoloviznin in https://github.com/metarank/metarank/pull/964
Doc update by @vgoloviznin in https://github.com/metarank/metarank/pull/965
Fixes for api doc by @vgoloviznin in https://github.com/metarank/metarank/pull/972
trim to top-N items for diversity extractor by @shuttie in https://github.com/metarank/metarank/pull/979
fix utf8 handling when run in docker by @shuttie in https://github.com/metarank/metarank/pull/980
merge biencoder and field_match by @shuttie in https://github.com/metarank/metarank/pull/982
fix(doc): typo in cli.md by @tomsquest in https://github.com/metarank/metarank/pull/986
onnx embedding support for field_match by @shuttie in https://github.com/metarank/metarank/pull/989
use PrintProgress for autofeature status line by @shuttie in https://github.com/metarank/metarank/pull/991
Fix autofeature on explicit judgements by @shuttie in https://github.com/metarank/metarank/pull/992
add field split strategy by @shuttie in https://github.com/metarank/metarank/pull/993
fix native memory leak in ONNX inference by @shuttie in https://github.com/metarank/metarank/pull/994
fix crash on analytics payload generation for biencoder schema by @shuttie in https://github.com/metarank/metarank/pull/995
emit user/info train events only when needed by @shuttie in https://github.com/metarank/metarank/pull/996
BM25 should count doc freq, not field freq by @shuttie in https://github.com/metarank/metarank/pull/997
Caching support for embeddings by @shuttie in https://github.com/metarank/metarank/pull/998
show progress for embedding cache loading by @shuttie in https://github.com/metarank/metarank/pull/1001
support RFC4180 CSV double-quotes by @shuttie in https://github.com/metarank/metarank/pull/1000

Dependencies

Update kinesis, s3 to 2.20.21 by @scala-steward in https://github.com/metarank/metarank/pull/967
scalafmt 3.7.3 by @shuttie in https://github.com/metarank/metarank/pull/999
Update sentry-logback to 6.17.0 by @scala-steward in https://github.com/metarank/metarank/pull/990
Update rocksdbjni to 8.0.0 by @scala-steward in https://github.com/metarank/metarank/pull/985
less frequent dep update for aws-sdk by @shuttie in https://github.com/metarank/metarank/pull/975
Update s3 to 2.20.27 by @scala-steward in https://github.com/metarank/metarank/pull/978
Update jcl-over-slf4j to 2.0.7 by @scala-steward in https://github.com/metarank/metarank/pull/977
Update sentry-logback to 6.16.0 by @scala-steward in https://github.com/metarank/metarank/pull/976
Update logback-classic to 1.4.6 by @scala-steward in https://github.com/metarank/metarank/pull/973

New Contributors

@tomsquest made their first contribution in https://github.com/metarank/metarank/pull/986

Full Changelog: https://github.com/metarank/metarank/compare/0.6.4...0.7.0

0.6.4

1 year ago

Important changes

nothing, only bugfixes.

What's Changed

fix dockerhub latest tag pointing to all images by @shuttie in https://github.com/metarank/metarank/pull/954
scalar fields config format mismatch with docs by @shuttie in https://github.com/metarank/metarank/pull/960
allow empty features in config by @shuttie in https://github.com/metarank/metarank/pull/961
Fix crash on no reranker by @shuttie in https://github.com/metarank/metarank/pull/962

Dependencies

Update kinesis, s3 to 2.20.19 by @scala-steward in https://github.com/metarank/metarank/pull/959

Full Changelog: https://github.com/metarank/metarank/compare/0.6.3...0.6.4