NVIDIA Merlin Merlin Versions Save

NVIDIA Merlin is an open source library providing end-to-end GPU-accelerated recommender systems, from feature engineering and preprocessing to training deep learning models and running inference in production.

v23.12.00

3 months ago

What's Changed

Full Changelog: https://github.com/NVIDIA-Merlin/Merlin/compare/v23.09.00...v23.12.00

v23.09.00

7 months ago

What's Changed

New Contributors

Full Changelog: https://github.com/NVIDIA-Merlin/Merlin/compare/v23.08.00...v23.09.00

v23.08.00

8 months ago

What's Changed

New Contributors

Full Changelog: https://github.com/NVIDIA-Merlin/Merlin/compare/v23.06.00...v23.08.00

v23.05.00

11 months ago

What’s Changed

🐜 Bug Fixes

  • revert tensorflow install @jperez999 (#997)
  • update paths in deploying recsys example @nv-alaiacano (#988)
  • WAR for hugectr gmock build error @EmmaQiaoCh (#982)
  • Quick-start for Ranking: Fix bug when saving model trained with single task and moved util classes to Models @gabrielspmoreira (#967)

🚀 Features

  • Quick-start for ranking - Added --shuffled_train arg to ranking.py script @gabrielspmoreira (#985)
  • Update feast to run on newest release version 0.31 @jperez999 (#975)
  • Quick-start for Ranking: Fix bug when saving model trained with single task and moved util classes to Models @gabrielspmoreira (#967)

📄 Documentation

  • Quick start for Ranking - Include support for Triton inference @rnyak (#966)
  • Add Recommender Model Guide @bschifferer (#953)
  • Support matrix updates for 23.04 @nvidia-merlin-bot (#959)
  • add 22.04 changelog @nv-alaiacano (#954)

🔧 Maintenance

  • revert tensorflow install @jperez999 (#997)
  • Update dockerfile for release-23.05 @nv-alaiacano (#996)
  • syntax fix: use f-string @nv-alaiacano (#990)
  • update paths in deploying recsys example @nv-alaiacano (#988)
  • Update feast to run on newest release version 0.31 @jperez999 (#975)
  • downgrade protobuf after feast install @jperez999 (#984)
  • WAR for hugectr gmock build error @EmmaQiaoCh (#982)
  • Update for new CUDA/arrow/parquet @EmmaQiaoCh (#974)
  • Bump dask and pyarrow versions in integration test @edknv (#979)
  • fix ci container to work with new environment @jperez999 (#981)
  • Update merlin base to use triton/dlfw 23.03 @edknv (#976)
  • Add requirements.txt that points to Merlin 23.04 releases @karlhigley (#939)
  • Add workflows to check base branch and set stable branch @oliverholworthy (#965)
  • Update tag pattern in GitHub Workflows @oliverholworthy (#964)
  • don't re-run tests on closed PR @nv-alaiacano (#963)

v23.04.00

1 year ago

What’s Changed

🐜 Bug Fixes

  • update version of cupy to be 12.0.0 minimum @jperez999 (#899)
  • Replace nvtabular.utils with merlin.core.compat in criteo nvtabular n… @edknv (#892)
  • Install horovod 0.27 for tensorflow 2.11 support @edknv (#883)
  • Update transformers tf 2 11 @jperez999 (#882)
  • Minor adjustments to the example notebooks and tests @karlhigley (#864)

🚀 Features

  • Update sok ut @EmmaQiaoCh (#876)

📄 Documentation

  • remove legacy examples @radekosmulski (#868)
  • Support matrix updates for 23.02 @nvidia-merlin-bot (#854)

🔧 Maintenance

  • Install comptabile version of protobuf in integration test @edknv (#911)
  • Don't install distributed embeddings by default, remove tests @nv-alaiacano (#908)
  • add TARGETARCH arg with default @nv-alaiacano (#902)
  • Remove duplicate build image in base Dockerfile @karlhigley (#901)
  • update version of cupy to be 12.0.0 minimum @jperez999 (#899)
  • Update unit tests to remove num_rows in read_parquet() @edknv (#891)
  • Revert "Install horovod 0.27 for tensorflow 2.11 support (#883)" @edknv (#890)
  • Update dependency versions in integration tests @edknv (#885)
  • Install horovod 0.27 for tensorflow 2.11 support @edknv (#883)
  • Update transformers tf 2 11 @jperez999 (#882)
  • Update sok ut @EmmaQiaoCh (#876)
  • increase container size @jperez999 (#869)
  • Fix libnvinfer conflict @EmmaQiaoCh (#855)
  • Bump ipython from 8.2.0 to 8.10.0 in /docs @dependabot (#848)
  • Arm64 support in dockerfile.merlin @jlinford (#846)
  • Use 'scikit-learn' rather than 'sklearn' in ci-runner @edknv (#860)
  • Bump tensorflow version in ci-runner to 2.10 @edknv (#849)
  • Remove the legacy Getting Started With MovieLens example notebooks @karlhigley (#859)

v23.02.00

1 year ago

What’s Changed

🚀 Features

  • Replace next(iter(loader)) with loader.peek() @edknv (#778)

📄 Documentation

  • update README.md/docs @radekosmulski (#804)
  • add links to docs @radekosmulski (#802)
  • Review getting started examples @radekosmulski (#779)
  • Support matrix updates for 22.12 @nvidia-merlin-bot (#784)
  • Replace next(iter(loader)) with loader.peek() @edknv (#778)
  • Address review feedback @mikemckiernan (#755)
  • Inconsistent order of columns in getting-started-movielens tutorial @mikemckiernan (#758)
  • Remove legacy Criteo examples @bschifferer (#757)
  • Review Criteo Examples and Added Unittest @bschifferer (#756)
  • Add SageMaker example to docs @mikemckiernan (#754)
  • Support matrix updates for 22.11 @nvidia-merlin-bot (#747)

🔧 Maintenance

  • container size increase to 16gb @jperez999 (#847)
  • Install hps backend and hps trt plugin in hugectr/tf/pytorch @EmmaQiaoCh (#783)
  • Add transformers==4.26.1 to CI runner image @oliverholworthy (#843)
  • Pin dask/distributed package versions after other installs in CI image @karlhigley (#841)
  • Fix a variety of minor issues with the CI container build @karlhigley (#840)
  • Adjust Merlin library installs in the nightly images @karlhigley (#839)
  • Fix string literal comparison in CI container test script @karlhigley (#838)
  • Consolidate size checks in container builds @karlhigley (#837)
  • fix size check to exclude mounts @jperez999 (#836)
  • Skip the container size check for the CI container @karlhigley (#832)
  • Remove NVT Triton back-end install from Docker base image @karlhigley (#831)
  • Pin pynvml to 11.4.1 @oliverholworthy (#830)
  • fix syntax error @nv-alaiacano (#821)
  • Shallow Clone HugeCTR submodules and remove .git/modules @oliverholworthy (#817)
  • clean up .git from cloned repos after installing @nv-alaiacano (#812)
  • Use --no-cache-dir on all pip install commands in dockerfiles @oliverholworthy (#808)
  • Add container size check to check script @jperez999 (#790)
  • Container size fix for <15gb @jperez999 (#789)
  • Fix docs build to use tox, as described @mikemckiernan (#803)
  • Install protobuf==3.20.3 for hugectr @EmmaQiaoCh (#777)
  • update dockerfile merlin base container @jperez999 (#781)
  • save env var for systems test @jperez999 (#780)
  • Replace next(iter(loader)) with loader.peek() @edknv (#778)
  • adding workflow for gpu ci on gha runner @jperez999 (#775)
  • revert ci change @bschifferer (#774)
  • Remove data manipulation in integration test and run the first notebo… @edknv (#773)
  • Pin pyarrow version for integration tests @oliverholworthy (#770)
  • Replace ensemble_model with executor_model @oliverholworthy (#772)
  • Remove hugectr test @jperez999 (#771)
  • Increase timeout of scaling-criteo/03-Training-with-HugeCTR test @oliverholworthy (#769)
  • Bump treelite to 2.4.0 to match with Triton 22.11 @karlhigley (#750)
  • Pin protobuf version in merlin base container to 3.20.3 @oliverholworthy (#765)
  • add gcp label to jenkinsfile @AyodeAwe (#762)
  • Update hps_tf folder name @EmmaQiaoCh (#763)
  • fixes support library lookups for torch @jperez999 (#761)
  • Migrate the legacy examples to the Merlin repo @karlhigley (#742)
  • Replace sklearn by scikit-learn in pip install @edknv (#753)
  • Adjust package paths for torch, numpy, numba in Torch Docker image @karlhigley (#751)
  • update drafter to work on tags @jperez999 (#743)
  • Add Jenkinsfile @AyodeAwe (#734)

v22.11.00

1 year ago

What’s Changed

🐜 Bug Fixes

  • Update dockerfile.ci to find the NVT dev requirements file @karlhigley (#740)
  • Restrict cmake<3.25.0 to avoid an issue finding CUDA toolkit @karlhigley (#739)
  • add required dataloader dependency to run unit tests for dataloader @jperez999 (#735)
  • anchor xgboost to 1.6.2 to make tests pass @jperez999 (#726)
  • adding new metric loss_batch from merlin models @jperez999 (#727)

📄 Documentation

  • Add example notebook for training and inference on Sagemaker @edknv (#692)

🔧 Maintenance

  • Add Jenkinsfile @AyodeAwe (#734)
  • Update dockerfile.ci to find the NVT dev requirements file @karlhigley (#740)
  • Restrict cmake<3.25.0 to avoid an issue finding CUDA toolkit @karlhigley (#739)
  • add required dataloader dependency to run unit tests for dataloader @jperez999 (#735)
  • add dataloader unit testing to container run @jperez999 (#728)
  • Increase timeout of multi-stage notebook test from 120 to 180 @oliverholworthy (#729)
  • anchor xgboost to 1.6.2 to make tests pass @jperez999 (#726)
  • adding new metric loss_batch from merlin models @jperez999 (#727)

untagged-c73c3c7a63c75e538917

1 year ago

What’s Changed

  • Remove nvtabular backend @jperez999 (#378)
  • Adding instructions for running the E2E example on CPU @AshishSardana (#332)
  • add fastai to torch dockerfile @jperez999 (#363)
  • Fail the build if tritonserver is missing from inference containers @benfred (#358)
  • Use python setup.py install to install SOK @jperez999 (#357)
  • hugectr dockerfile update @jperez999 (#355)
  • Add sparse operation kit and distributed embeddings to tf image @jperez999 (#354)
  • Update hugectr and torch dockerfiles @jperez999 (#353)
  • Update merlin base dockerfile for 22.05 @jperez999 (#348)
  • Update Arrow and triton versions @jperez999 (#347)
  • Sys tests fix @jperez999 (#342)
  • add Tf keras to dockerfile @jperez999 (#341)
  • Fix ci routes @jperez999 (#331)
  • Ci update @jperez999 (#337)
  • Update CI dockerfile with new cuda keyring and keys for repo @jperez999 (#334)
  • Fix CVE @jperez999 (#328)
  • Distributed embeddings failing to install because of PYTHONPATH Edit before hand @jperez999 (#326)
  • Fix for 'import error' in merlin-tensorflow-training:22.05 @EmmaQiaoCh (#317)
  • Merlin rm bad key @jperez999 (#316)
  • Merlin rm bad key @jperez999 (#314)
  • Remove bad key for Nvidia apt repositories @jperez999 (#311)
  • Add torch inf @jperez999 (#307)
  • Add torch inf @jperez999 (#305)
  • Remove merlin PYTHONPATH edits @jperez999 (#304)
  • remove horovod upgrade to fix tf perf issue @zehuanw (#302)
  • Add container infos to notebooks @bschifferer (#298)
  • Rm pip e @jperez999 (#300)

⚠ Breaking Changes

  • Update for change of hugectr branch name @EmmaQiaoCh (#705)
  • Fix ci order @jperez999 (#581)
  • Fix int test @jperez999 (#578)
  • Add numpy anchor version after all package building and updates @jperez999 (#566)
  • Fix unit scaling criteo inference serving @jperez999 (#559)
  • Moving loss and metrics to model.compile @oliverholworthy (#340)

🐜 Bug Fixes

  • adding dataloader repo to dockerfile @jperez999 (#722)
  • add in reinstall for dask and distributed after feast install @jperez999 (#713)
  • create resilient directory rm @jperez999 (#718)
  • fix missing lib issue by adding from upstream @jperez999 (#689)
  • get numba from upstream container @jperez999 (#690)
  • Adding git pull command to nightly docker to ensure latest commit @jperez999 (#617)
  • Fix unit scaling criteo inference serving @jperez999 (#559)
  • Fix integration test and update NB @radekosmulski (#544)
  • Fix nightly container builds @benfred (#518)
  • Fix typo in CI script file name @karlhigley (#445)
  • remove extra CMD from containers @jperez999 (#390)
  • Add pytorch tritonserver backend to ci dockerfile @jperez999 (#441)
  • updates from entrypoint and cupy cuda116 @jperez999 (#389)
  • Add matplotlib to torch container @jperez999 (#386)
  • Add nvt backend back into containers @jperez999 (#382)
  • Remove entrypoint from inference/training images. @oliverholworthy (#336)
  • fix: "illegal instruction" error in hugectr test jobs @EmmaQiaoCh (#295)

🚀 Features

  • Add Dropna to remove nulls in the dataset that creates error in the integration test of multi-stage deployment nb @rnyak (#629)
  • Update multi-stage deployment notebooks and integration test @rnyak (#627)
  • modify multi-stage deployment nbs wrt recent changes in systems  @rnyak (#621)
  • Changes for hugectr @EmmaQiaoCh (#502)
  • fixes in the PoC first notebook @rnyak (#487)
  • Switch over HDFS build/install scripts @bashimao (#434)
  • Add jupyter ENVs in case launching container with normal user @EmmaQiaoCh (#439)
  • fix poc nbs and move poc unit test @rnyak (#387)
  • Moving loss and metrics to model.compile @oliverholworthy (#340)

📄 Documentation

  • docs: semver to calver banner @mikemckiernan (#715)
  • docs: Add configuration for SEO @mikemckiernan (#723)
  • docs: Remove SM from the support matrix @mikemckiernan (#721)
  • Support matrix updates for 22.10 @nvidia-merlin-bot (#719)
  • fix: Update HugeCTR version to 4.1.1 @mikemckiernan (#717)
  • Support matrix updates for 22.09 @nvidia-merlin-bot (#711)
  • Support matrix updates for 22.10 @nvidia-merlin-bot (#710)
  • fix links in Multi-stage Bulding-and-deployment nbs @rnyak (#697)
  • Support matrix updates for 22.09 @nvidia-merlin-bot (#636)
  • Address virtual dev review comments @mikemckiernan (#626)
  • modify multi-stage deployment nbs wrt recent changes in systems  @rnyak (#621)
  • Add a "New Functionality" section to the Roadmap issue template @karlhigley (#596)
  • Update Logos of all examples @bschifferer (#569)
  • Update Merlin libs graphic @mikemckiernan (#560)
  • Support matrix updates for 22.06 @nvidia-merlin-bot (#500)
  • Support matrix updates for 22.07 @nvidia-merlin-bot (#499)
  • Get TF version from Python and not Pip @mikemckiernan (#498)
  • docs: Readability improvements @ryanrussell (#440)
  • Update Criteo Example with Merlin Models and Merlin Systems @rvk007 (#380)
  • fixes in the PoC first notebook @rnyak (#487)
  • Remove unnecessary dependencies from docs builds @mikemckiernan (#466)
  • add integration tests @radekosmulski (#310)
  • Update README with installation steps @rvk007 (#430)
  • Support matrix updates for 22.06 @nvidia-merlin-bot (#435)
  • Add NGC overview descriptions for our containers @benfred (#399)
  • Add run timestamp to data @mikemckiernan (#415)
  • Update URLs for Criteo dataset @mikemckiernan (#400)
  • Document the change to three containers @mikemckiernan (#379)
  • fix poc nbs and move poc unit test @rnyak (#387)
  • Add issue templates @karlhigley (#345)
  • Hand-edit the HugeCTR versions @mikemckiernan (#329)
  • Support matrix updates for 22.05 @nvidia-merlin-bot (#321)
  • chore: Add release-drafter @mikemckiernan (#308)

🔧 Maintenance

  • adding in instructions from the jenkins dockerfile to keep in one place @jperez999 (#725)
  • Pass mpi environment variable to tox @edknv (#724)
  • adding dataloader repo to dockerfile @jperez999 (#722)
  • docs: Add two projects to the support matrix @mikemckiernan (#720)
  • add in reinstall for dask and distributed after feast install @jperez999 (#713)
  • create resilient directory rm @jperez999 (#718)
  • Install horovod in the ci-runner image for CI testing @edknv (#712)
  • Update for change of hugectr branch name @EmmaQiaoCh (#705)
  • Add dist-info directories for packages copied in the tensorflow image. @oliverholworthy (#704)
  • revert change from 2209 requirements @jperez999 (#701)
  • revert to 22.08 @jperez999 (#698)
  • add llvmlite to base for numba dep @jperez999 (#691)
  • fix missing lib issue by adding from upstream @jperez999 (#689)
  • get numba from upstream container @jperez999 (#690)
  • update TFDE build @FDecaYed (#659)
  • Upgrade upstream container references, get pyarrow from upstream @jperez999 (#656)
  • fix: RMM and cuDF are no longer installed with pip @mikemckiernan (#637)
  • Adding hugectr to nightly build dockerfile @jperez999 (#632)
  • Increase timeout of unit test for second multi-stage notebook @oliverholworthy (#630)
  • Add Dropna to remove nulls in the dataset that creates error in the integration test of multi-stage deployment nb @rnyak (#629)
  • Enable unittest for 2stage notebooks @bschifferer (#628)
  • Update paths using BASE_DIR in multi-stage notebook to handle non-default value @oliverholworthy (#622)
  • Update multi-stage deployment notebooks and integration test @rnyak (#627)
  • anchor tf version to avoid errors in 2.10.0 libnvinfer look ups @jperez999 (#625)
  • Revert to working tritonserver call in notebook using testbooks @jperez999 (#619)
  • Remove lint env from tox config @karlhigley (#624)
  • Add a tox config file @karlhigley (#623)
  • Update ci container to use nightly base container @jperez999 (#620)
  • Adding git pull command to nightly docker to ensure latest commit @jperez999 (#617)
  • Add dock nite @jperez999 (#616)
  • Add dockerfile for nightly builds @jperez999 (#615)
  • Args mv @jperez999 (#603)
  • Args mv @jperez999 (#602)
  • anchor Tf version @jperez999 (#601)
  • Add a "New Functionality" section to the Roadmap issue template @karlhigley (#596)
  • Don't install faiss with the integration tests @benfred (#591)
  • Install numpy for building faiss @benfred (#590)
  • Fixes for faiss install @benfred (#587)
  • Include a SM80 enabled version of faiss on merlin-base container @benfred (#584)
  • Rearrange testing for faster feedback @jperez999 (#583)
  • Second fix @jperez999 (#582)
  • Update triage github actions workflow @benfred (#580)
  • Fix ci order @jperez999 (#581)
  • Reduce the size of synthetic data used in Criteo test @karlhigley (#579)
  • Fix int test @jperez999 (#578)
  • Fix int + unit tests @jperez999 (#577)
  • Add hadoop envs @EmmaQiaoCh (#565)
  • Add numpy anchor version after all package building and updates @jperez999 (#566)
  • Docker edit @jperez999 (#564)
  • Docker fix @jperez999 (#563)
  • Add skip tf crit unit @jperez999 (#561)
  • Fix unit scaling criteo inference serving @jperez999 (#559)
  • update base dockerfile @benfred (#556)
  • Update the Merlin repos in the CI image build @karlhigley (#558)
  • Remove dependencies of hugectr & install hps tf plugin to merlin-tf @EmmaQiaoCh (#549)
  • Skip the multi-stage example notebook (for now) @karlhigley (#543)
  • Skip multi-stage example integration test (for now) @karlhigley (#541)
  • Revert CMake changes @karlhigley (#538)
  • Install CMake in Merlin base image (instead of copying from build) @karlhigley (#524)
  • Mark "scaling Criteo" notebook to be skipped without TF @karlhigley (#537)
  • install tox in base image @nv-alaiacano (#532)
  • Pin fsspec==22.5.0 directly in the Merlin base image @karlhigley (#533)
  • Remove duplicate CMake installs @karlhigley (#523)
  • Make integration test script executable @karlhigley (#521)
  • Install Feast/Faiss before running Merlin integration tests @karlhigley (#520)
  • Downgrade onnxruntime due to security issue of mpmath @EmmaQiaoCh (#486)
  • Convert the default text in the roadmap issue template to comments @karlhigley (#483)
  • Add tests in the Merlin repo to the CI test scripts @karlhigley (#450)
  • Remove unnecessary dependencies from docs builds @mikemckiernan (#466)
  • Adds integration tests to Merlin Models @gabrielspmoreira (#438)
  • Add wandb @jperez999 (#470)
  • added fiddle to container for models testing @jperez999 (#469)
  • add integration tests @radekosmulski (#310)
  • Refactor the container test script to run all the SW checks, unit tests, or integration tests before failing @karlhigley (#444)
  • Switch over HDFS build/install scripts @bashimao (#434)
  • remove extra CMD from containers @jperez999 (#390)
  • Add pytorch tritonserver backend to ci dockerfile @jperez999 (#441)
  • Add jupyter ENVs in case launching container with normal user @EmmaQiaoCh (#439)
  • remove excess python path setting @jperez999 (#432)
  • Remove stale doc reviews @mikemckiernan (#417)
  • Fix failing treelite install @jperez999 (#416)
  • Add FIL support to Base container, Add e2e support in ci container @jperez999 (#414)
  • Always run NVT integration tests @benfred (#401)
  • Inline hugectr container tests @benfred (#398)
  • Update test_container.sh script @benfred (#396)
  • Restrict tritonclient to 2.22.0 @EmmaQiaoCh (#391)
  • Add sok test new @EmmaQiaoCh (#384)
  • Add skip checks to examples tests @jperez999 (#392)
  • updates from entrypoint and cupy cuda116 @jperez999 (#389)
  • Add matplotlib to torch container @jperez999 (#386)
  • Rm old docker @jperez999 (#383)
  • Add a GA workflow that requires labels on PR's @benfred (#381)
  • Support matrix updates for 22.05 @nvidia-merlin-bot (#352)
  • Support matrix updates for 21.11 @nvidia-merlin-bot (#372)
  • Support matrix updates for 21.09 @nvidia-merlin-bot (#373)
  • Support matrix updates for 22.03 @nvidia-merlin-bot (#368)
  • Support matrix updates for 22.02 @nvidia-merlin-bot (#370)
  • Support matrix updates for 22.01 @nvidia-merlin-bot (#369)
  • Support matrix updates for 21.12 @nvidia-merlin-bot (#371)
  • Refactor SMX for blossom @mikemckiernan (#351)
  • Support matrix updates for 22.04 @nvidia-merlin-bot (#367)
  • Update for hdfs @EmmaQiaoCh (#365)
  • Enable running the SMX data job in Blossom @mikemckiernan (#325)
  • Request that PRs are labeled @mikemckiernan (#327)
  • Also use horovod from DLFW for hugectr training container @benfred (#303)

v22.05

1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/NVIDIA-Merlin/Merlin/compare/v0.7.1...v22.05