v0.11.4

Bug Fixes 🐞

• Update Maven package to include correct github path (#2073)
• handle long run ids in adb tests (#2102)
• fix small bug in timing logic (#2099)

Build 🏭

• bump ossf/scorecard-action from 2.2.0 to 2.3.0 (#2091)
• bump amannn/action-semantic-pull-request from 5.2.0 to 5.3.0 (#2082)

Documentation 📘

• Update new URL of Recommenders (#2086)

Features 🌈

• add certified event feature categories (#2109)
• Make streaming the default LightGBM data transfer mode (#2088)

Maintenance 🔧

• bump to version 0.11.4 (#2110)
• Update new URL of Recommenders (#2086)
• factor accesstoken runtime-dependency wrapper out (#2097)
• fix cognitive service tests (#2092)
• Scala client for certified events (#2045)
• Update README.md to avoid re-releasing (#2085)

Acknowledgements

We would like to acknowledge the developers and contributors, both internal and external who helped create this version of SynapseML.\n

v0.11.3

Bug Fixes 🐞

• updated gpt-review to version 0.9.5 to fix break (#2069)
• fixed broken link to developer readme (#2049)

Build 🏭

• bump actions/upload-artifact from 3.1.2 to 3.1.3 (#2067)
• bump actions/checkout from 3 to 4 (#2065)

Features 🌈

• support using mwc token for fabric openai transformer (#2070)
• add Azure Cognitive Search vector store (#2041)

Maintenance 🔧

• bump version to v0.11.3(#2084)
• add Esrp release (#2083)
• Add more redirect links to website (#2079)
• refactor telemetry system (#2047)
• Add .trunk to gitignore (#2078)
• fix mlflow error in build (#2077)
• Add missing redirects to website (#2076)
• turn off barrier exec mode in VW generic sample (#2072)
• fix some of the failing build issues (#2071)
• fix daily midnight build chronjob

Acknowledgements

We would like to acknowledge the developers and contributors, both internal and external who helped create this version of SynapseML.\n

Changes:

• 6ac187db38feff9bf455c9ef2b2e6f1b8983b5e7 chore: bump version to v0.11.3(#2084)
• acfc39101cae8f5260da3c4f3dada9dd42901dc0 chore: add Esrp release (#2083)
• eb05959be6901ee21ac2e140f77d238ec98e96a4 fix geospatial tests (#2081)
• b8942a79ef569b027e0ef12b6ccf8a0f58696d87 chore: Add more redirect links to website (#2079)
• b0bac727365dde27de7744969b2cfc94067d71aa chore: refactor telemetry system (#2047)
• f7a0af54eec436c6dc3d4a534e8efcaa17370c29 build: bump actions/upload-artifact from 3.1.2 to 3.1.3 (#2067)
• bef5518a4065f8c26e6837f8e86be06e93d17a87 feat: support using mwc token for fabric openai transformer (#2070)
• e3c48f8210b6efebefc7e68c832afb732872f9ac chore: Add .trunk to gitignore (#2078)
• f2a4047e82f5e060431b5be49a028a4988e1a6e3 chore: fix mlflow error in build (#2077)
• 5a5e84876f6a8fbcf59f080b9be2b3483cbbacb9 chore: Add missing redirects to website (#2076)

See More

• 17fddae285e9d16d902daab09beced9048b732b8 chore: turn off barrier exec mode in VW generic sample (#2072)
• dd7ba7c34c67033335ba1b7aee3459729dec4ad8 chore: fix some of the failing build issues (#2071)
• 3d1a7fc4c4a3e7177f4863c930e4595859bf5413 fix: updated gpt-review to version 0.9.5 to fix break (#2069)
• d494f6e5814eb39233a3eb4f8056eba962bb28f8 feat: add Azure Cognitive Search vector store (#2041)
• 111823d168519c030bc42e4e83250211b7227b3e build: bump actions/checkout from 3 to 4 (#2065)
• 7e9b0d1e3c6fa5e79ed141315f85d4da9b141b7d fix: fixed broken link to developer readme (#2049)
• ebecbe04ee9e1de7b7e9fb4f5955e19852e49373 chore: fix daily midnight build chronjob
• 0836e40efd9c48424e91aa10c8aa3fbf0de39f31 Fix problem with empty partition assigned to validation data (#2059)
• c6d58829435d8e2ab2cdc1cb1b6a9e0c5d4771b2 chore: remove secret scanner (#2048)
• 8f794c896dad5b790356671ac56590fbb4f36eaf feat: Support langchain transformer on fabric (#2036)
• 149c634005a935aef90226bc823c541934245568 docs: add badges to readme
• f6328b5dbe2a0721e12fdacd12a975a9c89c2494 fix: improve docgen (#2043)
• 33807625edcf678461c2916086a63fe91cf045a6 docs: fix small error in docgen docs
• 9eff35f5465269a16f2e936fdc069c6107536805 docs: initial POC of Jessica's fabric doc generator (#2023)
• fa497f09b58a462a4ca47c14cbe4bfd12231f1b2 docs: fix broken links (#2042)
• cde68347a44b6556ed4e6f6ab57bf6b4968cc6b2 fix: Improve LGBM exception and logging (#2037)
• db6386c6d6a133eb55fbec640012ad82bb526c94 fix: Fix ONNX link (#2035)
• 8be8fe3e61837dbe96a28189fd436e0b684f8ed2 docs: fix variable formatting for QandA nb (#2033)
• 072c9c9631d2c8c498677356dd2c152efd3cf51c chore: remove exclusions from pipeline.yml
• 495c9a9f297a31f05645324014e1ae738336d7eb chore: remove build exclusions from pipeline.yaml
• 0d8e613bc6e79f81795ab2b6f7cb9931cf66a864 build: bump actions/checkout from 2 to 3 (#2030)
• 4841ddb70cae5e6b8cf76d77bd2fed9d486b5471 docs: add QandA notebook. (#2029)
• d9b5d03e60f4e40323cace5a947732f43fa4454c docs: fix broken link (#2032)
• df2712afeb211003bd13e622239c9ae09c15615a docs: fix broken links (#2027)
• 81a36bd2457ccca5a526071c1cc7d06cafa7f807 docs: continue fixing broken links (#2026)
• 1c4c5b388edfa9cdffbf2a91fcb893a82e02c561 docs: fix broken links (#2025)
• 1f3a2bf9afcc45153b576eeb86c5d4ccaa92226e docs: add dead link checker (#2022)
• c4d077ad7f97bf5d08f1d329d6e866010c3889d0 chore: bump databricks e2e timeout (#2024)
• 09269384bbabf04d2532534b455263b172d32e9c docs: Refactor docs and docgen framework (#2021)
• ea60f56baf27d30e34e8f9fb7936a0e9227a098e docs: fix docker link (#2019)
• 094c180c3e884cfe9564abbc81986c3ccfb1737b docs: update notebooks - bring back fabric reviewers changes. (#1979)
• 46a56e1c8f9d1ed5e750892dc439964f817755fe docs: add prerequisites - openai and cognitive services resources (#2008)
• 8f79525f047ec19d6baad62a0e7f96cecb94892b build: bump semver from 5.7.1 to 5.7.2 in /website (#2012)
• 25c458223a8369baaaf67313a4d67803d640121b fix: modified the search engine in the demo notebook to bing (#2013)
• f7e8d80a96f12beb3fd1be0bb58590ef3646587c docs: remove pre-commit from docs
• 0c1c84b3bf8fcc3cf4dd079115020200dc94c61f chore: no-op PR to avoid double publishing

This list of changes was auto generated.

What's Changed

• fix: modified the search engine in the demo notebook to bing by @sherylZhaoCode in https://github.com/microsoft/SynapseML/pull/2013
• build: bump semver from 5.7.1 to 5.7.2 in /website by @dependabot in https://github.com/microsoft/SynapseML/pull/2012
• docs: add prerequisites - openai and cognitive services resources by @JessicaXYWang in https://github.com/microsoft/SynapseML/pull/2008
• docs: update notebooks - bring back fabric reviewers changes. by @JessicaXYWang in https://github.com/microsoft/SynapseML/pull/1979
• fix: docker link by @niehaus59 in https://github.com/microsoft/SynapseML/pull/2019
• docs: Refactor docs and docgen framework by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2021
• chore: bump databricks e2e timeout by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2024
• docs: add dead link checker by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2022
• docs: fix broken links by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2025
• docs: continue fixing broken links by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2026
• docs: fix broken links by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2027
• docs: fix broken link by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2032
• docs: add QandA notebook. by @aydan-at-microsoft in https://github.com/microsoft/SynapseML/pull/2029
• build: bump actions/checkout from 2 to 3 by @dependabot in https://github.com/microsoft/SynapseML/pull/2030
• docs: variable formatting for QandA nb by @aydan-at-microsoft in https://github.com/microsoft/SynapseML/pull/2033
• fix: Fix ONNX link by @iemejia in https://github.com/microsoft/SynapseML/pull/2035
• fix: Improve LGBM exception and logging by @svotaw in https://github.com/microsoft/SynapseML/pull/2037
• docs: fix broken links by @JessicaXYWang in https://github.com/microsoft/SynapseML/pull/2042
• docs: initial POC of Jessica's fabric doc generator by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2023
• fix: improve docgen by @eisber in https://github.com/microsoft/SynapseML/pull/2043
• feat: Support langchain transformer on fabric by @lhrotk in https://github.com/microsoft/SynapseML/pull/2036
• chore: remove secret scanner by @mhamilton723 in https://github.com/microsoft/SynapseML/pull/2048
• fix: Fix problem with empty partition assigned to validation data by @svotaw in https://github.com/microsoft/SynapseML/pull/2059
• chore: Adding Spark34 support by @KeerthiYandaOS in https://github.com/microsoft/SynapseML/pull/2052

New Contributors

• @aydan-at-microsoft made their first contribution in https://github.com/microsoft/SynapseML/pull/2029

Full Changelog: https://github.com/microsoft/SynapseML/compare/v0.11.2...v0.11.2-spark3.4

v0.11.2

Bug Fixes 🐞

• make geospatial services robust to 404 thrown by the service (#2007)
• dont retry 4XX codes other than 429 (#2005)
• improve tolerance for error handling (#1991)
• Some tidying and build fixes (#1984)
• fix import error on using the cognitive services on AML spark clusters (#1951)
• Update retry arguments in GeospatialServices - Flooding Risk.ipynb (#1954)
• Update retry arguments in GeospatialServices - Flooding Risk.ipynb (#1954)
• add retries for torchvision download (#1949)

Build 🏭

• upload notebooks to storage on every build (#2001)
• Publishing to ADO Feed (#1995)
• bump ossf/scorecard-action from 2.1.3 to 2.2.0 (#1993)
• Update documentprojection to support manifest files and custom formatters/endpoints (#1976)
• bump microsoft/gpt-review from 0.9.3 to 0.9.4 (#1962)
• bump microsoft/gpt-review from 0.9.2 to 0.9.3 (#1960)
• Added module for generating docs from notebooks (#1911)

Documentation 📘

• Improved LightGBM docs (#2003)
• Add Langchain notebook demo (#2002)
• update website synapse info and fabric installation (#2000)
• update OpenAI notebook for acrolinx (#1999)
• Add new LightGBM streaming docs (#1992)
• Update Vowpal Wabbit - Multi-class classification.ipynb (#1971)
• Update Vowpal Wabbit - Overview.ipynb (#1972)
• Update Vowpal Wabbit - Contextual Bandits.ipynb (#1970)
• Update Vowpal Wabbit - Classification using VW-native Format.ipynb (#1969)
• Update Vowpal Wabbit - Classification using SparkML Vector.ipynb (#1968)
• update spark33 installation instruction readme (#1961)
• remove cell output - sentiment analysis quickstart (#1932)
• improve and organize openai docs (#1937)

Features 🌈

• Reference dataset (#1977)
• Add Langchain Transformation (#1925)
• OrthogonalForestDML (#1873)

Maintenance 🔧

• bump to v0.11.2 (#2011)
• make it so custom versions are possible (#1998)
• fix spark_install for R tests (#1994)
• retry conda install and add a timeout (#1983)
• exclude failing explanation dashboard notebook (#1982)
• fix broken tests (#1981)
• add timeouts for R tests (#1963)
• add internal to find_secret (#1948)
• fix flakiness in spark installation (#1944)
• update R-setup.md docs (#1946)
• Add Azure Open AI based PR Summarization (#1957)
• fix gpu notebook protobuf version (#1959)
• A base scrubber and a "Shared Access Signature" Scrubber (#1939)
• remove old notebooks from website (#1934)
• no-op commit to ensure no double-releasing of library

Performance Improvements 🚀

• Update OpenAI Embedding with latest embedding model (#1938)

Acknowledgements

We would like to acknowledge the developers and contributors, both internal and external who helped create this version of SynapseML.\n