Ragas Versions Save

What's Changed

• docs: Import AnswerSimilarity by @nelsonauner in https://github.com/explodinggradients/ragas/pull/296
• FIx: testset_generator.py by @ferdinandl007 in https://github.com/explodinggradients/ragas/pull/291
• Case-insensitive and whitespace handling for context_precision. by @Pauldevillers in https://github.com/explodinggradients/ragas/pull/297
• Fix/tiny refactor by @Yongtae723 in https://github.com/explodinggradients/ragas/pull/305
• fix: broken link to metrics by @younes-io in https://github.com/explodinggradients/ragas/pull/311
• Convert context_recall to json format by @shahules786 in https://github.com/explodinggradients/ragas/pull/312
• fix: add retry logic for OpenAI and Azure OpenAI by @jjmachan in https://github.com/explodinggradients/ragas/pull/315
• fix: openai env var load after init and before score also by @jjmachan in https://github.com/explodinggradients/ragas/pull/316
• import llama_index gracefully, solves #318 by @ceferisbarov in https://github.com/explodinggradients/ragas/pull/319
• Make testgenerator output compatible with evaluate by @tinomaxthayil in https://github.com/explodinggradients/ragas/pull/302

New Contributors

• @nelsonauner made their first contribution in https://github.com/explodinggradients/ragas/pull/296
• @ferdinandl007 made their first contribution in https://github.com/explodinggradients/ragas/pull/291
• @Pauldevillers made their first contribution in https://github.com/explodinggradients/ragas/pull/297
• @younes-io made their first contribution in https://github.com/explodinggradients/ragas/pull/311
• @ceferisbarov made their first contribution in https://github.com/explodinggradients/ragas/pull/319

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.20...v0.0.21

What's Changed

• docs: update how LLMs are customized in Ragas metrics by @jjmachan in https://github.com/explodinggradients/ragas/pull/219
• fix: Add RagasLLM for customized test set generation by @chankeith96 in https://github.com/explodinggradients/ragas/pull/242
• docs: add import statement in testset generation by @jjmachan in https://github.com/explodinggradients/ragas/pull/249
• expose metrics prompts by renaming metric modules by @grauvictor in https://github.com/explodinggradients/ragas/pull/243
• fix: added support for google vertexAI by @jjmachan in https://github.com/explodinggradients/ragas/pull/252
• Renamed module names and made changes in init to reflect the change by @tinomaxthayil in https://github.com/explodinggradients/ragas/pull/244
• added hint in synthetcic data generation by @tinomaxthayil in https://github.com/explodinggradients/ragas/pull/259
• feat: RagasEmbeddings by @shahules786 in https://github.com/explodinggradients/ragas/pull/232
• Fix: type hints by @shahules786 in https://github.com/explodinggradients/ragas/pull/263
• Update issue templates by @shahules786 in https://github.com/explodinggradients/ragas/pull/265
• Update evaluation.md typo by @whitewum in https://github.com/explodinggradients/ragas/pull/275
• removed ragas score from result object by @tinomaxthayil in https://github.com/explodinggradients/ragas/pull/276
• Custom embeddings from HuggingFace (sentence transformer) do not pass the assertion in src/ragas/metrics/_answer_similarity.py by @alebondarenko in https://github.com/explodinggradients/ragas/pull/277
• fix: set temperate to near zero value by @shahules786 in https://github.com/explodinggradients/ragas/pull/267
• feat: add native support for OpenAI and AzureOpenAI by @jjmachan in https://github.com/explodinggradients/ragas/pull/261
• feat: make ragas pip more lighter by @jjmachan in https://github.com/explodinggradients/ragas/pull/283
• docs: amazon bedrock (#241) by @arm-diaz in https://github.com/explodinggradients/ragas/pull/246
• docs: added vertext ai support by @jjmachan in https://github.com/explodinggradients/ragas/pull/284
• chore: pin OpenAI to >1 by @jjmachan in https://github.com/explodinggradients/ragas/pull/285

New Contributors

• @chankeith96 made their first contribution in https://github.com/explodinggradients/ragas/pull/242
• @grauvictor made their first contribution in https://github.com/explodinggradients/ragas/pull/243
• @tinomaxthayil made their first contribution in https://github.com/explodinggradients/ragas/pull/244
• @whitewum made their first contribution in https://github.com/explodinggradients/ragas/pull/275
• @alebondarenko made their first contribution in https://github.com/explodinggradients/ragas/pull/277

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.19...v0.0.20

What's Changed

• docs: fix typo by @shahules786 in https://github.com/explodinggradients/ragas/pull/214
• feat: context average precision by @shahules786 in https://github.com/explodinggradients/ragas/pull/204
• fix: avoid division by zero by @shahules786 in https://github.com/explodinggradients/ragas/pull/218
• fix: typecast in TestsetGeneration fails for python3.8 by @jjmachan in https://github.com/explodinggradients/ragas/pull/215
• fix: make context_relevancy available by @jjmachan in https://github.com/explodinggradients/ragas/pull/229
• feat: add support for llms on AWS Bedrock (#226) by @arm-diaz in https://github.com/explodinggradients/ragas/pull/227
• tests: for metrics by @jjmachan in https://github.com/explodinggradients/ragas/pull/233
• docs: add context_precision by @shahules786 in https://github.com/explodinggradients/ragas/pull/236
• docs: add langfuse notebook by @jjmachan in https://github.com/explodinggradients/ragas/pull/216
• Fix typos in langfuse.ipynb by @marcklingen in https://github.com/explodinggradients/ragas/pull/237

New Contributors

• @arm-diaz made their first contribution in https://github.com/explodinggradients/ragas/pull/227
• @marcklingen made their first contribution in https://github.com/explodinggradients/ragas/pull/237

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.18...v0.0.19

What's Changed

• fix: use llm from baseclass for metrics by @jjmachan in https://github.com/explodinggradients/ragas/pull/189
• bugfix: context_precision by @shahules786 in https://github.com/explodinggradients/ragas/pull/194
• Fix typos in Eval doc by @mmaysami in https://github.com/explodinggradients/ragas/pull/198
• testset generation : Improvements by @shahules786 in https://github.com/explodinggradients/ragas/pull/195
• feat: langchain documents support for TestsetGenerator by @jjmachan in https://github.com/explodinggradients/ragas/pull/201
• docs: document loaders support by @shahules786 in https://github.com/explodinggradients/ragas/pull/202
• feat: support for multiple n in llms by @jjmachan in https://github.com/explodinggradients/ragas/pull/197
• feat: llamaIndex llm support by @jjmachan in https://github.com/explodinggradients/ragas/pull/205
• Refactor testset_generator.py for newbies to understand easily by @Yongtae723 in https://github.com/explodinggradients/ragas/pull/207
• fix: remove limit on pydantic 2.0 by @jjmachan in https://github.com/explodinggradients/ragas/pull/209

New Contributors

• @mmaysami made their first contribution in https://github.com/explodinggradients/ragas/pull/198

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.17...v0.0.18

What's Changed

• Testset generation: add gaurdrails to chunk filtering by @shahules786 in https://github.com/explodinggradients/ragas/pull/166
• Docs testset generation by @shahules786 in https://github.com/explodinggradients/ragas/pull/165
• don't warn when context_precision is correctly called by @monstertruck in https://github.com/explodinggradients/ragas/pull/168
• fixed chunk validation by @shahules786 in https://github.com/explodinggradients/ragas/pull/169
• doc: init docs.ragas.io by @jjmachan in https://github.com/explodinggradients/ragas/pull/170
• docs: Add references to ragas by @jjmachan in https://github.com/explodinggradients/ragas/pull/171
• Docs: added contents by @shahules786 in https://github.com/explodinggradients/ragas/pull/175
• Answer correctness metrics by @shahules786 in https://github.com/explodinggradients/ragas/pull/161
• added imports to doc by @shahules786 in https://github.com/explodinggradients/ragas/pull/178
• docs: added github and discord links by @jjmachan in https://github.com/explodinggradients/ragas/pull/179
• Fix typos by @pitmonticone in https://github.com/explodinggradients/ragas/pull/180
• docs: add refferences by @jjmachan in https://github.com/explodinggradients/ragas/pull/177
• docs: support notebooks by @jjmachan in https://github.com/explodinggradients/ragas/pull/182
• added emojis to docs by @shahules786 in https://github.com/explodinggradients/ragas/pull/183
• Docs improvements by @shahules786 in https://github.com/explodinggradients/ragas/pull/186
• testset generation: bug fixes by @shahules786 in https://github.com/explodinggradients/ragas/pull/185

New Contributors

• @monstertruck made their first contribution in https://github.com/explodinggradients/ragas/pull/168
• @pitmonticone made their first contribution in https://github.com/explodinggradients/ragas/pull/180

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.16...v0.0.17

What's Changed

• docs: azure openai quickstart by @jjmachan in https://github.com/explodinggradients/ragas/pull/155
• fix: llamaIndex issues by @jjmachan in https://github.com/explodinggradients/ragas/pull/156
• feat: changing context_relevancy to context_precision by @jjmachan in https://github.com/explodinggradients/ragas/pull/157
• Test set generation paradigm by @shahules786 in https://github.com/explodinggradients/ragas/pull/150
• Testset generation: documentation by @shahules786 in https://github.com/explodinggradients/ragas/pull/158

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.15...v0.0.16

What's Changed

• added contact info by @shahules786 in https://github.com/explodinggradients/ragas/pull/142
• Add note about when ground truth labels are required by @tleyden in https://github.com/explodinggradients/ragas/pull/146
• bug fix: embeddings -> embedding by @starrywheat in https://github.com/explodinggradients/ragas/pull/134
• ZeroDivisionError in context_relevance by @DevanshuBrahmbhatt in https://github.com/explodinggradients/ragas/pull/154

New Contributors

• @tleyden made their first contribution in https://github.com/explodinggradients/ragas/pull/146
• @DevanshuBrahmbhatt made their first contribution in https://github.com/explodinggradients/ragas/pull/154

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.14...v0.0.15

What's Changed

• Update README.md by @emilesilvis in https://github.com/explodinggradients/ragas/pull/139
• Fix remap_column_names by @yujonglee in https://github.com/explodinggradients/ragas/pull/140

New Contributors

• @emilesilvis made their first contribution in https://github.com/explodinggradients/ragas/pull/139
• @yujonglee made their first contribution in https://github.com/explodinggradients/ragas/pull/140

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.13...v0.0.14

General bug fixes and reliability improvements

What's Changed

• fix: spelling of context_relevancy by @jjmachan in https://github.com/explodinggradients/ragas/pull/113
• update tutorial notebook by @Yongtae723 in https://github.com/explodinggradients/ragas/pull/125
• Fix/column-map: fix bug in column_map argument of evaluation by @jjmachan in https://github.com/explodinggradients/ragas/pull/121
• Update README with explanation of Ragas metrics by @Yongtae723 in https://github.com/explodinggradients/ragas/pull/124
• Improve metrics by @shahules786 in https://github.com/explodinggradients/ragas/pull/131
• add custom embeddings for answer relevance by @starrywheat in https://github.com/explodinggradients/ragas/pull/123
• fix: remove dependency on protobuff by @jjmachan in https://github.com/explodinggradients/ragas/pull/132
• fix: added support for azure LLM by @jjmachan in https://github.com/explodinggradients/ragas/pull/133
• fix: update quickstart notebook by @jjmachan in https://github.com/explodinggradients/ragas/pull/137
• fix: linting issues by @jjmachan in https://github.com/explodinggradients/ragas/pull/138

New Contributors

• @Yongtae723 made their first contribution in https://github.com/explodinggradients/ragas/pull/125
• @starrywheat made their first contribution in https://github.com/explodinggradients/ragas/pull/123

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.12...v0.0.13

What's Changed

• chore: added note about consultation by @jjmachan in https://github.com/explodinggradients/ragas/pull/98
• llamaIndex: fix the bugs by @jjmachan in https://github.com/explodinggradients/ragas/pull/100
• fix typos by @shahules786 in https://github.com/explodinggradients/ragas/pull/102
• Limit context relevancy to 1 by @shahules786 in https://github.com/explodinggradients/ragas/pull/105
• Improve context relevancy by @shahules786 in https://github.com/explodinggradients/ragas/pull/112

Full Changelog: https://github.com/explodinggradients/ragas/compare/v0.0.11...v0.0.12