Oodles Versions Save

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

v0.7.0

3 weeks ago

What's Changed

Change default evaluation model to gpt-3.5-turbo by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/685
Link fixes in llamaindex by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/687
frontend changes by @sanchitadev in https://github.com/uptrain-ai/uptrain/pull/689
update new APIs for new backend by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/688

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.13...v0.7.0

v0.6.13

4 weeks ago

What's Changed

Add Multi-Query Accuracy docs and improve Sub-Query Completeness docs by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/676
Fix Guideline Adherence by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/677
Update Guideline Adherence Test by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/678
Api client modify by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/679
update frontend code by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/680
Embedding Operator Tutorial by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/584
add question_completeness eval by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/681
Assistants Evaluation by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/675
Improve Language critique operator by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/683
Update Response Matching Operator by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/684

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.12...v0.6.13

v0.6.12

1 month ago

What's Changed

Milvus Integration Cookbook by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/668
Updated dashboard positioning in docs by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/669
Add query rewrite operator by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/670
Create MultiQueryAccuracy operator by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/671
Add open source prompt for query rewrite by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/672
Add support for vllm by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/673
v0.6.12 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/674

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.10.post1...v0.6.12

v0.6.10.post1

1 month ago

What's Changed

Add Custom Eval to docs by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/662
Remove TransformOp from Custom Evals by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/663
Promptfoo view function better handling by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/653
Add links to llamaindex callback handler docs and Daily Monitoring to README by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/664
Add support for local evaluation in CustomPromptEval by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/666
Remove OpenAI API key requirement from custom evals by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/665

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.9...v0.6.10.post1

v0.6.9

1 month ago

What's Changed

Change json.loads to parse_json by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/647
Make output of response consistency consistent by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/648
Change demo video by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/649
Update pyproject.toml by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/650
Readme Changes: Buttons by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/651
Custom python func by @sourabhagr in https://github.com/uptrain-ai/uptrain/pull/655
Add support for ColumnOp in EvalLLM by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/657
Added openai api key validation by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/659
Add pandas data handling by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/652
Create Tutorial for Custom Eval by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/658
Add badges to README by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/660
Fixes: Factual Accuracy and Response Completeness Tests and Add json5 to dependencies by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/661

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.8...v0.6.9

v0.6.8

1 month ago

What's Changed

RCA tutorial improvements by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/608
Integration to support ollama for evaluations by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/623
Fix docs by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/622
added experiment on gemma vs gpt by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/618
Ollama integration by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/626
Cookbook for Helicone by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/625
Update frontend code by @sanchitadev in https://github.com/uptrain-ai/uptrain/pull/627
Support CLASSIFY eval type for Response Consistency eval by @Abhiramkns in https://github.com/uptrain-ai/uptrain/pull/583
Update dependencies by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/629
improved tutorial on rca by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/628
Remove old docs pages and fix broken links by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/630
Rearrange and update integrations by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/634
Added Promptfoo by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/636
Improve README and update RCA tutorial by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/637
Update README.md by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/638
Re-order Key Features in README by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/639
Promptfoo Integration Updates by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/640
Update quickstart.mdx by @msalhab96 in https://github.com/uptrain-ai/uptrain/pull/642
Frontend changes mar by @sanchitadev in https://github.com/uptrain-ai/uptrain/pull/643
Improve llm output parsing and factual accuracy prompts by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/645
v0.6.8 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/646

New Contributors

@msalhab96 made their first contribution in https://github.com/uptrain-ai/uptrain/pull/642

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.7.post1...v0.6.8

v0.6.7.post1

1 month ago

What's Changed

Added a cookbook on rag using mistral by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/596
updated docs for rca by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/598
Compare Claude-3 vs. GPT-4 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/590
Update CONTRIBUTING.md by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/606
Update pyproject.toml by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/609
Langfuse integration by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/588
Fix Code Hallucination and Response Matching by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/613
Experiment tutorial improvements + Response matching (include context) by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/610
Pydantic Fix: Change deprecated function by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/614
update pyproject.toml by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/616
Experiments: Handling duplicates in data by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/617
promptfoo integration by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/587
Readme fixes by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/593
Remove v0 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/612
Clean docs by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/611
Delete .github/workflows/deploy-api-docs.yml by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/619

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.6.post3...v0.6.7.post1

v0.6.7

1 month ago

What's Changed

Added a cookbook on rag using mistral by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/596
updated docs for rca by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/598
Compare Claude-3 vs. GPT-4 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/590
Update CONTRIBUTING.md by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/606
Update pyproject.toml by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/609
Langfuse integration by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/588
Fix Code Hallucination and Response Matching by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/613
Experiment tutorial improvements + Response matching (include context) by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/610
Pydantic Fix: Change deprecated function by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/614
update pyproject.toml by @ashish-1600 in https://github.com/uptrain-ai/uptrain/pull/616
Experiments: Handling duplicates in data by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/617
promptfoo integration by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/587
Readme fixes by @shrjain1312 in https://github.com/uptrain-ai/uptrain/pull/593
Remove v0 by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/612
Clean docs by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/611
Delete .github/workflows/deploy-api-docs.yml by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/619

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.6.post3...v0.6.7

v0.6.6.post3

2 months ago

What's Changed

Docs: improve langfuse introduction by @clemra in https://github.com/uptrain-ai/uptrain/pull/595
Disable Next.js telemetry in compose by default by @TensorTemplar in https://github.com/uptrain-ai/uptrain/pull/597
Fix fsspec import error by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/603

New Contributors

@clemra made their first contribution in https://github.com/uptrain-ai/uptrain/pull/595
@TensorTemplar made their first contribution in https://github.com/uptrain-ai/uptrain/pull/597

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.6.post2...v0.6.6.post3

v0.6.6.post2

2 months ago

What's Changed

Fix pydantic issues by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/591
Update UpTrain version by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/592
Add type annotation to Table Operator by @Dominastorm in https://github.com/uptrain-ai/uptrain/pull/594

Full Changelog: https://github.com/uptrain-ai/uptrain/compare/v0.6.6.post1...v0.6.6.post2