Growthbook Versions Save

Open Source Feature Flagging and A/B Testing Platform

v1.1.0

2 years ago

New Features

  • New SDKs (Golang, Android), feature support for existing SDKs (PHP, Python) #226 #230 #231 #256 #258
  • Feature environment toggles (dev/prod) plus API/webhook support #236 #250
  • More intuitive UI for adding feature rules #232 #240 #241 #243
  • Support Mixpanel EU Residency server #228
  • Customize the experiment import lookback period (default 365 days) #238

Bug Fixes

  • React Native support in the React SDK b4d2fe9
  • Detect and auto-fix mismatched variation ids #225 #267
  • For PrestoDB, make password/schema/catalog optional and fix datediff syntax #272
  • Support both TIMESTAMP and DATETIME types for BigQuery #273

Misc

  • Moved complex metric behavior settings behind an "advanced options" dropdown #233
  • Add mixpanel tracking instructions to docs #235
  • Add FAQ and How It Works sections to docs 6ab9ebe #249
  • Remove the "pageviews" data source query #264
  • Design updates #244 #245

v1.0.0

2 years ago

New Features

  • Feature Flags! #161
  • New Chrome devtools extension #207
  • Detect and remove users who were exposed to multiple variations in a single experiment #196
  • My Reports page listing all ad-hoc reports #194
  • Import experiments from a data source without going through settings #208
  • Support custom delimiters for Google Analytics #195
  • Allow custom SSL certs for postgres/redshift #216

Bug Fixes

  • Mixpanel error when mean/stddev returns null instead of 0 6fa5271
  • Incorrect overall number of users on experiment results in some cases 07a90e8
  • Visual editor script error when used within <head> or loaded multiple times c360299 44177f0
  • Incorrect mean for Google Analytics binomial metrics 81b32a8
  • Segment date column not being used in experiment query #212
  • Error message on dashboard for non-admin users #224

Misc

  • Unified SDK test suite #211 #217

v0.9.0

2 years ago

This release includes some huge performance improvements. We cut the number of executed SQL queries in half and the ones that remain are up to 10x more efficient - all automatic without any work on your end.

New Features

  • North Star metrics #105
  • Ad-hoc experiment reports #165
  • Custom metric aggregations #192
  • Ability to update experiment results on a Cron schedule (or disable updates entirely) #188
  • Enable cache for faster experiment queries #179
  • Improve metric query performance, plus support SQL template vars for more advanced optimizations #182 #189

Bug Fixes

  • Invalidate cdn.growthbook.io when an experiment changes in a Cloud account #73
  • Add groups/force to config API endpoint response b659b14
  • Errors when experiment queries don't return results b4f2bd1 edc2316 5975b5c
  • BigQuery syntax error when using regular expressions 0fb524a
  • Fix "=" operator for Mixpanel metric conditions 63cc970
  • Safer archiving and deleting of metrics and segments #172 #133
  • Experiment phase modal breaks for 3+ variations and phases not showing on dashboard correctly d184df5 96ce7b4
  • Percent improvement graphs cut off and have incorrect grid lines #174 #183
  • Could not create presentation when there are no stopped experiments efb1210

Misc

  • Add build number to left nav and API #176
  • When searching for experiments, show the trackingKey in the table #166
  • Switch select boxes to react-select for better searching #180
  • Update dependencies, remove old code #164
  • Add tooltips to "Chance to Win" column in experiment results #190
  • Fix bug in example webhook code in docs related to body-parser #186
  • Sync first name when registering account on GrowthBook Cloud #193

v0.8.0

2 years ago

New Features

  • Mutually exclusive experiments support for JS/React SDKs #121
  • Automatic dimensionality reduction #139
  • Export Jupyter notebooks from dimension breakdown results #148
  • Allow searching experiments by owner name and metrics #142
  • Built-in dimension for activation metric status #138
  • Option to hide partial data from running experiments (i.e. strict conversion windows) #148

Bug Fixes

  • Fix various bugs involving Invalid Date objects 2e860bf 569fd53 #143
  • Some query errors on metric pages were being hidden in the UI f010c3c
  • Edge case when users exist in Mongo, but there are no organizations #134
  • Some metric activity was not being recorded in the audit history #144
  • Google Analytics dates were not being parsed correctly #145
  • minPercentChange setting for metrics was not saving to Mongo properly 04212c6
  • Fixes for config API - include groups for stopped experiments and force variation 0 for non-winning tests #160

Misc

  • UI redesign with new colors, layout, and styles #152 #158
  • Up to 10x faster stats analysis, especially when doing dimension breakdowns #148
  • Removed the need to specify the variation id format (strings vs array indexes) #136
  • Reduced the number of SQL queries run for experiment results and metric analyses #148
  • Fixed typo in metric form #156

v0.7.0

2 years ago

New Features

  • View experiment results over time with the new built-in Date dimension! #122
  • Show full stats when breaking down results by dimension #118
  • Min percent change for a metric to be highlighted green/red in an experiment #110
  • Easily clone/duplicate a metric #129
  • More flexible options to filter specific users out of an experiment analysis #127
  • Add filtering and sorting to the metric and past experiments page #114 #123
  • Ability to delete segments and dimensions #128

Bug Fixes

  • Fix login bug and improve password reset messaging b24f4bd
  • Mixpanel not parsing variation_id correctly #115

Misc

  • Enabled Typescript strictNullChecks setting for back-end #116
  • Reduce CPU usage for stats analysis by limiting the number of parallel Python threads 2bcdb51
  • Improve docs and debugging experience when configuring an email SMTP server #131

v0.6.0

2 years ago

New Features

  • Group ideas and experiments into Projects #57
  • Import/export config.yml #104
  • Metric graph improvements - standard deviation shading, tooltips, day/week granularity, and segment support #95 #96 #102
  • Ability to delete an experiment phase #99

Bug Fixes

  • Only allow a single organization in self-hosted deployments #92
  • Bug when mixing anon/user ids in a single experiment dea12ba
  • Bug when variation ids are left empty #97
  • Mixpanel was only filtering by date part of timestamp and not time #100
  • File upload bug #101
  • Jupyter notebook error when runQuery code contains double quotes 42dce66

Misc

  • Update "Build Your Own" client library docs with latest hashing behavior d5d6ddb
  • Pin Docker base image at python 3.9. The new 3.10 release seems to have bugs with scipy d3ee5be

v0.5.0

2 years ago

New Features

  • :fire: Export experiment results as a Jupyter notebook! #81
  • Per-metric data quality thresholds (min sample size and suspicious uplift percent)
  • SDK Dev Mode now supports both the javascript and react SDKs and can be enabled in staging builds #79
  • Specify the experiment status (running or stopped) when importing past experiments #82
  • View Queries button now shows the exact rows returned from the database before any post-processing #81

Bug Fixes

  • Fix broken number inputs in forms (switch to react-hook-form library) #78
  • Bug in stddev correction for revenue metrics #69
  • Error when sending invite emails to teammates 14cf152
  • Fix division bug for Postgres/Redshift when metric values are integers #69
  • Render modals inside portal to fix z-index issues #77
  • Downgrade Typescript to 4.3.5 to fix ts-server bugs during development #81

Misc

  • Switch docker base image from node-alpine to python-slim
  • GrowthBook stats engine now available as a standalone python package on PyPi: gbstats #81
  • Change name to GrowthBook (no space)
  • Move javascript and react SDKs to this monorepo #79
  • Add video tour link to getting started page 75ef52a
  • Document all data quality checks

v0.4.0

2 years ago

New Features

  • Custom per-metric risk thresholds #53
  • Experiment-level dimensions #65
  • Custom minimum experiment length (in days) when importing past experiments #60
  • Export data sources, metrics, and dimensions from MongoDB to a config.yml file #56
  • Easilly override default SQL queries right after connecting to a data source #55
  • Warn about variation id mismatches in query results #63

Bug Fixes

  • Fix Cannot read property 'forEach' of null when importing past experiments 641565f
  • Error when selecting multiple metrics by tags b4488d4
  • Variation Id input not showing up on edit form 3aa8c01
  • Error when deleting a metric that is being used in an experiment 4368783
  • Update dependencies and fix yarn warnings #48

Misc

  • Better docs for SQL data sources and metrics 67f1ebb

v0.3.0

2 years ago

New Features

  • Configuration via yml files #38
  • Use S3 for file uploads #41
  • Custom metric conversion windows #52
  • Control the automatic experiment refresh frequency 2fa4c0a
  • Option to connect to Postgres and Redshift with SSL 385d300

Bug Fixes

  • Various Clickhouse bugs - date function names, non-equi joins, json response format, stddev function 3644548 0034530
  • Broken yarn install on OSX c71b86a
  • UnhandledPromiseRejectionWarning on failed SQL queries 83219ad
  • Cannot read property '0' of null on experiment results 0ac0fb5
  • Docs typo #51

Misc

  • Document the statistics engine and link to stats whitepaper #39

v0.2.4

2 years ago

Changes

  • New sharing and presentation feature #31
  • Add MySQL and MariaDB data sources #35
  • Switch experiments to use new async query engine #32
  • [bug fix] Fix BigQuery date parsing bug a7efc68
  • [docs] Improve docs on self-hosting and metrics 4a0dfe4