Sql Versions Save

Security

• [CVE Patch] Version Bump: SpringFramework and GSON (#1022)

Infrastructure

• Resolve ssri Security Vulnerability (#1084)
• Bump lodash version (#1063)
• Bump jackson-dataformat-cbor version (#1074)

20201-2-3 Version 1.13.0.0

Breaking Changes

• Refine PPL head command syntax (#1022)
• Disable access to the field keyword in the new SQL engine (#1025)

Features

• Added keywords option as alias identifier in SQL parser (#866)
• Support show and describe statement (#907)
• Support cast function in SQL (#926)
• Support NULLS FIRST/LAST ordering for window functions (#929)
• Project operator pushdown (#933)
• add string function RIGHT (#938)
• Add Flow control function IF(expr1, expr2, expr3) (#990)
• Support Struct Data Query in SQL/PPL (#1018)

Enhancements

• Enable new SQL query engine (#989)
• Add metrics for SQL query requests in new engine (#905)
• Enable failed test logging and fix flaky UT (#910)
• Improve logging in new SQL engine (#912)
• Enable date type input in function Count() (#931)
• Use name and alias in JDBC format (#932)
• Throw exception when access unknown field type (#942)
• Fill hyphen strings to workbench table cells that have null and missing values (#944)
• Support aggregate window functions (#946)
• Support filter clause in aggregations (#960)
• Enable sql function ifnull, nullif and isnull (#962)
• Double quoted as string literal instead of identifier (#974)
• [PPL] Support index name with date suffix (#983)
• Support NULL literal as function argument (#985)
• Allow Timestamp/Datetime values to use up to 6 digits of microsecond precision (#988)
• Protect window operator by circuit breaker (#1006)
• Removed stack trace when catches anonymizing data error (#1014)
• Disable access to the field keyword in the new SQL engine (#1025)
• Only keep the first element of multivalue field response (#1026)
• Remove request id in response listener logging (#1027)

Bug Fixes

• Fix round fix issue when input is negative and end with .5 (#914)
• Add fix to handle functions applied to literal (#913)
• Fetch error message in root cause for new default formatter (#1001)
• Fixed interval type null/missing check failure (#1011)
• Fix workbench issue that csv result not written to downloaded file (#1024)

Infrastructure

• Bump ini from 1.3.5 to 1.3.7 in /workbench (#911)
• Backport workbench fixes to 7.9.1 (#937)
• Backport workbench fixes to 7.9 on old platform (#940)
• Backporting latest change from develop to opendistro-1.11 (#945)
• Bump jackson-databind version to 2.10.5.1 (#984)
• Rename sql release artifacts (#1007)
• Rename odbc release artifacts (#1010)
• Rename sql-cli wheel to use dashes instead of underscore (#1015)

Documentation

• Keep development doc sync with latest code (#961)
• Update ODBC documentation (#1012)

Maintenance

• Fix workbench issue in backported 1.11 branch: error message cannot display (#943)
• Fix URI Encoding in 1.12 (#955)

2020-11-20 Version 1.12.0.0

Features

• For ODFE 1.12 change position for sql workbench plugin (remove DEFAULT_APP_CATEGORIES) (#857)
• For ODFE 1.12 change position for sql workbench plugin (#855)
• add support for HH:mm:ss (#850)
• Support NULLS FIRST/LAST in new engine (#843)
• Support subquery in FROM clause in new engine (#822)
• Support CASE clause in new engine (#818)
• Support COUNT star and literal in new engine (#802)
• Adding example of nested() for more complex nested queries (#801)
• Adding example of nested() for more complex nested queries (#799)
• Support HAVING in new SQL engine (#798)
• Add ppl request log (#796)

Enhancements

• Sort field push down (#848)
• Seperate the logical plan optimization rule from core to storage engine (#836)

Bug Fixes

• Fix ExprCollectionValue serialization bug (#859)
• Fix issue: sort order keyword is case sensitive (#853)
• Config the default locale for gradle as en_US (#847)
• Fix bug of nested field format issue in JDBC response (#846)
• Fix symbol error and Fix SSLError when connect es. (#831)
• Bug fix, using Local.Root when format the string in DateTimeFunctionIT (#794)

Infrastructure

• add codecov for sql plugin (#835)
• update odbc workflow (#828)
• Updated workbench snapshots to fix broken workflow (#823)
• Updated Mac version for GitHub action build (#804)
• Fix unstable integration tests (#793)
• Update cypress tests and increase delay time (#792)

Documentation

• Add doc for ODFE SQL demo (#826)
• Update out-of-date documentation (#820)
• Add release notes for ODFE 1.12 (#841)

Maintenance

• SQL release for Elasticsearch 7.10 (#834)
• Migrate Query Workbench to new Platform (#812)
• Migrate Query Workbench to 7.10 (#840)
• Bump version number to 1.12.0.0 for [JDBC, ODBC, SQL-CLI] (#838)

Open Distro for Elasticsearch Version 1.11.0

• Support date and time functions: date_add, date_sub, day, dayname, dayofweek, dayofyear, from_days, hour, microsecond, minute, month, monthname, quarter, second, subdate, time_to_sec, to_days (#746)
• Update index.rst (#756)
• Bug Fix, using matcher to compare the Json result (#762)
• [UI] Separate SQL and PPL pages (#761)
• Support aggregations min, max (#541)
• Support date and time function: week (#757)
• DATE_FORMAT function (#764)
• Add LogicalPlan optimization (#763)
• Bug fix, order by doesn't work when group by field has alias (#766)
• Bug fix, using Local.Root when format the string (#767)
• Add support of basic data types byte, short, binary and add data type testing (#780)
• Restyle workbench SQL/PPL UI (#781)
• Release ODFE 1.11.0 (#785)
• Change SQL plugin version from 1.11.0.1 to 1.11.0.0 (#788)
• Support ORDER BY in new SQL engine (#782)

Enhancements

• Support ranking window functions (#753)
• Support describe index alias (#775)

Bug Fixes

• Fix cast statement in aggregate function return 0 (#773)
• Fix bug, support multiple aggregation (#771)
• Fix unstable integration tests (#793)

Infrastructure

• Enforce 100% branch coverage for sql and es module (#774)

2020-09-28 Version 1.10.1.1

Infrastructure

• Support security plugin (#760)
• Bump to ODFE 1.10.1.1 for integration test fixes (#759)
• Bug Fix, Clean all the indices, included hidden indices (#758)

2020-09-08 Version 1.10.1.0

Features

• Support Top/Rare Command In PPL (#720)
• support Elasticsearch geo_point and ip data type (#719)
• add serialization support for expression (#712)
• Optimize filter expression script (#707)
• Add PPL stats endpoint (#706)
• Support WHERE clause in new SQL parser (#682)
• Add Cypress testing for SQL Workbench (#562)
• Lucene query pushdown optimization (#671)
• ODBC: Add PBIDS support (#676)
• Add PPL enable/disable setting (#681)
• Add query size limit (#679
• Expression pushdown optimization (#663)
• changes required for using to Power BI Service with Open Distro For Elasticsearch (#669)
• Support NULL and MISSING value in response (#667)
• ODBC: Use literals instead of parameters in Power BI data connector (#652)
• Support select fields and alias in new query engine (#636)
• Add comparision operator for SQL (#635)

Enhancements

• Parse backtick strings (``) as identifiers instead of string literals (#678)
• add error details for all server communication errors (#645)

Bug Fixes

• Fixed sql workbench loading issue (#723)
• ODBC: Fix Windows 64-bit workflows (#703)
• Fix for query folding issue while applying filter in PBID (#666)
• Fix for query folding issue with direct query mode in Power BI data connector (#640)

Infrastructure

• Changed rpm and deb artifact name (#705)
• Adjust release drafter to follow ODFE standards (#700)
• ODBC: improve Windows build process (#661)
• Skip doctest in github release actions (#648)

Documentation

• update user documentation for testing odbc driver connection on windows(#722)
• Added workaround for identifiers with special characters in troubleshooting page(#718)
• Update release notes for OD 1.10 release(#699)

Maintenance

• Bumped ES and Kibana versions to v7.9.0 (#697)
• Bump ES and Kibana to 7.9.1 and release ODFE 1.10.1.0 (#732)

Open Distro for Elasticsearch Version 1.9.0

• Add new sql module (PR #527)
• Rename release notes to use 4 digit versions (PR #547)
• Revert changes ahead of develop branch in master (PR #551)
• Bump develop branch to 1.9 and fix all build errors (PR #552)
• Merge develop to master (PR #553)
• Merge all SQL repos and adjust workflows (PR #549)
• Merge develop to master (add all sql related repos) (#549) (PR #554)
• Revert "add date and time support" (PR #567)
• add date and time support (PR #568)
• Add workflow to draft release on push (PR #572)
• Update docs after merging repos (PR #563)
• ODBC: Report error from Excel when executing an invalid query (PR #611)
• ODBC: Adding BASIC & AWS_SIGV4 auth in M Connector (PR #610)
• ODBC: Change Tableau connector version (PR #622)
• ODBC: Fix for data loading failure in Power BI Desktop (PR #627)
• Bump versions to 1.9.0.1 and add release notes (PR #632)
• Merge develop to master for ODFE 1.9.0.1 release (PR #633)
• Fix workflow path (PR #637)
• Merge fixes for github release actions from develop to master (PR #638)

SQL and PPL

• [PPL] Support expression and boolean operators (PR #518)
• [PPL] Add Resource monitor to avoid OOM (PR #533)
• Enforce comparison test in new SQL module (PR #536)
• Support LIKE operator (PR #534)
• Add select expression without query support (PR #542)
• Add plugin setting for new SQL module (PR #544)
• Redefine the Expression interface and Type (PR #550)
• Keep mismatch results when error occurs in comparison test (PR #557)
• Support mathematical functions ceil/ceiling, exp, floor, ln, log (PR #540)
• add date and time support (PR #560)
• Support mathematical functions: conv, crc32, mod, pow/power, round, sign, sqrt, truncate (PR #577)
• Fix object/nested field select issue (PR #584)
• Support SELECT * and FROM clause in new SQL parser (PR #573)
• Using UTC as default timezone for date_format function if not provided (PR #605)
• Fix CAST bool field to integer issue (PR #600)
• Support mathematical functions rand and constants e, pi (PR #591)
• Support trigonometric functions acos, asin, atan, atan2, cos, cot, degrees, radians, sin, tan (PR #599)
• Add ElasticsearchExprValueFactory in StorageEngine (PR #608)
• Issue 623, fix security vulnerability regarding to depedencies common… (PR #624)
• Support queries end with semi colon (PR #609)
• Add Text and Keyword Data Type (PR #620)

SQL ODBC

• Remove columns from result which are not returned by SELECT * query but returned by DESCRIBE query (PR #556)
• ODBC: Build driver files in parallel (PR #570)
• ODBC: Remove catalog support from driver (PR #566)
• ODBC: Add documents for Refresh & Export as CSV files options in Microsoft Excel (PR #571)
• ODBC: Update documentation for using Microsoft Excel with Open Distro For Elasticsearch (PR #576)
• ODBC: Add user documentation for using Microsoft Excel on Mac (PR #594)
• ODBC: add ODBC 2.x functions called by Excel for Mac (PR #592)
• ODBC: Updating Microsoft Excel connection documents (PR #581)
• Extra fixes for Mac ODBC driver (PR #602)
• ODBC: Adding Power BI M connector (PR #596)
• ODBC: adding manual test plan for Microsoft Excel testing (PR #604)

SQL Workbench

• Bumped lodash version to fix dependency security vulnerability (PR #598)
• Move workbench down in kibana nav (PR #578)

Enhancements

• Enforce comparison test in new SQL module (PR #536)
• Add select expression without query support (PR #542)
• Add plugin setting for new SQL module (PR #544)
• Keep mismatch results when error occurs in comparison test (PR #557)
• Support queries end with semi colon (PR #609)

Bug Fixes

• Keep mismatch results when error occurs in comparison test (PR #557)
• Fix object/nested field select issue (PR #584)
• Using UTC as default timezone for date_format function if not provided (PR #605)
• Fix CAST bool field to integer issue (PR #600)

Features

Elasticsearch Compatibility

• Feature #532: Elasticsearch 7.8.0 compatibility (issue: #531)

Documentation

• Feature #486: Add Github badges to README

Enhancements

SQL Features

• Feature #473: Support Integration Tests for Security enabled ODFE cluster

Bugfixes

• Bugfix #489: Fix ANTLR grammar for negative integer and floating point number (issue: #488)
• Bugfix #522: Bug fix, support long type for aggregation (issue: #521)

Features

Elasticsearch Compatibility

• Feature #467: Elasticsearch 7.7.0 compatibility

Enhancements

SQL Features

• Enhancement #470: Add the field type conflict check in semantic check (issue: #348)

Bugfixes

• Bugfix #462: Correct the column when SELECT function as field (issue: #461)