Zama Ai Concrete Versions Save

Concrete: TFHE Compiler that converts python programs into FHE equivalent

v2.6.0

1 month ago

Summary

Concrete v2.6 introduces support of faster operators (approximate rounding, ternary operator, relu and sign), compression features, extended support of function composition, and as well bug fixes.

What's Changed

New features

feat(frontend-python): Introduces fhe.identity and fix scalar squeeze by @umut-sahin in https://github.com/zama-ai/concrete/pull/696
feat(frontend-python): Additional Pre and Post Processors by @umut-sahin in https://github.com/zama-ai/concrete/pull/721, https://github.com/zama-ai/concrete/pull/727
feat(frontend-python): approximate for round_bit_pattern by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/710
feat(compiler): support multi-circuit compilation by @aPere3 in https://github.com/zama-ai/concrete/pull/705
feat(frontend-python): Beta version of multi circuits by @aPere3 in https://github.com/zama-ai/concrete/pull/724
feat(frontend-python): random inputset generator by @umut-sahin in https://github.com/zama-ai/concrete/pull/730

Improvements

refactor(compiler): Re-implement multi-parameter parametrization pass using type inference, can fix segfault or accuracy issue in dag-multi optimization by @andidr in https://github.com/zama-ai/concrete/pull/674, https://github.com/zama-ai/concrete/pull/702
feat(compiler): Fuse table lookups to optimize dag with sequences of TLUs by @umut-sahin in https://github.com/zama-ai/concrete/pull/709, https://github.com/zama-ai/concrete/pull/749
feat(compiler): Upgrade HPX library version to 1.9.1. by @antoniupop in https://github.com/zama-ai/concrete/pull/718, https://github.com/zama-ai/concrete/pull/719
feat(compiler): Distributed execution, on-demand key transfer to remote notes by @antoniupop in https://github.com/zama-ai/concrete/pull/720
feat(compiler): Parallel decompression of evaluation keys by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/736
fix(compiler): Speedup simulation by not reinstantiate csprng each time in the simulation by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/744
feat(frontend): Optimize TLU based on bounds instead of bitwidth by @umut-sahin in https://github.com/zama-ai/concrete/pull/733
feat(compiler): Remove p+1 requirement for clear values for tighter optimization by @umut-sahin in https://github.com/zama-ai/concrete/pull/752, https://github.com/zama-ai/concrete/pull/761
docs(frontend): Add a tutorial about XOR distance by @bcm-at-zama in https://github.com/zama-ai/concrete/pull/714
docs(frontend): Improve documentation by @bcm-at-zama, @yuxizama, @RafLaf in https://github.com/zama-ai/concrete/pull/723, https://github.com/zama-ai/concrete/pull/725, https://github.com/zama-ai/concrete/pull/735, https://github.com/zama-ai/concrete/pull/738, https://github.com/zama-ai/concrete/pull/728, https://github.com/zama-ai/concrete/pull/747, https://github.com/zama-ai/concrete/pull/742, https://github.com/zama-ai/concrete/pull/763, https://github.com/zama-ai/concrete/pull/700, https://github.com/zama-ai/concrete/pull/746

Fixes

fix(compiler): fix mac arm exception propagation by @aPere3 in https://github.com/zama-ai/concrete/pull/697
fix(compiler): fix double free on aliased outputs by @aPere3 in https://github.com/zama-ai/concrete/pull/711
fix(compiler): Guard decompression of seeded keys by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/691
fix(compiler): Do not omit assignment of optimizer ID to FHE.reinterpret_precision by @andidr in https://github.com/zama-ai/concrete/pull/729
fix(compiler): Preserve explicit optimizer partition frontiers for TFHE circuit parametrization by @andidr in
fix(compiler): Handle tensor.empty in the pass that lower tfhe to the simulation code by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/760
fix(frontend-python): Keep negative values inside tlus as is. by @umut-sahin in https://github.com/zama-ai/concrete/pull/765
fix(frontend-python): round_bit_pattern, prevent exactness argument misuse by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/759

Other changes

chore(ci): Fixing and improving CI by @umut-sahin, @BourgerieQuentin, @rudy-6-4 in https://github.com/zama-ai/concrete/pull/698, https://github.com/zama-ai/concrete/pull/706, https://github.com/zama-ai/concrete/pull/713, https://github.com/zama-ai/concrete/pull/712, https://github.com/zama-ai/concrete/pull/715, https://github.com/zama-ai/concrete/pull/739, https://github.com/zama-ai/concrete/pull/716, https://github.com/zama-ai/concrete/pull/717, https://github.com/zama-ai/concrete/pull/743, https://github.com/zama-ai/concrete/pull/754
chore(frontend-python): converter, getattr call with default by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/688
feat(optimizer): accept high precision weight by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/687
fix(frontend-python): failure to display invalid input set value by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/682
chore(frontend-python): Improve bitwise tests coverage by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/680
feat(compiler): Add support for tiling of linalg.generic operations by @andidr in https://github.com/zama-ai/concrete/pull/609
chore(ci): Distributed CI by @antoniupop in https://github.com/zama-ai/concrete/pull/740
chore(ci): bump tj-actions/changed-files from 41 to 43 by @dependabot in https://github.com/zama-ai/concrete/pull/751

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.5.1...v2.6.0-rc2

Resources

Documentation:
Blog Post:
- Concrete v2.6: Approximate PBS, Input Compression, Extended Composable Functions, Speed mprovements

v2.5.0

3 months ago

New features

Support for multiple outputs for circuits (return x, y, z)
Support for composition
Truncation operator (documentation)
Bit extraction operator (documentation)
Min/Max operators (documentation)

Refactors

TFHE-rs integration
HPX integration

Bug fixes

Memory usage of table generation is improved

Commit log

Fix/compiler optimizer bad signed dot by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/578
fix(optimizer): multi-parameters, shorter_dump for the compiler --dis… by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/579
docs: adding a Game of Life example by @bcm-at-zama in https://github.com/zama-ai/concrete/pull/569
fix(optimizer): multi-parameters, DEBUG, display reason for lower bound by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/583
feat(optimizer): multi-parameters, direct variance and cost operation… by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/581
woppbs simulation by @youben11 in https://github.com/zama-ai/concrete/pull/580
refactor(frontend-python): reduce memory usage for table construction of non-multi table lookups by @umut-sahin in https://github.com/zama-ai/concrete/pull/584
Docs: Statistics by @umut-sahin in https://github.com/zama-ai/concrete/pull/586
fix(backend): fix boolean rounding in woppbs simulation by @youben11 in https://github.com/zama-ai/concrete/pull/589
Support linalg.generic in the MANP analysis by @youben11 in https://github.com/zama-ai/concrete/pull/571
feat(frontend-python): implement dumping/loading of auto rounders by @umut-sahin in https://github.com/zama-ai/concrete/pull/596
docs(frontend): add FHE workarounds by @aquint-zama in https://github.com/zama-ai/concrete/pull/588
Fix: Key Value Database Example by @umut-sahin in https://github.com/zama-ai/concrete/pull/599
fix(frontend-python): convert rounding to tlu when necessary by @umut-sahin in https://github.com/zama-ai/concrete/pull/595
chore(frontend-python): push docker images on releases by @umut-sahin in https://github.com/zama-ai/concrete/pull/597
chore(ci): add markdown link check by @aquint-zama in https://github.com/zama-ai/concrete/pull/398
chore(ci): markdown link check by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/600
chore(deps): bump actions/checkout from 2 to 4 by @dependabot in https://github.com/zama-ai/concrete/pull/559
feat(frontend-python): create multivariate extension by @umut-sahin in https://github.com/zama-ai/concrete/pull/594
feat(optimizer): multi-parameters, variance and cost value and coeffi… by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/585
fix(concrete-cpu): fix rust lint error by @aPere3 in https://github.com/zama-ai/concrete/pull/602
fix(front-end-python): ci, duplicated shared lib by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/604
Integrates concrete-protocol in compiler and client/server lib by @aPere3 in https://github.com/zama-ai/concrete/pull/493
test(frontend-python): add tests of assigning circuit.keys by @umut-sahin in https://github.com/zama-ai/concrete/pull/610
feat(compiler): Support multi-output by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/470
fix(compiler): Force linking of libomp with libstdc++ in debug builds by @andidr in https://github.com/zama-ai/concrete/pull/615
Feat: np.minimum & np.maximum by @umut-sahin in https://github.com/zama-ai/concrete/pull/613
test(compiler): Add retry for fixing some flaky tests by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/611
refactor(frontend/python): improve basic implementation of game of life example by @umut-sahin in https://github.com/zama-ai/concrete/pull/617
fix noise in woppbs by @samcrx in https://github.com/zama-ai/concrete/pull/592
test(frontend/python): use hinting instead of multiple outputs to test semi-optimized min/max by @umut-sahin in https://github.com/zama-ai/concrete/pull/620
feat(frontend/python): process graph in place before MLIR conversion by @umut-sahin in https://github.com/zama-ai/concrete/pull/619
fix(frontend-python): hint correct node when it's used after assignment by @umut-sahin in https://github.com/zama-ai/concrete/pull/622
fix(compiler): print parameters correctly in the bindings by @umut-sahin in https://github.com/zama-ai/concrete/pull/623
feat(frontend-python): make it possible to query maximum bit-width of… by @umut-sahin in https://github.com/zama-ai/concrete/pull/624
chore(ci): Update m6i to m7i by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/625
chore(frontend-python): typo in fhe_basics.md by @bcm-at-zama in https://github.com/zama-ai/concrete/pull/626
Feat/new ops compiler by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/614
fix(frontend-python): assigning signed values to unsigned tensors by @umut-sahin in https://github.com/zama-ai/concrete/pull/627
feat(frontend-python): add truncate bit pattern extension by @umut-sahin in https://github.com/zama-ai/concrete/pull/628
chore(compiler): fix capnp build step requiring network by @aPere3 in https://github.com/zama-ai/concrete/pull/631
Main bench fix by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/634
fix(frontend-python): use more strict inputset to fix a flanky test by @umut-sahin in https://github.com/zama-ai/concrete/pull/636
chore(compiler): fix broken retry for flaky tests by @aPere3 in https://github.com/zama-ai/concrete/pull/632
feat(frontend-python): fancy indexing by @umut-sahin in https://github.com/zama-ai/concrete/pull/640
docs(compiler): update the readme by @bcm-at-zama in https://github.com/zama-ai/concrete/pull/641
feat(compiler): Input compression bis by @mkmks in https://github.com/zama-ai/concrete/pull/605
Feat: Bit Extraction by @umut-sahin in https://github.com/zama-ai/concrete/pull/635
feat(frontend-python): printing assignment by @umut-sahin in https://github.com/zama-ai/concrete/pull/643
fix(frontend-python): generate correct MLIR for signed integer rounding to 1-bit by @umut-sahin in https://github.com/zama-ai/concrete/pull/644
chore(deps): bump rustix from 0.37.21 to 0.37.27 in /compilers/concrete-optimizer by @dependabot in https://github.com/zama-ai/concrete/pull/645
chore(deps): bump rustix from 0.37.21 to 0.37.27 in /backends/concrete-cpu/noise-model by @dependabot in https://github.com/zama-ai/concrete/pull/646
chore(deps): bump rustix from 0.37.21 to 0.37.27 in /backends/concrete-cpu/implementation by @dependabot in https://github.com/zama-ai/concrete/pull/648
chore(ci): bump actions/setup-python from 4 to 5 by @dependabot in https://github.com/zama-ai/concrete/pull/630
chore(ci): bump actions/download-artifact from 3 to 4 by @dependabot in https://github.com/zama-ai/concrete/pull/637
chore(ci): bump actions/upload-artifact from 3 to 4 by @dependabot in https://github.com/zama-ai/concrete/pull/638
chore(ci): bump dawidd6/action-download-artifact from 2 to 3 by @dependabot in https://github.com/zama-ai/concrete/pull/639
chore(ci): bump tj-actions/changed-files from 32 to 41 by @dependabot in https://github.com/zama-ai/concrete/pull/649
Fix flaky python test by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/651
fix(backend/cpu): Fix the size of the expanded lut in woppbs case of … by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/650
chore(backend/frontend): Fixing formatting... by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/652
feat(frontend-python): activate local env using make by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/647
chore(concrete_cpu): fix nightly feature which was not forwarded to TFHE-rs by @IceTDrinker in https://github.com/zama-ai/concrete/pull/654
feat(optimizer): add support for weak function composition by @aPere3 in https://github.com/zama-ai/concrete/pull/629
Support for [Multi-]GPU in CP by @antoniupop in https://github.com/zama-ai/concrete/pull/544
Antoniu/fix distributed by @antoniupop in https://github.com/zama-ai/concrete/pull/633
chore: using fhe.bits() feature in Game of Life example by @bcm-at-zama in https://github.com/zama-ai/concrete/pull/655
fix(optimizer): accept composable for v0-no-dag and woppbs by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/660
fix(frontend-python): some tests are broken due to compiler bug by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/618
fix(frontend-python): ensure shift strategies coverage by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/658
refactor(compiler/frontend): Rename option to compress_evaluation_keys by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/659
fix(compiler/benchmark): Use default compiler options for default com… by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/661
docs(compiler): fix readme by @aquint-zama in https://github.com/zama-ai/concrete/pull/662

New Contributors

@dependabot made their first contribution in https://github.com/zama-ai/concrete/pull/559

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.4.0...v2.5.0

v2.4.0

7 months ago

What's Changed

feat: Multi Precision Bitwise by @umut-sahin in https://github.com/zama-ai/concrete/pull/558
feat(frontend-python): support dynamic table lookups by @umut-sahin in https://github.com/zama-ai/concrete/pull/566
feat: various performance improvements up to 5x in some cases
docs(frontend-python): update outdated warning in simulation docs by @umut-sahin in https://github.com/zama-ai/concrete/pull/565
fix: Uncaught error on building statistics make the compilation crash by @umut-sahin in https://github.com/zama-ai/concrete/pull/568

Internal

feat/optimizer/key sharing by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/555
chore(frontend-python): remove optimization goal from z3 by @umut-sahin in https://github.com/zama-ai/concrete/pull/567
feat(compiler): adds support for dynamic luts in fhelinalg by @aPere3 in https://github.com/zama-ai/concrete/pull/563
chore(ci): Tag nightly on the public githut repository by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/543
fix(frontend-python): update bad static indexing tests to use a constant inputset for consistent errors by @umut-sahin in https://github.com/zama-ai/concrete/pull/576
fix(frontend-python): Makefile, default value for COMPILER_BUILD_DIRE… by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/573
fix(frontend-python): Makefile, portability 'source' by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/572

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.3.0...v2.4.0

v2.3.0

8 months ago

What's Changed

feat(frontend-python): Introduce fhe.hint to allows the end user to specify the operation bit width by @umut-sahin in https://github.com/zama-ai/concrete/pull/542
feat(frontend-python): Improve performance on comparison operators by using multi-precision by @umut-sahin in https://github.com/zama-ai/concrete/pull/549
docs(frontend-python): Improve comparisons tutorial by @umut-sahin in https://github.com/zama-ai/concrete/pull/556
feat(compiler): Add to the compiler feedback the estimated memory footprint per location by @youben11 in https://github.com/zama-ai/concrete/pull/538
feat(compiler): Expose more compilation options to the python bindings by @youben11 in https://github.com/zama-ai/concrete/pull/552
feat(optimizer): Improve optimization of levelled only circuit by removing the power of two constraint on lwe size by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/541
fix(compiler): Fixing the lowering of fhe.zero to tfhe with crt encoding by @youben11 in https://github.com/zama-ai/concrete/pull/548
fix(optimizer): Fixing woppbs cost model by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/540
fix(compiler): Disable high error warning when an explicit global_p_error is set by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/511
fix(compiler): do not optimize llvm twice by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/502
feat(compiler): Allow arbitrary integer bit width of the apply lookup table operator by @aPere3 in https://github.com/zama-ai/concrete/pull/554

Internal

feat(concrete-cuda): Add multiplication of radix encoded integers by @bbarbakadze in https://github.com/zama-ai/concrete/pull/547
refactor(compiler): clean statistic passes by @youben11 in https://github.com/zama-ai/concrete/pull/551
chore(compiler/benchmark): Activate levelled + cifar-16 benchmark by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/553
fix(compiler): ci, format_cpp.sh, bug + better message by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/557
fix(compiler): Use FHE.zero_tensor instead of bufferization.alloc_ten… by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/561
refactor(compiler): Interfaces to generalize noise calculation in FHE/FHELinalg ops by @mkmks in https://github.com/zama-ai/concrete/pull/416

New Contributors

@mkmks made their first contribution in https://github.com/zama-ai/concrete/pull/416

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.2.0...v2.3.0

v2.2.0

8 months ago

What's Changed

Features

feat(frontend-python): Support of len by @umut-sahin in https://github.com/zama-ai/concrete/pull/534
feat(frontend-python/compiler): Enable multi precision for encrypted multiplication in order to have a finer optimization in multi parameters by @umut-sahin in https://github.com/zama-ai/concrete/pull/535
feat(frontend-python): Enable multi precision and multi parameters by default by @umut-sahin in https://github.com/zama-ai/concrete/pull/483

Internal changes

test: Add a workflow to validate Concrete using Concrete ML tests https://github.com/zama-ai/concrete/pull/531@RomanBredehoft in https://github.com/zama-ai/concrete/pull/537 https://github.com/zama-ai/concrete/pull/539
chore(optimizer): Update for nightly rust linting by @rudy-6-4 in https://github.com/zama-ai/concrete/pull/533
test(frontend-python): Remove the high p_error in graph evaluation tests to avoid Concrete Python flaky tests by @BourgerieQuentin in https://github.com/zama-ai/concrete/pull/532
chore(backend-gpu): changes the mutability of cuda streams in the rust api by @pdroalves in https://github.com/zama-ai/concrete/pull/536

New Contributors

@RomanBredehoft made their first contribution in https://github.com/zama-ai/concrete/pull/537

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.1.0...v2.2.0

v2.1.0

9 months ago

Summary

Concrete v2.1.0 brings some important fixes, along with a couple of features improving its usability

Features

Report Python line causing compilation erros https://github.com/zama-ai/concrete/pull/509 https://github.com/zama-ai/concrete/pull/514
New options to enable verbose/debug mode in the Compiler https://github.com/zama-ai/concrete/pull/525
Statistics about the compiled circuit https://github.com/zama-ai/concrete/pull/526

Fixes

Simulation when using simple assignment https://github.com/zama-ai/concrete/pull/516
Simulation when using multi parameters https://github.com/zama-ai/concrete/pull/518
Compilation of full encrypted dot and matmul operators in multi parameters https://github.com/zama-ai/concrete/pull/522

Full Changelog: https://github.com/zama-ai/concrete/compare/v2.0.0...v2.1.0

v2.0.0

9 months ago

Summary

Concrete v2.0.0 brings significant enhancements and new features, along with a few minor yet essential changes

:warning: BREAKING :warning: to upgrade from concrete-python v1 to v2 please see the Upgrading notes.

Features

More accurate simulation
Separate arguments
Multi parameters optimization
Rounding operator
Progressbar

You can read more about it in the release blog post

v1.0.0

1 year ago

Summary

First public release of Concrete TFHE Compiler.

:warning: BREAKING :warning: All versions prior to v1 refers to the Rust implementation of TFHE, now available in TFHE-rs. For users of concrete-numpy see the Upgrading notes to see how you should update your code to make it work with concrete-python.

Links

Docker Image: zamafhe/concrete-python:v1.0.0 PyPI Package: https://pypi.org/project/concrete-python/1.0.0/

v1.0.0

(compared to concrete-numpy v0.11.1)

Breaking Changes

Python 3.7 support is dropped
concrete.numpy namespace is renamed to concrete.fhe
concrete.onnx namespace is moved to concrete.fhe
Virtual option is removed, all circuits must be compiled now, and then they can be simulated without encryption using the simulate method.
Dataflow parallelization is disabled by default as it’s not available on macOS yet. You can manually enable it using dataflow_parallelize=True configuration option on Linux.

Feature

Native Apple Silicon support
Explicit Key Management interface
Branching Detection Mechanism for good error messages instead of unexpected execution
Ciphertext Multiplication
Maximum Pooling

Fixes

(De)serialization of PublicArgs for some big bit-width circuits is fixed
Crash on macOS is fixed

concrete-boolean-0.2.0

1 year ago

Added

Support for accelerating the bootstrap via GPU (cuda).

Changed

Replaced fftw with concrete-fft
Updated concrete-core dependency to 1.0.0

concrete-integer-0.1.0

1 year ago

Added

Crt functions (sub, neg, scalar_add, scalar_sub, scalar_mul)
Parallelized Crt functions (_parallelized function of ServerKey)
Parallelized Radix functions (_parallelized function of ServerKey)
Initial support for aarch64 (requires nightly)
Look Up Table (LUT) generation and evaluation via WoP-PBS for all supported representations

Changed

Replaced fftw with concrete-fft
Improved API (Breaking changes):
- Split the Ciphertext struct into two structs RadixCiphertext and CrtCiphertex.
- Added RadixClientKey and CrtClientKey (The more general ClientKey still exist)

Removed

TreePBS related functions and structures.