Spago Versions Save

Added

• Various new test cases (improving the coverage).
• nlp.embeddings.syncmap package.
• ml.nn.recurrent.srnn.BiModel which implements a bidirectional variant of the Shuffling Recurrent Neural Networks (SRNN).
• Configurable timeout and request limit to all HTTP and gRPC servers (see also commands help).

Changed

• All CLI commands implementation has been refactored, so that the docker-entrypoint can reuse all other cli.App objects, instead of just running separate executables. By extension, now the Dockerfile builds a single executable file, and the final image is way smaller.
• All dependencies have been upgraded to the latest version.
• Simplify custom error definitions using fmt.Errorf instead of functions from github.com/pkg/errors.
• Custom binary data serialization of matrices and models is now achieved with Go's encoding.gob. Many specific functions and methods are now replaced by fewer and simpler encoding/decoding methods compatible with gob. A list of important related changes follows.
  • utils.kvdb.KeyValueDB is no longer an interface, but a struct which directly implements the former "badger backend".
  • utils.SerializeToFile and utils.DeserializeFromFile now handle generic interface{} objects, instead of values implementing Serializer and Deserializer.
  • mat32 and mat64 custom serialization functions (e.g. MarshalBinarySlice, MarshalBinaryTo, ...) are replaced by implementations of BinaryMarshaler and BinaryUnmarshaler interfaces on Dense and Sparse matrix types.
  • PositionalEncoder.Cache and AxialPositionalEncoder.Cache fields (from ml.encoding.pe package) are now public.
  • All types implementing nn.Model interface are registered for gob serialization (in init functions).
  • embeddings.Model.UsedEmbeddings type is now nlp.embeddings.syncmap.Map.
  • As a consequence, you will have to re-serialize all your models.
• Flair converter now sets the vocabulary directly in the model, instead of creating a separate file.
• sequencelabeler.Model.LoadParams has been renamed to Load.

Removed

• In relation to the aforementioned gob serialization changes:
  • nn.ParamSerializer and related functions
  • nn.ParamsSerializer and related functions
  • utils.Serializer and utils.Deserializer interfaces
  • utils.ReadFull function
• sequencelabeler.Model.LoadVocabulary

Fixed

• docker-entrypoint sub-command hugging-face-importer has been renamed to huggingface-importer, just like the main command itself.
• docker-entrypoint sub-command can be correctly specified without leading ./ or / when run from a Docker container.
• BREAKING: mat32.Matrix serialization has been fixed, now serializing single values to chunks of 4 bytes (instead of 8, like float64). Serialized 32-bit models will now be half the size! Unfortunately you will have to re-serialize your models (sorry!).

Added

• Static analysis job (golint and gocyclo) to Go GitHub workflow.
• You can set a limit for concurrent heavyweight Graph computations (e.g. forward and backward steps) - see ml.ag.ConcurrentComputations() (GraphOption) and ml.ag.Graph.ConcurrentComputations(). If no option is specified, by default the limit is set to runtime.NumCPU().
• You can set a limit for concurrent heavyweight computations of ml.optimizers.gd.GradientDescent (e.g. params update step).
• New package utils.processingqueue.
• mat32 package, which operates on float32 data type.
• It's possible to switch between float32 and float64 as default floating-point data type, using the script change-float-type.sh
• Go GitHub workflow has been adapted to run tests using both float32 and float64 as main floating-point data type.
• This CHANGELOG file.
• Pull and convert Hugging Face models automatically if not found locally when starting BERT or BART server.
• Move content from GitHub Wiki to README in related package folders.

Changed

• ml.ag.ConcurrentComputations (GraphOption) expects the maximum number of concurrent computations handled by heavyweight Graph operations (e.g. forward and backward steps).
• ml.nn.linear.Model and ml.nn.convolution.Model read the concurrent computations limit set on the model's Graph, thus SetConcurrentComputations() methods have been removed.
• mat has been renamed to mat64 and some functions have been renamed.
• The whole project now works with float32 floating-point data type by default, by using the package mat32.
• When imported, the new package mat32 is always aliased as mat. Then, explicit usages of float64 type have been replaced with mat.Float. Moreover, bitsize-specific functions have been made more generic (i.e. operating with mat.Float type) or split into separate implementation, in mat32 and mat64. In this way, switching the whole project between float32 and float64 is just a matter of changing all imports, from mat32 to mat64, or vice-versa (see also the new file change-float-type.sh).
• Update internal links to pre-trained NER models to float32 versions.
• nlp.sequencelabeler.Convert() now loads and converts original Flair models, instead of pre-processed dumps.
• Change command line arguments to make them more consistent; please refer to the help messages of each command.
• Update Dockerfile using a new base building image and adding bart server.

Fixed

• Added dedicated package names to different protocol buffers definition files to avoid name conflicts.

Notable changes:

• Added support for BART model (tested on Natural Language Inference task);
• Added BART API to perform Zero-Shot Text Classification;
• Significant reduction of boilerplate code through the unification of nn.Model and nn.Processor interfaces:
  • there is now a single nn.Model interface that can be reified to become a neural processor. See nn.Reify();
  • there was no compelling reason to have a Forward method in the nn.Model interface so it has been removed, gracefully increasing flexibility in the implementation of a model.