Change Log

version : v0.3.0

change things

Bug Fixes

• When using NAS, the default list_objects function has been modified to have the same output as minio's list_objects function.
  • Todo : When prefix is the file name including slash and recursive option is True, output is different from minio.
  • https://github.com/graykode/matorage/blob/master/tests/test_nas.py#L94
• Add unittests for NAS.
  • Add data saver and data loader for NAS.
  • Add model saver and model loader for NAS.
  • Add optimizer saver and optimizer loader for NAS.
• Fixed deadlock(join in multiprocessing) when model is reloaded in tensorflow. This bug created a timeout error in travis ci.
• Fixed an error when an empty string entered in the group in tensorflow optimizer.
• Split downloaded data cache folder with ~/.matorage(default cache_folder_path).
• Fixed unittest nas folder permission in .travis.
• Fixed group type from int to str, so tensorflow and torch are working fine.
• Fixed cache_folder_path not in DataS3Test.
• Fixed unittest main function to be right.
• Split test_datasaver_filetype to torch and tensorflow.

New Features

• Add context manager for DataSaver #24.

New Examples

Change Log

version : v0.2.1

change things

Bug Fixes

• Fixed raise error when filetype is False but trying to store string type matrix(issue #17)
• Fixed itemsize also save to json file(issue #18)
• Fixed the list_object function overridden in NAS(issue #21,#22)
• Fixed not use caching when using NAS(issue #21,#22)
• Fixed FileNotFoundError when use put_object function in NAS.

New Features

New Examples

Change Log

version : v0.2.0

change things

Bug Fixes

• Docker container bug in travis.
• Group named 0 error in the optimizer.
• The problem that the dataset name is not sorted when loading.
• Unable to read metadata.json file in the bucket.
• The problem of reading filetype as well as HDF5.

New Features

• Compatible S3 module.
• saving and loading logic for dataset of filetype
• refresh argument in DataSaver to clean all dataset.
• saving and loading logic for scheduler.
• Showing bucket list for dataset, model and optimizer.

New Examples

• Add SQuAD 1.1/2.0 tasks

Hello, matorage!

• Initial release, We support manage dataset, model, and optimizer.