Feature Store Api Versions Save

Python - Java/Scala API for the Hopsworks feature store

2.1.0

3 years ago

33e0e4d Release version 2.1.0 b153e24 [HOPSWORKS-2338] handle empty tfrecord files in TFDataEngine (#230) 58809b6 [HOPSWORKS-2337] Upgrade hudi to 0.7.0 version (#229) 9d1f3ee Documentation version selector (#204) 4a8c2fb Fix deserialization for TD create job config (#228) 33d79ee Handle null spark_options in storage connector (#227) 1c0db64 Fix ingestion job config dict with null value (#226) 93225f5 Add docs for MLStudio and HDInsight (#225) 12bf1ee [HOPSWORKS-2197] Add ADLS connector support (#221) 023f97e Remove dangerous query default (#224) 4c48a3b [HOPSWORKS-2280] Save statistics configuration also for training datasets (#217) 9302c27 [HOPSWORKS-1971] Add HSFS python support (#206) b2a7e0b Add Python training dataset API reference (#215) 880366e JDBC connector spark_options should provide all the properties (#214) 832c115 Fix broken link in Databricks network configuration (#211) 626d96f Fix bad merge, add back compute_statistics method (#213) f2ce3d8 [HOPSWORKS-2188] Append - fix time_travel_format.upper() if None (#210) ce659ad On demand feature group over S3 buckets (#185) cf9fa72 [HOPSWORKS-2188] Remove partition key requirements for HUDI feature groups and allow users to set precombine keys (#198) 867a179 Select all Features of a Feature Group except few (#207) f356072 [HOPSWORKS-2277] Add feature type docs (#208) 2448428 Fix get storage connector hudi_engine (#203) fee3f7d [HOPSWORKS-2134] Extend Query constructor with filter capability (#194) 0130182 [HOPSWORKS-2134] Extend Query constructor with filter capability (#174) cafe316 [Append] Hopsworks client to work with Hive Engine (#201) 110b613 [HOPSWORKS-2206] HSFS profile to install with and without Hive dependencies (#200) 8a59a4e add online type getter/setter (#199) 655d1c2 Allow to set engine in connection (#196) 60efdd9 [instance_profile_permissions] Reorganize instance profile section and add permissions for CloudWatch (#197) 42ace4d [HOPSWORKS-2177] Refactor storage connectors (#193) 2fc5687 Add StorageConnectorId to TrainingDataset (#195) ea51784 Use proper endpoint to retrive the online storage connector (#192) 242e17b Replace ModuleNotFoundError to ImportError (#190) 5ed9d60 Fix typo (#188) 97ddd2b Fix typo (#187) 1d56234 [HOPSWORKS-2085] redshift connector (#177) 1215325 [HOPSWORKS-2183] Add feature group, training dataset, storage connector counters to FeaturestoreDTO summary (#176) 05a6ee0 Add documentation for EMR (#175) 8b8dbec Account for other configuration parameters (#172) ac6c24d HSFS is defaulting to PyHive instead of Spark on EMR (#171) 1fe5adb add properties to feature store (#168) 439ce62 Documentation fixes for integration (#169) 81fa058 [HOPSWORKS.AI-DOC] support for gpu in azure (#166) 0841bd2 Apply Java checkstyle (#122) 4249151 improvements and imgs (#164) 8742328 Add support reference (#163) b37a313 Expand Databricks Integration guide (#162) 1e2b5c1 Fix read for on-demand feature groups a24a06e query_online can be null (#161) 1a9f81d [HOPSWORKS.AI-DOC] User mamangement doc (#160) daba5a8 [HOPSWORKS.AI-DOC] add and remove workers (#159) 1a0c7bd [HOPSWORKS.AI-DOC] Fix EKS screenshots (#158) cfee823 [vpc_doc] Add link to create Security Group guide (#157) 5377e15 [HOSPSWORKS.AI-DOC] add cluster creation for AWS (#156) 6b9e587 [HOPSWORKS.AI-DOC] update aws getting started (#155) b499702 [HOPSWORKS.AI-DOC] add azure cluster creation (#154) 142ba96 Link the old docs so people can find it (#153) a28b1e4 [HOPSWORKS.AI-DOC] fix azure getting started (#152) 8eb97bd [HOPSWORKS.AI-DOC] add permission restriction for Azure (#151) 33af423 Migrate hopsworks.ai docs part 1 (#150) 204d0b9 Add Databricks configuration documentation (#149) 1afc509 Add link to getting started with hopsworks.ai (#148) 70dcc86 Hudi fixes and exclusions for databricks (#147) a10f6d5 Copy LICENSE and README.md before packaging (#145) ed83682 fix pypi setup (#143) 0f26471 Prepare for 2.1.0-SNAPSHOT development (#141) 02fbcfc add desc type to setup.py (#139)

2.0.0

3 years ago

44ce720 Release version 2.0.0 (#138) f50efa5 On demand feature group append (#137) b263ed3 Documentation: Features/Storage Connectors (#136) e399549 Support for on demand feature groups (#104) 77d103d [HOPSWORKS-1374] Append: get commit details in correct order and make upsert default op for fg.insert (#132) 7c704e0 [HOPSWORKS-2091] Label/Prediction feature metadata for training datasets (#127) 4753612 [HOPSWORKS-2091] Label/Prediction feature metadata for training datasets (#126) 23777d1 [HOPSWORKS-2122] Backend not handling null TimeTravelFormat sent by client (#133) 2665497 Don't set spark type as online type in Java API (#131) 7169a09 [HOPSWORKS-2084] Remove default_storage option from feature groups (#118) c2877ec [HOPSWORKS-2084] Remove default_storage option from feature groups (#119) 3de10b2 Add documentation for integration with extenral Spark clusters (#129) 17792c4 [HOPSWORKS-1580] Change endpoint for getting the online storage connector (#111) 36d0c23 [HOPSWORKS-1374] Append: change hudi group name to io.hops.hudi (#128) 922aa12 [HOPSWORKS-1374] Add Hudi API to HSFS and commits to the FeatureStore metadata (#120) 581fd15 [HOPSWORKS-2077] Append: mock tf and pydoop modules if ModuleNotFoundError for documentation (#125) 0b27bdb [HOPSWORKS-2077] add support for reading csv files as tf data object and rename feeder to tf_data (#113) 33ab960 Bump Docker image version (#123) 4128aa5 Python Documentation (#114) 38d9291 [HOPSWORKS-2009] Append Features to Feature Group schema (#115) 21088c9 [HOPSWORKS-2009] Append Features to Feature Group schema (#117) df68ffc Bump junit from 4.13 to 4.13.1 in /java (#116) 4105f5c Python client can't handle disabled online feature store fix (#107) f48fab6 add jenkinsfile for documentation pipeline (#110) eb4edfe #60 Replay training dataset query (#73) f4a6486 Add Docs setup (#108) 9987a1f Training Dataset set Id from backend after creation (#106) 7f938f1 Java API Fixes for statistics (#105) 9d7ec52 [HOPSWORKS-1982] Deequ statistics for Feature Groups/Training Datasets (#84) 43c2e1c [HOPSWORKS-1982] Deequ statistics for Feature Groups/Training Datasets (#96) 26b1203 Bump HSFS java/scala version (#103) a42ecde Modify setup.py metadata (#102) c7c623e fix build docker image (#101) 721c58a Add Jenkinsfile to publish to PyPi (#100)

1.4.0

3 years ago

c7c623e7bc9e83c1eb05716229550624c32e32ce (HEAD, upstream/master) fix build docker image (#101) 721c58a4ba6e7f62532a3db535fc7e6811e68abe Add Jenkinsfile to publish to PyPi (#100) d0e1ab9c14a11f90d575d9803f9d2d57bb15a571 (upstream/branch-1.4, branch-1.4) Release version 1.4.0 (#99) 96934b7759bfa5a8db510dcba783b097fb61903e [HOPSWORKS-1972] Featurestore connect using API key value (#76) 7aff980ff325b5b15263c78e0eadc7dcf3d07526 Spark-TFRecord (#97) d0e83ab4f2ff68b0786773cf754729064acd61b7 [HOPSWORKS-1762] Add support for Spark-Tfrecord (#94) 141677e92162b5d8b6e848d1d2f42a57561e52ec Lowercase feature store name before calling the get (#93) 966ac3e2370fbec37566f68beaca37f8d1d52a7d Engine specific (hopsfd, s3) tf glob (#92) 5df55cb44a6da704131cc6df1c0110c4a9e72a90 Python client can't handle empty responses from the backend (#90) de628f0e0b9298671d93ab6f0524f38d55fb5303 Don't allow to specify storage on save (#91) c6bd9bbd3b970736853acd5c9d51fa71dbf8ffb9 Fix Pydoop missing import if scheme not provided (#88) cfd0573e6928e35f2e7559c82e4d63b6ff29b38b Python client ignore partition_key in feature group (#87) fdd69ed29ac22a68cd4d4f1b22e13e01158ae0fe Pydoop should handle hopsfs:// scheme (#79) 3e2a727dc6bbb644ea705d2576c6ae43c2ecd50c default storage is not set on feature group creation (#83) eb1312283d12ea9e0df1a864187df2c3678a168c [HOPSWORKS-1592] Add support for feature store s3 storage connectors to encrypted buckets (#68) ac4df84bf0ff42101b51def3fb15fd911a19c61d (60-python) Fix versions to match Hopsworks releases (#72) fda0706f22ca966ba1231e98897473473401f24a add readme before making the repository public (#71) 65a9bafc9fd829057c0f1b9fe52ac7e1e3d740aa #65 add checkstyle to java apis (#67) b28524f0760db7a3b63ddaa98e03570df87e25ce Feed model engine (#1) (#62) 604ae639ee23c6eca1cb47a7ddd8c201d4118baf Java client fixes for databricks (#53) 4d3d1396e49ec204b44d1b4c22771b8acd368dab Revert "Feed model engine (#39)" (#61) 4781152a23c1ba018d813fc113778ec12d0900ca Feed model engine (#39) 51940d8ac098dafc76e1781c822e03e1fea9cfb7 #58 Null pointer exception when reading with the java API without storage (#59) 8d4733bb35627d25b6f877dff451e71467171f6e Add tag api methods to training dataset plus unify documentation (#54) eeba06c9020b27a9754b0764864ab16c01228c70 Unify tags APIs and add to training dataset (#55) 5858fbeba90b39b985702cc8c7bf1d91a83fd17b Version default to 1 for get methods and increment for create (#49) bd4bb3d1196801c0fcdc4863fe1dd9c11aff83ea Version default to 1 for get methods and increment for create (#50) b95f41f4196fa96cc060d12960da9e931d775226 Databricks fixes (#51) 3fb9c22af58c5ed1a857bb72c222c49a303c7517 Fix pure sql against feature store (#48) 055da08dacbb7a18db34f257fdcac5141f3fd603 Java Feature group (#20) c714d33af25440b73e78865869ca2d1052e5a1f8 Python feature group (#43) ccf36a0d2d42efd1b8bc9b06be5ed828bbe730c9 Databricks setup and connect (#33) 71de520659c8888428a68bc493fabdf8d862c106 (python_fg) HOPSWORKS-1765 archiva (#40) 279ade58731a6a5b096303257a9a3cd6cf5341f9 Replace double create with save for training datasets (#38) b3fd68576a9152a12917c9fb25be72020d621123 Rename Java API to hsfs and add Apache License (#35) b0f279b1e1951c9e442adb310e3eec1621c65c01 Fix rename bug (#36) ac96e7238f467c8d3d71edb7f0a2eec7df3d77d3 Fix hsfs rename import (#34) 21560cb29b32ad92c4fc2c4f91c765f44f500d5e Rename library to hsfs and add LICENSE (#32) 7cfd4f8b5a6987a191e2d8dc6228224c6809e760 Initial training dataset implementation - Java (#14) 8b1fb8e9880951a4359a833a0adbedc0b9adff8d Training dataset api python (#25) b2a8fe6553eef730302c988981c7f8369ea70bb4 Make client a singleton (#23) 58483eb752dbbc8526c01c7bf3efb7dc9a2b64f2 Add possibility to execute pure sql on feature store (#18) b9b73ad26bffcf976a64362bfb3b7ac75685ae90 Add feature group joins (#15) 75c012c660900bd095829240f0302a592e4b1e1f Make connect optional (#17) 4d8647c83ea3ae6d7005ec99145d88a4331f740b Add feature group api and hive and spark engine (#10) 77a1935700726cb1b0b085fc9f72368458adb2d5 Java/Scala API should allow passing feature list as a list of string #12 (#13) 430061fb8a5d88f2f719f1fb7fd4b9ed205d9eed #7 remove read method from spark engine, #8 replace head with show() (#9) 3c8cf0847170051588d35d24754ac258491ac9c5 Add Connection module in Java/Scala API (#6) 7f6e235c1d23a3568de5ef2b3d969f59c22e6f89 Add feature store api (#4) a794af11e2fe0e58602dea554c57ae41570143ee Add feature group query/join capabilities (#3) bfa2b82cbcab506864553f4e99c4e20f5c65680e Add connection functionality (#2) 462d6cf994e7aec28963cd72af7503bf6c5c1709 Initialize Development Style (#1) f1580b484fbab570d51583842c239f516843f6ad remove ignored files 8040105564423534173bfd2fd84ea06f0e9b0cf5 More java gitignore 09bc8d69b2797c21b6188fd43c8bf78e65ae36df add intellij to gitignore 0d282edb85ab8da1a8eb7e3fd40684fbfe71c382 Start java implementation 088a4e91caacb8cbbf3440304a5990c5dff3bb90 Basic client b84bf768ffa15c1481b36f460e3bdad501d2e7e4 Setup package rough structure 5c6d53cea0d95ce78a6f0fa746c12a31f2c616cb Add .gitignore b8e610307e70276ff03e70d377f7a86732a8a330 Add README.md