Cheng Li Pyramid Versions Save

BR-rerank

• Writes predictions and confidence scores to file
• Allows users to specify max GB training iteration

Make pyramid compatible with Java 9+

Fix tar long file issue

New functions:

• Add the ability to normalize the feature matrix when creating datasets
• Add new calibrator type: identity (using uncalibrated confidence as final confidence) and zero (mapping everything to 0 confidence to avoid automation)
• Support F1 as calibration target
• Report Average Precision for each label classifier
• Unify LR and GB top feature file format

Internals:

• Use expected precision, recall, F1 as features for reranker calibrator
• Sample random support sets as negative calibration candidates
• Better bounds for isotonic regression output
• Improved CBM prediction stop condition based on the Threshold Algorithm

release code and data for the ECML-PKDD 2019 paper "Learning to Calibrate and Rerank Multi-label Predictions"

• smoothed isotonic regression label calibrator
• use un-interpolated isotonic regression for label calibrator and interpolated isotonic regression for ensemble set calibrator
• make support predictions consistent with top_sets.csv

Fixed an issue with the top sets

Fix a bug in CombSUM ensemble caused by empty set

Use F1 based confidence in CombSUM ensemble

• add precision, recall, F1, and ground truth to reports
• support F1 as the target metric in confidence threshold tuning
• average-confidence based ensemble
• isotonic regression outputs interpolated confidence