BERT ML.NET Save
BERT Model for dotnet ML
Project README
BERT-ML.NET
Question and Answering (Q&A) BERT model implementation for ML.NET.
An example of BERT model predictions in .NET Core/.NET Standard.
Model
https://github.com/onnx/models/tree/master/text/machine_comprehension/bert-squad
Download the pre-trained BERT ONNX model by running getDependicies.sh. Or download the model to the BERT.WebApi/Model folder.
GPU usage
The project is setup to run on CPU. This allows the sample to run on machines without an Nvidia GPU.
To run on an Nvidia CUDA GPU:
- Set
hasGpu = truein OnnxModelConfigurator.cs - Remove NuGet
Microsoft.ML.OnnxRuntime.NoOpenMP - Add NuGet
Microsoft.ML.OnnxRuntime.Gpu
Example queries
When the solution runs, it will start an ASP.NET webservice at localhost:5001.
| Context | Question | Model Reply | |
|---|---|---|---|
| (link) | Bob is walking through the woods collecting blueberries and strawberries to make a pie. | What is his name? | ✅ {"tokens":["bob"],"probability":0.8884454} |
| (link) | Bob is walking through the woods collecting blueberries and strawberries to make a pie. | What will he bring home? | ✅ {"tokens":["blueberries","and","strawberries"],"probability":0.4070111} |
| (link) | Bob is walking through the woods collecting blueberries and strawberries to make a pie. | Where is Bob? | ✅ {"tokens":["walking","through","the","woods"],"probability":0.6123137} |
| (link) | Bob is walking through the woods collecting blueberries and strawberries to make a pie. | What will he bake? | ❌ {"tokens":["blueberries","and","strawberries"],"probability":0.48385787} |
Open Source Agenda is not affiliated with "BERT ML.NET" Project. README Source: Gigabyte0x1337/BERT-ML.NET
Stars
91
Open Issues
1
Last Commit
1 year ago
Repository
License
Tags
Open Source Agenda Badge
