Tengine is a lite, high performance, modular inference engine for embedded device
Models | Input Size | Inference Time of ZCU102+NVDLA (ms) |
---|---|---|
ResNet18 | 3x32x32 | 12.6 |
YOLOv3-Tiny-ReLU | 3x416x416 | 630.5 |
YOLOX-Nano-ReLU | 3x416x416 | 1138.8 |
Models | Inference Time of A311D (ms) |
---|---|
MobileNet v1 | 4.3 |
MobileNet v2 | 5.2 |
ResNet18 | 5.5 |
ResNet50 | 14.6 |
SqueezeNet v1.1 | 2.6 |
VGG16 | 18.7 |
YOLOv3 | 78.6 |
YOLOv5s | 68.9 |
YOLOX-S | 55.2 |