Alturos.Yolo

A state of the art real-time object detection system for C# (Visual Studio). This project has CPU and GPU support, with GPU the detection works much faster. The primary goal of this project is an easy use of yolo, this package is available on nuget and you must only install two packages to start detection. In the background we are use the Windows Yolo version of AlexeyAB/darknet. Send an image path or the byte array to yolo and receive the position of the detected objects. Our project is meant to return the object-type and -position as processable data. This library supports YoloV3 and YoloV2 Pre-Trained Datasets

NuGet

Quick install Alturos.Yolo over NuGet

PM> install-package Alturos.Yolo (C# wrapper and C++ dlls 28MB)
PM> install-package Alturos.YoloV2TinyVocData (YOLOv2-tiny Pre-Trained Dataset 56MB)

Object Detection

Example code

Detect the type and the position of an image (Automatic configuration)

var configurationDetector = new ConfigurationDetector();
var config = configurationDetector.Detect();
using (var yoloWrapper = new YoloWrapper(config))
{
	var items = yoloWrapper.Detect(@"image.jpg");
	//items[0].Type -> "Person, Car, ..."
	//items[0].Confidence -> 0.0 (low) -> 1.0 (high)
	//items[0].X -> bounding box
	//items[0].Y -> bounding box
	//items[0].Width -> bounding box
	//items[0].Height -> bounding box
}

Detect the type and the position of an image (Manual configuration)

using (var yoloWrapper = new YoloWrapper("yolov2-tiny-voc.cfg", "yolov2-tiny-voc.weights", "voc.names"))
{
	var items = yoloWrapper.Detect(@"image.jpg");
	//items[0].Type -> "Person, Car, ..."
	//items[0].Confidence -> 0.0 (low) -> 1.0 (high)
	//items[0].X -> bounding box
	//items[0].Y -> bounding box
	//items[0].Width -> bounding box
	//items[0].Height -> bounding box
}

Performance

It is important to use GPU mode for fast object detection. It is also important not to instantiate the wrapper over and over again. A further optimization is to transfer the images as byte stream instead of passing a file path. GPU detection is usually 10 times faster!

System requirements

• .NET Framework 4.6.1 or .NET standard 2.0
• Microsoft Visual C++ Redistributable for Visual Studio 2015, 2017 und 2019 x64

GPU requirements (optional)

It is important to use the mentioned version 10.2

1. Install the latest Nvidia driver for your graphic device
2. Install Nvidia CUDA Toolkit 10.2 (must be installed add a hardware driver for cuda support)
3. Download Nvidia cuDNN v7.6.5 for CUDA 10.2
4. Copy the cudnn64_7.dll from the output directory of point 2. into the project folder.

Build requirements

• Visual Studio 2019

Benchmark / Performance

Average processing speed of test images bird1.png, bird2.png, car1.png, motorbike1.png

CPU

GPU

Pre-Trained Dataset

A Pre-Trained Dataset contains the Informations about the recognizable objects. A higher Processing Resolution detects object also if they are smaller but this increases the processing time. The Alturos.YoloV2TinyVocData package is the same as YOLOv2-tiny. You can download the datasets manually or integrate them automatically into the code.

//The download takes some time depending on the internet connection.
var repository = new YoloPreTrainedDatasetRepository();
await repository.DownloadDatasetAsync("YOLOv3", ".");

yolo9000 require a data directory with this two files coco9k.map and 9k.tree. Merge files with this command type xaa xab > yolo9000.weights

Troubleshooting

If you have some error like DllNotFoundException use Dependencies to check all references are available for yolo_cpp_dll_gpu.dll

If you have some error like NotSupportedException check if you use the latest Nvidia driver

Debugging Tool for Nvidia Gpu

Check graphic device usage "%PROGRAMFILES%\NVIDIA Corporation\NVSMI\nvidia-smi.exe"

Directory Structure

You should have this files in your program directory.

.
├── Alturos.Yolo.dll              # C# yolo wrapper
├── yolo_cpp_dll_cpu.dll      # yolo runtime for cpu
├── yolo_cpp_dll_gpu.dll      # yolo runtime for gpu
├── cudnn64_7.dll             # required by yolo_cpp_dll_gpu (optional only required for gpu processig)
├── opencv_world340.dll       # required by yolo_cpp_dll_xxx (process image as byte data detect_mat)
├── pthreadGC2.dll            # required by yolo_cpp_dll_xxx (POSIX Threads)
├── pthreadVC2.dll            # required by yolo_cpp_dll_xxx (POSIX Threads)
├── msvcr100.dll              # required by pthread (POSIX Threads)

Annotation Tool

To marking bounded boxes of objects in images for training neural network you can use

• Alturos.ImageAnnotation
• VoTT

Dataset of tagged images

• http://cocodataset.org/
• https://storage.googleapis.com/openimages/web/index.html