Alpha Zero Othello

There are 2 newer versions of this project that are both significantly faster:
- bhansconnect/fast-alphazero-general is completely written in python, but is much faster and more extensible than this library.
- bhansconnect/alphazero-pybind11 has large parts written in C++ and may be less beginner friendly, but totally crushes previous versions in performance.

If you like this project, please look at my other project, Expert Iterations General. It is similar to this one, but uses Pytorch and is built better.

A Python program for learning to play Othello/Reversi from zero. The best part is that it is easy to plug this same algorithm into many other games. If you have any questions. feel free to contact me: [email protected]

The current best version is in the root directory as model-best.h5 To use it, simply copy it to into data\models. Once it is copied over, you can train based off of it or play with it using the commands below. This model was only trained for 64 iterations. This equates to approximately 30000 games, which is not a lot in terms of rl. It is definitely getting better, but is not super good.

To install required libraries run: pip install -r requirements.txt

This version currently uses a smaller neural network for testing purposes as things are confirmed to be working, I will upgrade to full size.

Currently run by calling: python run.py {self, opt, eval, play, rank, compile_rank}

• self for it to generate self play games.
• opt for it to update the network.
• eval to compare different versions.
• play to play against it yourself.
• rank to compare multiple models
• compile_rank to load all ranking/eval history into one comparison

I generally run 2 instances self playing games and 1 optimizing while training it. Config.py has all of the options.

As a side note, it is possible to train on multiple servers by setting up a shared drive between multiple computers from that shared drive, you can run the program on multiple computers and they will all generate self play games. That being said, you would still be limited to one optimizer. Luckily, it takes much less time to optimize than self play games.