Errare humanum est, perseverare autem diabolicum: A Follow-Up Study on the Human-Likeness of an AI Othello Player

Othello, also known as Reversi, is a popular 2-players board game. Olivaw is an intelligent agent playing Othello. Compared to the most famous ones (such as Saio), it exploits limited resources by autonomously learning how to improve its gameplay by playing against itself. In previous occasions, Othello players reported the impression of a sort of human-likeness in how Olivaw plays. We designed and ran an experimental study to better investigate these impressions in a controlled setting. Participantswere asked to watch the moves of pre-recorded Othello games played by a human expert player against either another agent (i.e., Olivaw, Saio) or another human. The identity of the opponent, the outcome of the game (i.e., whether the human expert or the opponent player won), and the color of the players (i.e., black or white, black always playing first) were manipulated. We then asked participants to evaluate the human-likeness of the opponent player. Results confirm that the outcome of the match affects the perception of human-likeness of the players.