From 6844c234cde69ee356168bb3dcb7d69fa4e8a74d Mon Sep 17 00:00:00 2001 From: Navan Chauhan Date: Thu, 18 Apr 2024 00:47:42 -0600 Subject: simple chess AI --- docs/feed.rss | 314 ++++++++++++++++- ...-17-implementing-minimax-for-chess-in-swift.png | Bin 0 -> 38531 bytes docs/index.html | 34 +- ...17-implementing-minimax-for-chess-in-swift.html | 387 +++++++++++++++++++++ docs/posts/index.html | 19 +- docs/tags/Chess.html | 108 ++++++ docs/tags/Game Theory.html | 108 ++++++ docs/tags/Swift.html | 17 + docs/tags/mathematics.html | 11 - 9 files changed, 970 insertions(+), 28 deletions(-) create mode 100644 docs/images/opengraph/posts/2024-04-17-implementing-minimax-for-chess-in-swift.png create mode 100644 docs/posts/2024-04-17-implementing-minimax-for-chess-in-swift.html create mode 100644 docs/tags/Chess.html create mode 100644 docs/tags/Game Theory.html (limited to 'docs') diff --git a/docs/feed.rss b/docs/feed.rss index 81b5acb..dec39fa 100644 --- a/docs/feed.rss +++ b/docs/feed.rss @@ -4,7 +4,7 @@ Rare Tips, Tricks and Posts - 2024-04-13T22:30:15.472249 + 2024-04-18T00:47:15.150903 Navan Chauhan @@ -6338,6 +6338,318 @@ DescriptionThe bag-of-words model is a simplifying representation used in NLP, i + + Implementing Minimax with Alpha-Beta pruning for a simple Chess AI in Swift + + https://web.navan.dev/posts/2024-04-17-implementing-minimax-for-chess-in-swift.html + 2024-04-17T23:20:00 + 2024-04-17T23:20:00 + Adding a bestMove method to swift-chess-neo by implementing alpha-beta pruning for minimax + + Implementing Minimax with Alpha-Beta pruning for a simple Chess AI in Swift + +

Ever since Chess24 shut down, I have been looking to find a better way to follow Chess tournaments. A few weeks ago I decided to start working on a cross-platform (macOS/iOS) app using Lichess's API. +I heavily underestimated the amount of work it would take me to build something like this in SwiftUI. You not only need a library that can parse PGNs, but also a way to display those moves!

+ +

I ended up forking Sage to swift-chess-neo. I did have to patch the library to make it compatible with Swift 5 and create my own UI components using SwiftUI.

+ +

Now that I had a working Chess library that could give me all legal moves in a position, I wondered if I could write a minimax implementation.

+ +

Theory

+ +

Imagine you could look far ahead into the future and predict the perfect moves in a game for both sides. This is similar to Dr. Strange seeing all 14,000,605 alternate futures. +Knowing what works and what doesn't can help you decide what you should actually play.

+ +

Using the example of Dr. Strange looking into the alternate futures, think of the Avengers winning being scored as +1, and Thanos winning being scored as -1. +The Avengers would try to maximize this score, whereas Thanos would try to minimize this.

+ +

This is the idea of "minimax".

+ +

Say we are playing a game of Tic-Tac-Toe, where us winning is scored positively and our opponent winning is scored negatively. We are going to try and maximize our score. A fresh game of Tic-Tac-Toe can be represented as a 3x3 grid. Which means, if we have the first turn we have 9 possible moves.

+ +

Say we place an X in the top left corner:

+ +
-------------
+| x |   |   |
+-------------
+|   |   |   |
+-------------
+|   |   |   |
+-------------
+
+ +

Now, our oponent has 8 different moves they can play. Say they play their move in the bottom right corner

+ +
-------------
+| x |   |   |
+-------------
+|   |   |   |
+-------------
+|   |   | o |
+-------------
+
+ +

We have 6 different moves we can play.

+ +

It would take us ages to brute force each and every combination/permutation of moves by hand. A depth-first minimax algorithm for Tick-Tac-Toe would have a max-depth of 9 (since after 9 moves from the start, we would have exhausted the search space as there would be no more available moves).

+ +

Since we cannot score an individual Tic-Tac-Toe position (technically we can), we can iterate through all moves (till we reach our max-depth) and then use these three terminal states:

+ +
    +
  • +1 (You Win)
  • +
  • -1 (You Lose)
  • +
  • 0 (Draw)
  • +
+ +

Pseudocode

+ +
function minimax(board, depth, isMaximizingPlayer):
+    score = evaluate(board)
+
+    # +1 Win, -1 Lose, 0 Draw
+    if score == 1: return score
+    if score == -1: return score
+
+    if boardFull(board):
+        return 0
+
+    if isMaximizingPlayer:
+        best = -infinity
+
+        for each cell in board:
+            if cell is empty:
+                place X in cell
+                best = maximum of (best, minimax(board, depth + 1, false))
+                remove X from cell
+        return best
+
+    else:
+        best = infinity
+
+        for each cell in board:
+            if cell is empyu:
+                place O in cell
+                best = minimum of (best, minimax(board, depth + 1, true))
+        return best
+
+function evaluate(board):
+    if three consecutive Xs: return 1
+    if three consecutive 0s: return -1
+
+    return 0
+
+function boardFull(board):
+    if all cells are filled: return true
+
+    else:
+        return false
+
+ +

Think of each move as a node, and each node having multiple continuations (each continuing move can be represented as a node).

+ +

Alpha-Beta Pruning

+ +

This is quiet inefficient, as this will comb through all 9! or 362,880 moves! Imagine iterating through the entire search space for a complex game like Chess. It would be impossible. Therefore we use a technique called Alpha-beta pruning wherein we reduce the number of nodes that we are evaluating.

+ +
function minimax(board, depth, isMaximizingPlayer, alpha, beta):
+    score = evaluate(board)
+
+    # +1 Win, -1 Lose, 0 Draw
+    if score == 1: return score
+    if score == -1: return score
+
+    if boardFull(board):
+        return 0
+
+    if isMaximizingPlayer:
+        best = -infinity
+
+        for each cell in board:
+            if cell is empty:
+                place X in cell
+                best = maximum of (best, minimax(board, depth + 1, false, alpha, beta))
+                remove X from cell
+                alpha = max(alpha, best)
+                if beta <= alpha:
+                    break
+        return best
+
+    else:
+        best = infinity
+
+        for each cell in board:
+            if cell is empyu:
+                place O in cell
+                best = minimum of (best, minimax(board, depth + 1, true, alpha, beta))
+                beta = min(beta, best)
+                if beta <= alpha:
+                    break
+        return best
+
+ +

Alpha and beta are initialized as and + respectively, with Alpha representing the best already explored option along the path to the root for the maximizer, and beta representing the best already explored option along the path to the root for the minimizer. If at any point beta is less than or equal to alpha, it means that the current branch does not need to be explored further because the parent node already has a better move elsewhere, thus "pruning" this node.

+ +

Thus, to implement a model you can use minimax (or similar algorithms), you need to be able to describe the following:

+ +
    +
  • Players +
      +
    • Player Count - How many players are there in this game? (Just 2)
    • +
    • Active Player - Whose turn is it?
    • +
  • +
  • Game +
      +
    • Game State - How do you represent the current game state
    • +
    • Save/Load Game State - If you are trying out different moves, you need to be able to go to the original state before you move on to the next node
    • +
    • Score - Who is winning? Is the game over? Who lost?
    • +
  • +
  • Moves +
      +
    • Valid Moves - What are all the legal moves in this game state?
    • +
  • +
+ +

Show me the code!

+ +

The chess library does a little bit of the heavy lifting by already providing methods to take care of the above requirements. Since we already have a way to find all possible moves in a position, we only need to figure out a few more functions/methods:

+ +
    +
  • Evaluation/Score - We need to be able to numerically quantify the effect of a move. For a basic implementation we can just sum over the piece values.
  • +
  • Game state management - Since we explore different possible moves in our search space up to a certain depth, we need to be able to copy/save the state and reset it back to this state after we are done exploring all of our moves. Even though I did add a setGame method to the Game class, I use the undoMove() method
  • +
+ +

Evaluate

+ +

Each piece has a different relative value. Since "capturing" the king finishes the game, the king is given a really high value.

+ +
+
public struct Piece: Hashable, CustomStringConvertible {
+    public enum Kind: Int {
+        ...
+        public var relativeValue: Double {
+            switch self {
+                case .pawn: return 1
+                case .knight: return 3
+                case .bishop: return 3.25
+                case .rook: return 5
+                case .queen: return 9
+                case .king: return 900
+            }
+        }
+        ...
+    }
+    ...
+}
+
+
+ +

We extend the Game class by adding an evaluate function that adds up the value of all the pieces left on the board.

+ +
+
extension Game {
+    func evaluate() -> Double {
+        var score: Double = 0
+        for square in Square.all {
+            if let piece = board[square] {
+                score += piece.kind.relativeValue * (piece.color == .white ? 1.0 : -1.0)
+            }
+        }
+    return score
+}
+
+
+ +

Since the values for black pieces are multiplied by -1 and white pieces by +1, material advantage on the board translates to a higher/lower evaluation.

+ +

Recursive Minimax

+ +

Taking inspiration from the pseudocode above, we can define a minimax function in Swift as:

+ +
+
func minimax(depth: Int, isMaximizingPlayer: Bool, alpha: Double, beta: Double) -> Double {
+    if depth == 0 || isFinished {
+        return evaluate()
+    }
+
+    var alpha = alpha
+    var beta = beta
+
+    if isMaximizingPlayer {
+        var maxEval: Double = -.infinity
+
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let eval = minimax(depth: depth - 1, isMaximizingPlayer: false, alpha: alpha, beta: beta)
+            maxEval = max(maxEval, eval)
+            undoMove()
+            alpha = max(alpha, eval)
+            if beta <= alpha {
+                break
+            }
+        }
+        return maxEval
+    } else {
+        var minEval: Double = .infinity
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let eval = minimax(depth: depth - 1, isMaximizingPlayer: true, alpha: alpha, beta: beta)
+            minEval = min(minEval, eval)
+            if beta <= alpha {
+                break
+            }
+        }
+        return minEval
+    }
+}
+
+
+ +

Best Move

+ +

We can now get a score for a move for a given depth, we wrap this up as a public method

+ +
+
extension Game {
+    public func bestMove(depth: Int) -> Move? {
+        var bestMove: Move?
+        var bestValue: Double = (playerTurn == .white) ? -.infinity : .infinity
+        let alpha: Double = -.infinity
+        let beta: Double = .infinity
+
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let moveValue = minimax(depth: depth - 1, isMaximizingPlayer: playerTurn.isBlack ? false : true, alpha: alpha, beta: beta)
+            undoMove()
+            if (playerTurn == .white && moveValue > bestValue) || (playerTurn == .black && moveValue < bestValue) {
+                bestValue = moveValue
+                bestMove = move
+            }
+        }
+        return bestMove
+    }
+}
+
+
+ +

Usage

+ +
+
import SwiftChessNeo
+
+let game = try! Game(position: Game.Position(fen: "8/5B2/k5p1/4rp2/8/8/PP6/1K3R2 w - - 0 1")!)
+let move = game.bestMove(depth: 5)
+
+
+ +

Of course there are tons of improvements you can make to this naive algorithm. A better scoring function that understands the importance of piece positioning would make this even better. The Chess Programming Wiki is an amazing resource if you want to learn more about this.

+]]> +
+ + Navan Chauhan + blog@navan.email + +
+ RSS Feed written in HTML + JavaScript diff --git a/docs/images/opengraph/posts/2024-04-17-implementing-minimax-for-chess-in-swift.png b/docs/images/opengraph/posts/2024-04-17-implementing-minimax-for-chess-in-swift.png new file mode 100644 index 0000000..4197443 Binary files /dev/null and b/docs/images/opengraph/posts/2024-04-17-implementing-minimax-for-chess-in-swift.png differ diff --git a/docs/index.html b/docs/index.html index 1f22460..d54cfb3 100644 --- a/docs/index.html +++ b/docs/index.html @@ -88,6 +88,24 @@ lead.innerText = new_phrase;

Recent Posts

For all posts go to Posts diff --git a/docs/posts/2024-04-17-implementing-minimax-for-chess-in-swift.html b/docs/posts/2024-04-17-implementing-minimax-for-chess-in-swift.html new file mode 100644 index 0000000..5683da6 --- /dev/null +++ b/docs/posts/2024-04-17-implementing-minimax-for-chess-in-swift.html @@ -0,0 +1,387 @@ + + + + + + + + + + Implementing Minimax with Alpha-Beta pruning for a simple Chess AI in Swift + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ +
+

Implementing Minimax with Alpha-Beta pruning for a simple Chess AI in Swift

+ +

Ever since Chess24 shut down, I have been looking to find a better way to follow Chess tournaments. A few weeks ago I decided to start working on a cross-platform (macOS/iOS) app using Lichess's API. +I heavily underestimated the amount of work it would take me to build something like this in SwiftUI. You not only need a library that can parse PGNs, but also a way to display those moves!

+ +

I ended up forking Sage to swift-chess-neo. I did have to patch the library to make it compatible with Swift 5 and create my own UI components using SwiftUI.

+ +

Now that I had a working Chess library that could give me all legal moves in a position, I wondered if I could write a minimax implementation.

+ +

Theory

+ +

Imagine you could look far ahead into the future and predict the perfect moves in a game for both sides. This is similar to Dr. Strange seeing all 14,000,605 alternate futures. +Knowing what works and what doesn't can help you decide what you should actually play.

+ +

Using the example of Dr. Strange looking into the alternate futures, think of the Avengers winning being scored as +1, and Thanos winning being scored as -1. +The Avengers would try to maximize this score, whereas Thanos would try to minimize this.

+ +

This is the idea of "minimax".

+ +

Say we are playing a game of Tic-Tac-Toe, where us winning is scored positively and our opponent winning is scored negatively. We are going to try and maximize our score. A fresh game of Tic-Tac-Toe can be represented as a 3x3 grid. Which means, if we have the first turn we have 9 possible moves.

+ +

Say we place an X in the top left corner:

+ +
-------------
+| x |   |   |
+-------------
+|   |   |   |
+-------------
+|   |   |   |
+-------------
+
+ +

Now, our oponent has 8 different moves they can play. Say they play their move in the bottom right corner

+ +
-------------
+| x |   |   |
+-------------
+|   |   |   |
+-------------
+|   |   | o |
+-------------
+
+ +

We have 6 different moves we can play.

+ +

It would take us ages to brute force each and every combination/permutation of moves by hand. A depth-first minimax algorithm for Tick-Tac-Toe would have a max-depth of 9 (since after 9 moves from the start, we would have exhausted the search space as there would be no more available moves).

+ +

Since we cannot score an individual Tic-Tac-Toe position (technically we can), we can iterate through all moves (till we reach our max-depth) and then use these three terminal states:

+ +
    +
  • +1 (You Win)
  • +
  • -1 (You Lose)
  • +
  • 0 (Draw)
  • +
+ +

Pseudocode

+ +
function minimax(board, depth, isMaximizingPlayer):
+    score = evaluate(board)
+
+    # +1 Win, -1 Lose, 0 Draw
+    if score == 1: return score
+    if score == -1: return score
+
+    if boardFull(board):
+        return 0
+
+    if isMaximizingPlayer:
+        best = -infinity
+
+        for each cell in board:
+            if cell is empty:
+                place X in cell
+                best = maximum of (best, minimax(board, depth + 1, false))
+                remove X from cell
+        return best
+
+    else:
+        best = infinity
+
+        for each cell in board:
+            if cell is empyu:
+                place O in cell
+                best = minimum of (best, minimax(board, depth + 1, true))
+        return best
+
+function evaluate(board):
+    if three consecutive Xs: return 1
+    if three consecutive 0s: return -1
+
+    return 0
+
+function boardFull(board):
+    if all cells are filled: return true
+
+    else:
+        return false
+
+ +

Think of each move as a node, and each node having multiple continuations (each continuing move can be represented as a node).

+ +

Alpha-Beta Pruning

+ +

This is quiet inefficient, as this will comb through all 9! or 362,880 moves! Imagine iterating through the entire search space for a complex game like Chess. It would be impossible. Therefore we use a technique called Alpha-beta pruning wherein we reduce the number of nodes that we are evaluating.

+ +
function minimax(board, depth, isMaximizingPlayer, alpha, beta):
+    score = evaluate(board)
+
+    # +1 Win, -1 Lose, 0 Draw
+    if score == 1: return score
+    if score == -1: return score
+
+    if boardFull(board):
+        return 0
+
+    if isMaximizingPlayer:
+        best = -infinity
+
+        for each cell in board:
+            if cell is empty:
+                place X in cell
+                best = maximum of (best, minimax(board, depth + 1, false, alpha, beta))
+                remove X from cell
+                alpha = max(alpha, best)
+                if beta <= alpha:
+                    break
+        return best
+
+    else:
+        best = infinity
+
+        for each cell in board:
+            if cell is empyu:
+                place O in cell
+                best = minimum of (best, minimax(board, depth + 1, true, alpha, beta))
+                beta = min(beta, best)
+                if beta <= alpha:
+                    break
+        return best
+
+ +

Alpha and beta are initialized as and + respectively, with Alpha representing the best already explored option along the path to the root for the maximizer, and beta representing the best already explored option along the path to the root for the minimizer. If at any point beta is less than or equal to alpha, it means that the current branch does not need to be explored further because the parent node already has a better move elsewhere, thus "pruning" this node.

+ +

Thus, to implement a model you can use minimax (or similar algorithms), you need to be able to describe the following:

+ +
    +
  • Players +
      +
    • Player Count - How many players are there in this game? (Just 2)
    • +
    • Active Player - Whose turn is it?
    • +
  • +
  • Game +
      +
    • Game State - How do you represent the current game state
    • +
    • Save/Load Game State - If you are trying out different moves, you need to be able to go to the original state before you move on to the next node
    • +
    • Score - Who is winning? Is the game over? Who lost?
    • +
  • +
  • Moves +
      +
    • Valid Moves - What are all the legal moves in this game state?
    • +
  • +
+ +

Show me the code!

+ +

The chess library does a little bit of the heavy lifting by already providing methods to take care of the above requirements. Since we already have a way to find all possible moves in a position, we only need to figure out a few more functions/methods:

+ +
    +
  • Evaluation/Score - We need to be able to numerically quantify the effect of a move. For a basic implementation we can just sum over the piece values.
  • +
  • Game state management - Since we explore different possible moves in our search space up to a certain depth, we need to be able to copy/save the state and reset it back to this state after we are done exploring all of our moves. Even though I did add a setGame method to the Game class, I use the undoMove() method
  • +
+ +

Evaluate

+ +

Each piece has a different relative value. Since "capturing" the king finishes the game, the king is given a really high value.

+ +
+
public struct Piece: Hashable, CustomStringConvertible {
+    public enum Kind: Int {
+        ...
+        public var relativeValue: Double {
+            switch self {
+                case .pawn: return 1
+                case .knight: return 3
+                case .bishop: return 3.25
+                case .rook: return 5
+                case .queen: return 9
+                case .king: return 900
+            }
+        }
+        ...
+    }
+    ...
+}
+
+
+ +

We extend the Game class by adding an evaluate function that adds up the value of all the pieces left on the board.

+ +
+
extension Game {
+    func evaluate() -> Double {
+        var score: Double = 0
+        for square in Square.all {
+            if let piece = board[square] {
+                score += piece.kind.relativeValue * (piece.color == .white ? 1.0 : -1.0)
+            }
+        }
+    return score
+}
+
+
+ +

Since the values for black pieces are multiplied by -1 and white pieces by +1, material advantage on the board translates to a higher/lower evaluation.

+ +

Recursive Minimax

+ +

Taking inspiration from the pseudocode above, we can define a minimax function in Swift as:

+ +
+
func minimax(depth: Int, isMaximizingPlayer: Bool, alpha: Double, beta: Double) -> Double {
+    if depth == 0 || isFinished {
+        return evaluate()
+    }
+
+    var alpha = alpha
+    var beta = beta
+
+    if isMaximizingPlayer {
+        var maxEval: Double = -.infinity
+
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let eval = minimax(depth: depth - 1, isMaximizingPlayer: false, alpha: alpha, beta: beta)
+            maxEval = max(maxEval, eval)
+            undoMove()
+            alpha = max(alpha, eval)
+            if beta <= alpha {
+                break
+            }
+        }
+        return maxEval
+    } else {
+        var minEval: Double = .infinity
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let eval = minimax(depth: depth - 1, isMaximizingPlayer: true, alpha: alpha, beta: beta)
+            minEval = min(minEval, eval)
+            if beta <= alpha {
+                break
+            }
+        }
+        return minEval
+    }
+}
+
+
+ +

Best Move

+ +

We can now get a score for a move for a given depth, we wrap this up as a public method

+ +
+
extension Game {
+    public func bestMove(depth: Int) -> Move? {
+        var bestMove: Move?
+        var bestValue: Double = (playerTurn == .white) ? -.infinity : .infinity
+        let alpha: Double = -.infinity
+        let beta: Double = .infinity
+
+        for move in availableMoves() {
+            try! execute(uncheckedMove: move)
+            let moveValue = minimax(depth: depth - 1, isMaximizingPlayer: playerTurn.isBlack ? false : true, alpha: alpha, beta: beta)
+            undoMove()
+            if (playerTurn == .white && moveValue > bestValue) || (playerTurn == .black && moveValue < bestValue) {
+                bestValue = moveValue
+                bestMove = move
+            }
+        }
+        return bestMove
+    }
+}
+
+
+ +

Usage

+ +
+
import SwiftChessNeo
+
+let game = try! Game(position: Game.Position(fen: "8/5B2/k5p1/4rp2/8/8/PP6/1K3R2 w - - 0 1")!)
+let move = game.bestMove(depth: 5)
+
+
+ +

Of course there are tons of improvements you can make to this naive algorithm. A better scoring function that understands the importance of piece positioning would make this even better. The Chess Programming Wiki is an amazing resource if you want to learn more about this.

+ +
+
If you have scrolled this far, consider subscribing to my mailing list here. You can subscribe to either a specific type of post you are interested in, or subscribe to everything with the "Everything" list.
+ +
+ +
+ +
+ + + + \ No newline at end of file diff --git a/docs/posts/index.html b/docs/posts/index.html index 7e6f7e4..e1c1cdd 100644 --- a/docs/posts/index.html +++ b/docs/posts/index.html @@ -84,6 +84,23 @@ lead.innerText = new_phrase;