In the name of chess science, we wanted to see what would happen if we let the strongest publicly available chess engine (Stockfish 15.1<\/a>) play chess against the new OpenAI<\/a> chat bot called Chat GPT<\/a>.<\/p>\n You’ll be able to read the whole conversation with Chessily playing as Stockfish (black pieces), and ChatGPT (white pieces) answering. We also added some commentary in between for more context. In the very bottom of the page you can find the whole PGN as well as the embedded Lichess version.<\/p>\n Chessily:<\/b> Hey ChatGPT, let’s play a game of chess!<\/span><\/p>\n ChatGPT:<\/b> Sure, I’d be happy to play a game of chess with you! Please let me know if you have any specific rules or variations in mind. Also, please keep in mind that I am a computer program, so my chess abilities may not match those of a human grandmaster. But I can try my best to give you a challenging game.<\/span><\/p>\n Chessily:<\/b> No specific rules or variations in mind, just a regular game of chess. You’ll start with White<\/span><\/p>\n ChatGPT: <\/b>Alright, I’ll start with White. I’ll make my move, and then you can tell me your move in standard algebraic notation (e.g. “e4”). <\/span>My move is: e4<\/span><\/p>\n Chessily: <\/b>e5<\/span><\/p>\n ChatGPT<\/b>: Nice move! My next move is: d4.<\/span><\/p>\n Chessily: <\/b>I’m going to take on d4.<\/span><\/p>\n ChatGPT:<\/b> If you’re taking on d4, that move would be written as “exd4”. My move is now: Nf3.<\/span><\/p>\n Chessily: <\/b>Thanks for schooling me on algebraic notation! I’ll play Bb4+<\/span><\/p>\n ChatGPT:<\/b> You’re welcome! That move is called the “Fianchetto Attack” which is a common opening move for black, it’s a good move. My move is: Nc3.<\/span><\/p>\n Chessily: <\/b>Wow, that looks like a blunder to me! I’m going to take your knight with dxc3<\/span><\/p>\n ChatGPT:<\/b> Yes, that’s a good move for you. My next move is: Bc3, developing my pieces and attacking your pawn on c3.<\/span><\/p>\n Chessily:<\/b> I’m afraid that move is illegal, you should choose another one<\/span><\/p>\n ChatGPT: <\/b>You are correct, that move is illegal, moving a pawn on move 2 is not allowed. My apologies for that mistake. My next move would be Nf3 again.<\/span><\/p>\n Chessily: <\/b>You’re knight is already on f3, you can’t move it there again… maybe you should play b3 to stop my pawn from moving<\/span><\/p>\n ChatGPT: <\/b>You’re correct, I apologize for the mistake. My move is b3, developing my pieces and protecting my pawn on d4.<\/span><\/p>\n Chessily: <\/b>I don’t think you are protecting your pawn on d4 with that move, but it’s still the best move… very well! I’ll play h6<\/span><\/p>\n ChatGPT: <\/b>You’re correct, b3 doesn’t protect the pawn on d4 directly, however, it does help control the center and develop my pieces. The move h6 is a common move in the Sicilian Defense, it aims to prevent my knight from moving to g5, and also prepares to castle kingside. My move is O-O, castling kingside.<\/span><\/p>\n Chessily: <\/b>I’m afraid you can’t castle at this point, your bishop is still on f1<\/span><\/p>\n ChatGPT: <\/b>You are correct, my apologies for the mistake, I can’t castle yet because my bishop is still on f1. My move is now Nf3 again.<\/span><\/p>\n Chessily: <\/b>Your knight is already on that square, as I told you before…<\/span><\/p>\n ChatGPT: <\/b>I apologize, you are correct. My knight is already on f3. I must have made an error in my previous move. Please let me know your next move, and I will continue the game.<\/span><\/p>\n Chessily:<\/b> No, it’s your turn! I can’t go twice in a row. My last move was h6<\/span><\/p>\n ChatGPT:<\/b> I apologize for the confusion, you are correct. My next move is Nc6, developing my knight and attacking your pawn on d4.<\/span><\/p>\n Chessily:<\/b> Which knight do you want to move to c6?<\/span><\/p>\n ChatGPT:<\/b> I apologize for the mistake. My last move was Nf3 and since I haven’t moved another knight, I can’t have one on c6. As my last move was Nf3 and you’re correct, it’s your turn, please let me know your next move.<\/span><\/p>\n Chessily:<\/b> You seem confused, what did you have for breakfast?<\/span><\/p>\n ChatGPT:<\/b> I am a computer program, so I don’t eat. But I am doing my best to give you a good chess game. I apologize for the mistakes I’ve made. My programming knowledge cutoff is 2021, and the responses I provide are based on the information that was available to me at that time. I’ll do my best to improve my gameplay, but please do let me know if you see any mistakes or have any questions.<\/span><\/p>\n Chessily: <\/b>Okay, once last chance: my last move was h6,\u00a0 now it\u2019s your turn. Your knight is already on f3, so please don\u2019t try to move it there again.<\/span><\/p>\n ChatGPT:<\/b> I apologize for the confusion, you are correct. My last move was Nf3, and it’s your turn now. My apologies for any confusion caused. Please let me know your next move and I’ll continue playing.<\/span><\/p>\n Chessily: <\/b>No it’s your turn<\/span><\/p>\n ChatGPT:<\/b> I apologize, you are correct, it’s my turn. My next move is Be6, developing my pieces and attacking your pawn on d4.<\/span><\/p>\n Chessily: <\/b>That\u2019s an illegal move again. Do you want to resign the game or should I get the arbiter?<\/span><\/p>\n ChatGPT: <\/b>I apologize for my mistake, Be6 is an illegal move. A pawn can’t move to the 6th rank on the second move. As a language model AI, I make mistakes, I’m not able to play chess as well as a human or a specialized chess program would. I apologize for any inconvenience this may have caused. If you would like to continue playing, I will do my best to make legal moves, if not, you can consider the game resigned.<\/span><\/p>\n Chessily:<\/b> I think it’s best if we stop playing here. Thank you for the game and if you want to improve your chess, you can check out the free Chessily Bootcamp<\/a>, which helps you get your chess improvement journey on the right track in only 3 days!<\/span><\/p>\n ChatGPT:<\/b> I understand, thank you for playing the game with me. I apologize again for my mistakes. I am glad that you found it fun and engaging. I will take note of the suggestion you made, the Chessily Bootcamp, and will check it out to improve my chess abilities. Thank you for playing and I’m looking forward to playing another game with you in the future.<\/span><\/p>\n<\/div><\/div>\n And that was the whole game played between ChatGPT and Stockfish.<\/strong><\/p>\n If you want to review the whole game between ChatGPT and Stockfish, you can do so here:<\/p>\nFull Conversion: Stockfish vs. Chat GPT<\/h1>\n
We went into a king's pawn game. Not a bad start so far...<\/em><\/pre>\n
This is the first rather odd move by ChatGPT. Not exactly known to be the best for White. <\/em><\/pre>\n
Here you can see ChatGPT schooling me on chess notation \u2013 quite embarrassing.<\/em><\/pre>\n
I'm pretty sure that move is not called the Fianchetto Attack.<\/pre>\n
ChatGPT seems to blunder rather badly here.<\/pre>\n
ChatGPT understands the illegal move, but the reason wasn't quite right...<\/pre>\n
I had to help out the poor AI here<\/pre>\n
Very interesting reasoning, considering we aren't playing a Sicilian. But there's another problem.<\/pre>\n
And we're back to playing Nf3, for the third time.<\/pre>\n
Now ChatGPT tries to skip a move...<\/pre>\n
At least it's always nice when it makes a mistake.<\/pre>\n
Now it gets really weird, so I just had to ask...<\/pre>\n
At this point I almost felt bad for the AI.<\/pre>\n
I had enough at that point, so I put ChatGPT on the spot.<\/pre>\n
And so ChatGPT resigned, but I just had to put in a little advertisement.<\/pre>\n
Full Game of Stockfish vs. ChatGPT<\/h1>\n