I saw the interesting message posted yesterday where Don Knuth played with ChatGPT in a discussion with Stephen Wolfram [0]. However, the way the message was formatted, I found it very difficult to constantly scroll up and down reading the questions, responses, and discussion in separate sections. I reformatted the message, with extremely minimal editing (like replacing "chatGPT" with "ChatGPT" because I'm a bit of a pedant, or changing "Answer #x" in the discussion section to "This answer"), to make it easier to read, and wanted to share it with everyone else.
Hey all, I found the post about Don Knuth and ChatGPT [1] very interesting so I hacked together this project over the weekend. Optimystic periodically re-runs Knuth's questions against the latest GPT model (additionally I've asked GPT to score the updated answers as PASS/FAIL).
Initially I thought it would just be a fun thing, but I've realized there could be some value to the larger LLM community. Also I think it would be interesting to apply this format to experts in other fields.
Hi HN,
I saw the interesting message posted yesterday where Don Knuth played with ChatGPT in a discussion with Stephen Wolfram [0]. However, the way the message was formatted, I found it very difficult to constantly scroll up and down reading the questions, responses, and discussion in separate sections. I reformatted the message, with extremely minimal editing (like replacing "chatGPT" with "ChatGPT" because I'm a bit of a pedant, or changing "Answer #x" in the discussion section to "This answer"), to make it easier to read, and wanted to share it with everyone else.
[0]: https://news.ycombinator.com/item?id=36012360