Notes on A hacker's guide to Language Models

Watch it.

ChatGPT4

• was trained to give the most probable answer, not the correct answer,
• has knowledge cutoff September 2021,
• doesn’t know about itself,
• deems everything answerable and
• is stateless, conversations are sent again and again.

TIP: add custom instructions in ChatGPT (Jeremy has quite good ones!)

Online GPU renting:

• runpod.io
• lambdalabs.com
• vast.ai