Section: How do GenAI models work?

The five general steps of the next-word prediction process


Abideen, Z. (2023). Autoregressive Models of Natural Language Processing. Medium. Retrieved from: https://medium.com/@zaiinn440/autoregressive-models-for-natural-language-processing-b95e5f933e1f
Alagumalai, V. (2023). Demystifying the Architecture of ChatGPT: A Deep Dive. LinkedIn. Retrieved from:

https://www.linkedin.com/pulse/demystifying-architecture-chatgpt-deep-dive-vijayarajan-a/

Collins, K. (2023). How ChatGPT could embed a ‘Watermark’ in the Text It Generates. The New York Times. Retrieved from: https://www.nytimes.com/interactive/2023/02/17/business/ai-text-detection.html

Kyle Hill. (2023). ChatGPT Explained Completely [Video]. Youtube. Retrieved from: https://www.youtube.com/watch?v=-4Oso9-9KTQ

Last, B., & Sprakel, T. (2023). Chatten met Napoleon. Boom.
Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. Retrieved from: https://unesdoc.unesco.org/ark:/48223/pf0000386693. Licensed under CC BY-SA 4.0 International License

Wolfram, S. (2023). What is ChatGPT doing… and why does it work?. Stephen Wolfram Writings. Retrieved from: https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/