Description
The recent advancements in large language models (LLMs) have significantly enhanced their capabilities, leading to a paradigm shift in how AI can be integrated into our society. This is particularly evident in the case of ChatGPT, including the latest iteration, GPT-4. It is intriguing how the straightforward approach of Transformer models trained on massive datasets has achieved such remarkable progress, which should pique our interest on both conceptual and technical levels.
This mini-workshop aims to provide tutorial-style talks introducing the technology behind GPT-4 and discussing its implications for society. The technical talks are tailored for researchers in the field of AI.
The workshop was held as follows:
Day 1 – June 30th
Day 2 – July 3rd
(*This video includes 3 talks and 1 discussion for Day2.)
Time: 1:30 p.m. – 3:30 p.m. (JST)
00:00:07 Speaker: Hiroshi Nakagawa
Title: How to live together with ChatGPT?
00:27:06 Speaker: Hiroki Teranishi
Title: How to train large language models on the example of GPT3 (LLaMA)
00:56:05 Speaker: Yuji Matsumoto
Title: Instruct GTP and the role of experts feedback (via RL) – example ChatGPT/GPT4
01:43:24 Moderator: Koiti Hasida
Title: Open Discussion on the Future of AI (AGI) and Humanity
