July 21, 2023 11:42
GPT4 Journal Club Series Day2 (RIKEN AIP mini workshop) thumbnails


The recent advancements in large language models (LLMs) have significantly enhanced their capabilities, leading to a paradigm shift in how AI can be integrated into our society. This is particularly evident in the case of ChatGPT, including the latest iteration, GPT-4. It is intriguing how the straightforward approach of Transformer models trained on massive datasets has achieved such remarkable progress, which should pique our interest on both conceptual and technical levels.

This mini-workshop aims to provide tutorial-style talks introducing the technology behind GPT-4 and discussing its implications for society. The technical talks are tailored for researchers in the field of AI.

The workshop was held as follows:
Day 1 – June 30th
Day 2 – July 3rd

(*This video includes 3 talks and 1 discussion for Day2.)
Time: 1:30 p.m. – 3:30 p.m. (JST)

00:00:07 Speaker: Hiroshi Nakagawa
Title: How to live together with ChatGPT?

00:27:06 Speaker: Hiroki Teranishi
Title: How to train large language models on the example of GPT3 (LLaMA)

00:56:05 Speaker: Yuji Matsumoto
Title: Instruct GTP and the role of experts feedback (via RL) – example ChatGPT/GPT4

01:43:24 Moderator: Koiti Hasida
Title: Open Discussion on the Future of AI (AGI) and Humanity