2024, Volume 34, Issue 3
Engineering >> 2024, Volume 34, Issue 3 doi: 10.1016/j.eng.2023.07.006
The Tong Test: Evaluating Artificial General Intelligence Through Dynamic Embodied Physical and Social Interactions
a National Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence, Beijing 100086, China
b Institute for Artificial Intelligence, Peking University, Beijing 100871, China
c Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences,Peking University, Beijing 100871, China
d School of Intelligence Science and Technology, Peking University, Beijing 100871, China
e School of Computer Science, Peking University, Beijing 100871, China
Next Previous
Abstract
The release of the generative pre-trained transformer (GPT) series has brought artificial general intelligence (AGI) to the forefront of the artificial intelligence (AI) field once again. However, the questions of how to define and evaluate AGI remain unclear. This perspective article proposes that the evaluation of AGI should be rooted in dynamic embodied physical and social interactions (DEPSI). More specifically, we propose five critical characteristics to be considered as AGI benchmarks and suggest the Tong test as an AGI evaluation system. The Tong test describes a value- and ability-oriented testing system that delineates five levels of AGI milestones through a virtual environment with DEPSI, allowing for infinite task generation. We contrast the Tong test with classical AI testing systems in terms of various aspects and propose a systematic evaluation system to promote standardized, quantitative, and objective benchmarks and evaluation of AGI.
京公网安备 11010502051620号
