Surprising Advances in Generative Artificial Intelligence Prompt Amazement—and Worries

Dana Mackenzie

doi:10.1016/j.eng.2023.04.004

PDF(529 KB)

Engineering ›› 2023, Vol. 25 ›› Issue (6) : 9-11. DOI: 10.1016/j.eng.2023.04.004

News & Highlights

Surprising Advances in Generative Artificial Intelligence Prompt Amazement—and Worries

Dana Mackenzie

Author information +

History +

Cite this article

EndNote

Ris (Procite)

Bibtex

Download citation ▾

Dana Mackenzie. Surprising Advances in Generative Artificial Intelligence Prompt Amazement—and Worries. Engineering, 2023, 25(6): 9‒11 https://doi.org/10.1016/j.eng.2023.04.004

References

Publishing order | Descend order by publishing year | Descend order by cited within

[1]	Turing AM. Computing machinery and intelligence. Mind 1950;29(236):433‒60.

[2]	Huang K. Alarmed by AI chatbots, universities start revamping how they teach [Internet]. New York City: The New York Times; 2023 Jan 16 [cited 2023 Feb 20]. Available from: https://www.nytimes.com/2023/01/16/technology/chatgpt-artificial-intelligence-universities.html.

[3]	Klein E, Marcus G. Transcript: Ezra Klein interviews Gary Marcus [Internet]. New York City: The New York Times; 2023 Jan 6 [cited 2023 Feb 20]. Available from: https://www.nytimes.com/2023/01/06/podcasts/transcript-ezra-kleininterviews-gary-marcus.html.

[4]	Hu K. ChatGPT sets record for fastest-growing user base [Internet]. London: Reuters; 2023 Feb 2 [cited 2023 Mar 10]. Available from: https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analystnote-2023-02-01/.

[5]	Marcus G. How come GPT can seem so brilliant one minute and so breathtakingly dumb the next? [Internet]. Brooklyn: The Road to AI We Can All Trust; 2022 Dec 1 [cited 2023 Feb 20]. https://garymarcus.substack.com/p/how-come-gpt-can-seem-so-brilliant.

[6]

Ganguli D, Hernandez D, Lovitt L, Askell A, Bai Y, Chen A, et al. Predictability and surprise in large generative models. In: Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (ACM FaccT 2022); 2022 Jun 21‒24; Seoul, Republic of Korea. New York City: Association for Computing Machinery (ACM); 2022. p. 1747‒64.

[7]	Metz C, Grant N. Racing to catch up with ChatGPT, Google plans release of its own chatbot [Internet]. New York City: The New York Times; 2023 Feb 6 [cited 2023 Feb 20]. Available from: https://www.nytimes.com/2023/02/06/technology/google-bard-ai-chatbot.html.

[8]

Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. In: von Luxburg U, Guyon I, Bengio S, Wallach H, Fergus R, editors. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017); 2017 Dec 4‒9; Long Beach, CA, USA. Red Hook: Curran Associates Inc.; 2017.

[9]	Levy S. Welcome to the wet hot AI chatbot summer [Internet]. San Francisco: Wired; 2023 Jan 6 [cited 2023 Feb 20]. Available from: https://www.wired.com/story/plaintext-welcome-to-the-wet-hot-ai-chatbot-summer/.

[10]

Metz C, Weise K. Microsoft bets big on the creator of ChatGPT in race to dominate AI [Internet]. New York City: The New York Times; 2023 Jan 12 [cited 2023 Mar 16]. Available from: https://www.nytimes.com/2023/01/12/technology/microsoft-openai-chatgpt.html?action=click&module=RelatedLinks&pgtype=Article.

[11]	Metz C, Weise K. A tech race begins as Microsoft adds AI to its search engine [Internet]. New York City: The New York Times; 2023 Feb 7 [cited 2023 Feb 20]. Available from: https://www.nytimes.com/2023/02/07/technology/microsoft-ai-chatgpt-bing.html.

[12]	Marcus G. Why is Bing so reckless? [Internet]. New York City: Communications of the ACM; 2023 Feb 21 [cited 2023 Feb 26]. Available from: https://cacm.acm.org/blogs/blog-cacm/270134-why-is-bing-so-reckless/fulltext.

[13]	Heaven WD. GPT-4 is bigger and better than ChatGPT—but OpenAI won’t say why [Internet]. Madrid: MIT Technology Review; 2023 Mar 14 [cited 2023 Mar 16]. Available from: https://www.‍technologyreview.‍com/2023/03/14/1069823/gpt-4-is-bigger-and-better-chatgpt-openai.

[14]	Saha S. The battle for AI supremacy begins [Internet]. Bengaluru: Analytics India Magazine; 2023 Feb 7 [cited 2023 Mar 10]. Available from: https://analyticsindiamag.com/the-battle-for-ai-supremacy-begins/.

[15]	Roose K. Bing’s AI chat: “I want to be alive. [emoji]” [Internet]. New York City: The New York Times; 2023 Feb 16 [cited 2023 Feb 20]. Available from: https://www.nytimes.com/2023/02/16/technology/bing-chatbot-transcript.html.

[16]	Huang K. Microsoft to limit length of Bing chatbot conversations [Internet]. New York City: The New York Times; 2022 Feb 17 [cited 2023 Mar 10]. Available from: https://www.‍nytimes.‍com/2023/02/17/technology/microsoftbing-chatbot-limits.html.

[17]	Open AI. Charter [Internet]. San Francisco: OpenAI; [cited 2023 Mar 10] Available from: https://openai.com/charter.

[18]

Bender EM, Gebru T, McMillan-Major A, Shmitchell S. On the dangers of stochastic parrots: can language models be too big? In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency; 2021 Mar 3‒10; online. New York City: Association for Computing Machinery (ACM); 2021. p. 610‒23.

[19]	Coghlan J. Ripple CTO shuts down ChatGPT’s XRP conspiracy theory [Internet]. Brooklyn: Cointelegraph; 2022 Dec 6 [cited 2023 Feb 20]. Available from: https://cointelegraph.‍com/news/ripple-cto-shuts-down-xrp-conspiracy-theoryfrom-chatgpt.

[20]	Heaven WD. Why Meta’s latest large language model survived only three days online [Internet]. Madrid: MIT Technology Review; 2022 Nov 18 [cited 2023 Feb 20]. Available from: https://www.‍technologyreview.‍com/2022/11/18/1063487/meta-large-language-model-ai-only-survived-three-days-gpt-3-science/.

[21]

Lin S, Hilton J, Evans O. Truthful QA: measuring how models mimic human falsehoods. In: MuresanS, NakovP, VillavicencioA, editors. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics; 2022 May 22‍‒‍27; Dublin, Ireland. Stroudsburg: Association for Computational Linguistics; 2022. p. 3214‒52.

[22]	Aaronson S. My AI safety lecture for UT effective altruism [Internet]. Austin: Shtetl-Optimized; 2022 Nov 8 [cited 2023 Feb 20]. Available from: https://scottaaronson.blog/?m=202211.

[23]	Kirchenbauer J, Geiping J, Wen Y, Katz J, Miers I, Goldstein T. A watermark for large language models. 2023. arXiv:2301.10226.

[24]	Kirchner JH, Ahmad L, Aaronson S, Leike J. New AI classifier for indicating AIwritten text [Internet]. San Francisco: OpenAI; 2023 Jan 31 [cited 2023 Feb 20] Available from: https://openai.‍com/blog/new-ai-classifier-for-indicating-aiwritten-text/.

[25]

Drake M, Ong J, Hansen M, Peets L. EU AI policy and regulation: what to look out for in 2023 [Internet]. San Francisco: Covington Inside Privacy; 2023 Feb 2 [cited 2023 Mar 11]. Available from: https://www.insideprivacy.com/artificial-intelligence/eu-ai-policy-and-regulation-what-to-look-out-for-in-2023/.

[26]	Gold A. AI rockets ahead in vacuum of U.S. regulation [Internet]. Arlington: Axios; 2023 Jan 30 [cited 2023 Mar 11]. Available from: https://www.axios.com/2023/01/30/ai-chatgpt-regulation-laws.