GPT-4o System Card

作者：OpenAI, :, Aaron M. Hurst, Adam K. Lerer, Adam P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, Aleksander Mądry, Alex Baker-Whitcomb, Alex Beutel, Alex Borzunov, Alex Carney, Chow, Alex, Kirillov, Alex, Alex Nichol, Alex Paino, Alex Renzin, Alex Tachard Passos, Kirillov, Alexander, Alexi Christakis, Alexis Conneau, Ali Reza Kamali, Allan Jabri, Allison F. Moyer, Allison Tam, Amadou Crookes, Amin Tootoochian, Amin Tootoonchian, Ananya Kumar, Andrea Vallone, Andrej Karpathy, Andrew Braunstein, A Mc Cann, Andrew Codispoti, Andrew Galu, Andrew Kondrich, Andrew Tulloch, Mishchenko, Andrey, Baek, Angela, Angela Jiang, Antoine Pelisse, Antonia Woodford, Anuj Gosalia, Dhar, Arka, Ashley Pantuliano, Nayak, Avi, Avital Oliver, Barret Zoph, Behrooz Ghorbani, Ben Leimberger, Ben Rossen, Ben Sokolowsky, Ben Wang, Benjamin Zweig, Hoover, Beth, Blake Samic, Bob McGrew, Bobby Spero, Bogo Giertler, Cheng, Bowen, Brad Lightcap, Brandon Walkin, Quinn, Brendan, Brian Guarraci, Brian Hsu, Bright Kellogg, Brydon Eastman, Camillo Lugaresi, Carroll L. Wainwright, Cary Bassin, Hudson, Cary, Casey Chu, Nelson, Chad, Chak Li, Chan Jun Shern, Channing Conger, Charlotte Barette, Chelsea Voss, Chen Ding, Lu, Cheng, Chong Zhang, Beaumont, Chris, Chris Hallacy, Christopher Koch, Gibson, Christian, Christina Kim, Choi, Christine, Christine McLeavey, Christopher Hesse, Fischer, Claudia, Clemens Winter, Coley Czarnecki, Jarvis, Colin, Colin Wei, Constantin Koumouzelis, Dane Sherburn, Daniel Kappler, Levin, Daniel, Levy, Daniel, David John Carr, David Farhi, David Mely, David Robinson, Sasaki, David, Jin, Denny, D. Torres Valladares, Dimitris Tsipras, Doug Li, Nguyen, Duc Phong, Findlay, Duncan, Edede Oiwoh, Edmund L. Wong, Ehsan Asdar, Elizabeth Proehl, Yang, Elizabeth, Eric Antonow, Kramer, Eric, Eric R. Peterson, Eric J. Sigler, Eric W. Wallace, Eugene Brevdo, Evan Mays, Farzad Khorasani, Felipe Petroski Such, Filippo A. Raso, Zhang, Francis, Fred von Lohmann, Freddie Sulit, Gabriel Goh, Gene Oden, Geoff Salmon, Giulio Starace, Greg Brockman, Hadi Salman, Bao, Haiming, Haitang Hu, Wong, Hannah, Haoyu Wang, Heather K. Schmidt, Heather M. Whitney, Heewoo Jun, H ne Kirchner, Henrique Pondé de Oliveira Pinto, Hong‐Yu Ren, Hui‐Wen Chang, Hyung Won Chung, Ian Kivlichan, Ian O'Connell, Ian O'Connell, Ian Osband, Ian Silber, Ian Sohl, Ibrahim Okuyucu, Ikai Lan, Ilya Kostrikov, Ilya Sutskever, Ingmar Kanitscheider, Ishaan Gulrajani, Coxon, Jacob, Jacob Menick, Jakub Pachocki, James Aung, James Betker, James Crooks, James Lennon, Jamie Kiros, Jan Leike, Jane Park, Kwon, Jason, Jason Phang, Jason Teplitz, Jason Wei, J. Alan Wolfe, Jay Chen, Harris, Jeff, Jenia Varavva, Lee, Jessica Gan, Shieh, Jessica, Ji Lin, Jiahui Yu, Jiayi Weng, Jie Tang, Yu, Jieqi, Joanne Wei-un Jang, Joaquin Quiñonero Candela, Joe Beutler, Joe Landers, J. G. Parish, Johannes Heidecke, John Schulman, Jonathan Lachman, McKay, Jonathan, Jonathan Uesato, Ward, Jonathan, Jong Wook Kim, Joost Huizinga, Jordan Sitkin, Jos Kraaijeveld, Josh Gross, Kaplan, Josh, Josh Snyder, Joshua Achiam, Jiao, Joy, Joyce S. Lee, Juntang Zhuang, Harriman, Justyn, K. H. Fricke, Hayashi, Kai, Karan Singhal, Shi, Katy, Karthik, Kavin, Wood, Kayla, Kendra Rimbach, Kenny Hsu, Kenny Nguyen, Keren Gu-Lemberg, Kevin Button, Kevin Liu, Kiel Howe, Krithika Muthukumar, Kyle Luther, Lama Ahmad, Larry Kai, Lauren Itow, Lauren M. Workman, Pathak, Leher, Yi Chen, Jing, Li, Guy, Lia, Liam Fedus, Liang Dao Zhou, Lien Mamitsuka, Lilian Weng, Lindsay McCallum, Lindsey Held, Long Ouyang, Louis Feuvrier, Lu Zhang, Lukas Kondraciuk, Łukasz Kaiser, Hewitt, Luke, Luke Metz, Lyric Doshi, Mada Aflak, Maddie Simens, Boyd, Madelaine, Madeleine Thompson, Marat Dukhan, Mark Chen, Mark Gray, Mark Hudnall, Marvin Zhang, Marwan Aljubeh, Mateusz Litwin, Zeng, Matthew, Johnson, Max, Shetty, Maya, Mayank Gupta, Meghan Shah, Mehmet Yatbaz, Meng Yang, Zhong, Mengchao, Mia Glaese, Mianna Chen, Michael Jänner, Lampe, Michael, Michael Petrov, Michael P. Wu, Michele Wang, Michelle Fradin, Michelle Pokrass, Miguel Castro, de Castro, Miguel Oom Temudo, Mikhail Pavlov, Miles Brundage, Miles Wang, Khan, Minal, Mira Murati, Mo Bavarian, Lin, Molly, Murat Yesildal, Natacha Aguilar de Soto, Natalia Gimelshein, Natalie Cone, Natalie Staudacher, Summers, Natalie, Natan LaFontaine, Neil Chowdhury, Nick Ryder, Nick Stathas, Nick Turley, Nikolas Tezak, Niko Felix, Nithanth Kudige, Nitish Shirish Keskar, Noah Deutsch, Noel Bundick, Nora Puckett, Ofir Nachum, Ola Okelola, Oleg Boiko, Oleg Mürk, Oliver Jaffe, Olivia Watkins, Olivier Godement, Owen Campbell-Moore, Chao, Patrick, Paul J. McMillan, P. Belov, Su, Peng, Peter Bak, Peter Bakkum, Deng, Peter, Dolan, Peter, Peter Hoeschele, Peter Welinder, Phil Tillet, Philip Pronin, Philippe Tillet, Prafulla Dhariwal, Yuan, Qiming, Dias, Rachel, Rachel Su Ann Lim, Rahul Arora, Rajan Troll, Lin, Randall, Lopes, Rapha Gontijo, Raul Puri, Reah Miyara, Reimar Leike, Renaud Gaubert, Reza Zamani, Wang, Ricky, Rob Donnelly, Rob Honsby, Smith, Rocky, Sahai, Rohan, Ramchandani, Rohit, Romain Huet, Carmichael, Rory, Rowan Zellers, Chen, Roy, R.Y. Chen, Ruslan Ramilevich Nigmatullin, Ryan Cheu, Saachi Jain, Altman, Sam, Samuel S. Schoenholz, Sam Toizer, Samuel Miserendino, Sandhini Agarwal, Culver, Sara, Scott Ethersmith, Scott Gray, Grove, Sean, Sean Metzger, Shamez Hermani, Shantanu Jain, Zhao, Shengjia, Shengzhang Wu, Shino Jomoto, Shirong Wu, Shuaiqi, Xia, Sonia Phene, Spencer Papay, Narayanan, Srinivas, Steven W. Coffey, Lee, Steve, Hall, Stewart, Suchir Balaji, Tal Broda, Tal Stramer, Tao Xu, Tarun Gogineni, Taya Christianson, Sanders, Ted, Tejal Patwardhan, Thomas Cunninghman, Thomas Degry, Thomas Dimson, Thomas Raoux, Thomas Shadwell, Zheng, Tianhao, Todd J. Underwood, Todor Markov, Toki Sherbakov, Tom Rubin, Tom Stasi, Tomer Kaftan, Tristan Heywood, Peterson, Troy, Tyce Walters, Tyna Eloundou, Valerie Qi, V. Moeller, Monaco, Vinnie, Venus Kuo, Vlad Fomenko, Wayne H. Chang, Zheng, Weiyi, Wen‐Da Zhou, Wesam Manassra, William Sheu, Wojciech Zaremba, Yash Patil, Yilei Qian, Yongjik Kim, Youlong Cheng, Yu Zhang, Yuchen He, Yuchen Zhang, Yujia Jin, Dai, Yunxing, Yu. F. Malkov · 发表于：arXiv (Cornell University) · 年份：2024 · DOI：10.48550/arxiv.2410.21276 · 被引用次数：165 · 研究领域：Cardiovascular Function and Risk Factors、Hyperglycemia and glycemic control in critically ill and hospitalized patients

GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation. It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50\% cheaper in the API. GPT-4o is especially better at vision and audio understanding compared to existing models. In line with our commitment to building AI safely and consistent with our voluntary commitments to the White House, we are sharing the GPT-4o System Card, which includes our Preparedness Framework evaluations. In this System Card, we provide a detailed look at GPT-4o's capabilities, limitations, and safety evaluations across multiple categories, focusing on speech-to-speech while also evaluating text and image capabilities, and measures we've implemented to ensure the model is safe and aligned. We also include third-party assessments on dangerous capabilities, as well as discussion of potential societal impacts of GPT-4o's text and vision capabilities.