Trading Inference-Time Compute for Adversarial Robustness

Authors: Zaremba, Wojciech, Nitishinskaya, Evgenia, Barak, Boaz, Lin, Stephanie, Toyer, Sam, Yu, Yaodong, Dias, Rachel, Wallace, Eric, Xiao, Kai, Heidecke, Johannes, Glaese, Amelia

Subject Terms: Computer Science - Machine Learning, Computer Science - Cryptography and Security

Access URL: http://arxiv.org/abs/2501.18841

OpenAI o1 System Card

Authors: OpenAI, Jaech, Aaron, Kalai, Adam, Lerer, Adam, Richardson, Adam, El-Kishky, Ahmed, Low, Aiden, Helyar, Alec, Madry, Aleksander, Beutel, Alex, Carney, Alex, Iftimie, Alex, Karpenko, Alex, Passos, Alex Tachard, Neitz, Alexander, Prokofiev, Alexander, Wei, Alexander, Tam, Allison, Bennett, Ally, Kumar, Ananya, Saraiva, Andre, Vallone, Andrea, Duberstein, Andrew, Kondrich, Andrew, Mishchenko, Andrey, Applebaum, Andy, Jiang, Angela, Nair, Ashvin, Zoph, Barret, Ghorbani, Behrooz, Rossen, Ben, Sokolowsky, Benjamin, Barak, Boaz, McGrew, Bob, Minaiev, Borys, Hao, Botao, Baker, Bowen, Houghton, Brandon, McKinzie, Brandon, Eastman, Brydon, Lugaresi, Camillo, Bassin, Cary, Hudson, Cary, Li, Chak Ming, de Bourcy, Charles, Voss, Chelsea, Shen, Chen, Zhang, Chong, Koch, Chris, Orsinger, Chris, Hesse, Christopher, Fischer, Claudia, Chan, Clive, Roberts, Dan, Kappler, Daniel, Levy, Daniel, Selsam, Daniel, Dohan, David, Farhi, David, Mely, David, Robinson, David, Tsipras, Dimitris, Li, Doug, Oprica, Dragos, Freeman, Eben, Zhang, Eddie, Wong, Edmund, Proehl, Elizabeth, Cheung, Enoch, Mitchell, Eric, Wallace, Eric, Ritter, Erik, Mays, Evan, Wang, Fan, Such, Felipe Petroski, Raso, Filippo, Leoni, Florencia, Tsimpourlas, Foivos, Song, Francis, von Lohmann, Fred, Sulit, Freddie, Salmon, Geoff, Parascandolo, Giambattista, Chabot, Gildas, Zhao, Grace, Brockman, Greg, Leclerc, Guillaume, Salman, Hadi, Bao, Haiming, Sheng, Hao, Andrin, Hart, Bagherinezhad, Hessam, Ren, Hongyu, Lightman, Hunter, Chung, Hyung Won, Kivlichan, Ian, O'Connell, Ian, Osband, Ian, Gilaberte, Ignasi Clavera, Akkaya, Ilge, Kostrikov, Ilya, Sutskever, Ilya, Kofman, Irina, Pachocki, Jakub, Lennon, James, Wei, Jason, Harb, Jean, Twore, Jerry, Feng, Jiacheng, Yu, Jiahui, Weng, Jiayi, Tang, Jie, Yu, Jieqi, Candela, Joaquin Quiñonero, Palermo, Joe, Parish, Joel, Heidecke, Johannes, Hallman, John, Rizzo, John, Gordon, Jonathan, Uesato, Jonathan, Ward, Jonathan, Huizinga, Joost, Wang, Julie, Chen, Kai, Xiao, Kai, Singhal, Karan, Nguyen, Karina, Cobbe, Karl, Shi, Katy, Wood, Kayla, Rimbach, Kendra, Gu-Lemberg, Keren, Liu, Kevin, Lu, Kevin, Stone, Kevin, Yu, Kevin, Ahmad, Lama, Yang, Lauren, Liu, Leo, Maksin, Leon, Ho, Leyton, Fedus, Liam, Weng, Lilian, Li, Linden, McCallum, Lindsay, Held, Lindsey, Kuhn, Lorenz, Kondraciuk, Lukas, Kaiser, Lukasz, Metz, Luke, Boyd, Madelaine, Trebacz, Maja, Joglekar, Manas, Chen, Mark, Tintor, Marko, Meyer, Mason, Jones, Matt, Kaufer, Matt, Schwarzer, Max, Shah, Meghan, Yatbaz, Mehmet, Guan, Melody Y., Xu, Mengyuan, Yan, Mengyuan, Glaese, Mia, Chen, Mianna, Lampe, Michael, Malek, Michael, Wang, Michele, Fradin, Michelle, McClay, Mike, Pavlov, Mikhail, Wang, Miles, Wang, Mingxuan, Murati, Mira, Bavarian, Mo, Rohaninejad, Mostafa, McAleese, Nat, Chowdhury, Neil, Ryder, Nick, Tezak, Nikolas, Brown, Noam, Nachum, Ofir, Boiko, Oleg, Murk, Oleg, Watkins, Olivia, Chao, Patrick, Ashbourne, Paul, Izmailov, Pavel, Zhokhov, Peter, Dias, Rachel, Arora, Rahul, Lin, Randall, Lopes, Rapha Gontijo, Gaon, Raz, Miyara, Reah, Leike, Reimar, Hwang, Renny, Garg, Rhythm, Brown, Robin, James, Roshan, Shu, Rui, Cheu, Ryan, Greene, Ryan, Jain, Saachi, Altman, Sam, Toizer, Sam, Toyer, Sam, Miserendino, Samuel, Agarwal, Sandhini, Hernandez, Santiago, Baker, Sasha, McKinney, Scott, Yan, Scottie, Zhao, Shengjia, Hu, Shengli, Santurkar, Shibani, Chaudhuri, Shraman Ray, Zhang, Shuyuan, Fu, Siyuan, Papay, Spencer, Lin, Steph, Balaji, Suchir, Sanjeev, Suvansh, Sidor, Szymon, Broda, Tal, Clark, Aidan, Wang, Tao, Gordon, Taylor, Sanders, Ted, Patwardhan, Tejal, Sottiaux, Thibault, Degry, Thomas, Dimson, Thomas, Zheng, Tianhao, Garipov, Timur, Stasi, Tom, Bansal, Trapit, Creech, Trevor, Peterson, Troy, Eloundou, Tyna, Qi, Valerie, Kosaraju, Vineet, Monaco, Vinnie, Pong, Vitchyr, Fomenko, Vlad, Zheng, Weiyi, Zhou, Wenda, McCabe, Wes, Zaremba, Wojciech, Dubois, Yann, Lu, Yinghai, Chen, Yining, Cha, Young, Bai, Yu, He, Yuchen, Zhang, Yuchen, Wang, Yunyun, Shao, Zheng, Li, Zhuohan

Subject Terms: Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2412.16720

Deliberative Alignment: Reasoning Enables Safer Language Models

Authors: Guan, Melody Y., Joglekar, Manas, Wallace, Eric, Jain, Saachi, Barak, Boaz, Helyar, Alec, Dias, Rachel, Vallone, Andrea, Ren, Hongyu, Wei, Jason, Chung, Hyung Won, Toyer, Sam, Heidecke, Johannes, Beutel, Alex, Glaese, Amelia

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Computers and Society, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2412.16339

An Economic Solution to Copyright Challenges of Generative AI

Authors: Wang, Jiachen T., Deng, Zhun, Chiba-Okabe, Hiroaki, Barak, Boaz, Su, Weijie J.

Subject Terms: Computer Science - Machine Learning, Economics - General Economics, Statistics - Methodology

Access URL: http://arxiv.org/abs/2404.13964

Distinguishing the Knowable from the Unknowable with Language Models

Authors: Ahdritz, Gustaf, Qin, Tian, Vyas, Nikhil, Barak, Boaz, Edelman, Benjamin L.

Subject Terms: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.03563

Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models

Authors: Zhang, Hanlin, Edelman, Benjamin L., Francati, Danilo, Venturi, Daniele, Ateniese, Giuseppe, Barak, Boaz

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language, Computer Science - Cryptography and Security

Access URL: http://arxiv.org/abs/2311.04378

On the works of Avi Wigderson

Authors: Barak, Boaz, Kalai, Yael, Raz, Ran, Vadhan, Salil, Vishnoi, Nisheeth K.

Subject Terms: Computer Science - Computational Complexity, Mathematics - History and Overview

Access URL: http://arxiv.org/abs/2307.09524

Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning

Authors: Vyas, Nikhil, Morwani, Depen, Zhao, Rosie, Kaplun, Gal, Kakade, Sham, Barak, Boaz

Subject Terms: Computer Science - Machine Learning, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2306.08590

Scaling Data-Constrained Language Models

Authors: Muennighoff, Niklas, Rush, Alexander M., Barak, Boaz, Scao, Teven Le, Piktus, Aleksandra, Tazi, Nouamane, Pyysalo, Sampo, Wolf, Thomas, Raffel, Colin

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2305.16264

On Provable Copyright Protection for Generative Models

Authors: Vyas, Nikhil, Kakade, Sham, Barak, Boaz

Subject Terms: Computer Science - Machine Learning, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2302.10870

Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit

Authors: Barak, Boaz, Edelman, Benjamin L., Goel, Surbhi, Kakade, Sham, Malach, Eran, Zhang, Cyril

Subject Terms: Computer Science - Machine Learning, Computer Science - Neural and Evolutionary Computing, Mathematics - Optimization and Control, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2207.08799

Deconstructing Distributions: A Pointwise Framework of Learning

Authors: Kaplun, Gal, Ghosh, Nikhil, Garg, Saurabh, Barak, Boaz, Nakkiran, Preetum

Subject Terms: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2202.09931

Quantum Optimization of Maximum Independent Set using Rydberg Atom Arrays

Authors: Ebadi, Sepehr, Keesling, Alexander, Cain, Madelyn, Wang, Tout T., Levine, Harry, Bluvstein, Dolev, Semeghini, Giulia, Omran, Ahmed, Liu, Jinguo, Samajdar, Rhine, Luo, Xiu-Zhe, Nash, Beatrice, Gao, Xun, Barak, Boaz, Farhi, Edward, Sachdev, Subir, Gemelke, Nathan, Zhou, Leo, Choi, Soonwon, Pichler, Hannes, Wang, Shengtao, Greiner, Markus, Vuletic, Vladan, Lukin, Mikhail D.

Source: Science 376, 1209 (2022)

Subject Terms: Quantum Physics, Condensed Matter - Disordered Systems and Neural Networks, Condensed Matter - Quantum Gases, Physics - Atomic Physics

Access URL: http://arxiv.org/abs/2202.09372

Limitations of Linear Cross-Entropy as a Measure for Quantum Advantage

Authors: Gao, Xun, Kalinowski, Marcin, Chou, Chi-Ning, Lukin, Mikhail D., Barak, Boaz, Choi, Soonwon

Subject Terms: Quantum Physics, Condensed Matter - Statistical Mechanics, Computer Science - Computational Complexity

Access URL: http://arxiv.org/abs/2112.01657

Revisiting Model Stitching to Compare Neural Representations

Authors: Bansal, Yamini, Nakkiran, Preetum, Barak, Boaz

Subject Terms: Computer Science - Machine Learning, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2106.07682

Classical algorithms and quantum limitations for maximum cut on high-girth graphs

Authors: Barak, Boaz, Marwaha, Kunal

Source: 13th Innovations in Theoretical Computer Science Conference (ITCS 2022); Article No. 14

Subject Terms: Quantum Physics, Computer Science - Data Structures and Algorithms

Access URL: http://arxiv.org/abs/2106.05900

Tackling myelin deficits in neurodevelopmental disorders using drug delivery systems

Authors: Rokach, May, Portioli, Corinne, Brahmachari, Sayanti, Estevão, Bianca Martins, Decuzzi, Paolo, Barak, Boaz

Source: In Advanced Drug Delivery Reviews April 2024 207

Named Tensor Notation

Authors: Chiang, David, Rush, Alexander M., Barak, Boaz

Source: TMLR, January 2023

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2102.13196

For self-supervised learning, Rationality implies generalization, provably

Authors: Bansal, Yamini, Kaplun, Gal, Barak, Boaz

Subject Terms: Computer Science - Machine Learning, Computer Science - Neural and Evolutionary Computing, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2010.08508

Optimizing testing policies for detecting COVID-19 outbreaks

Authors: Yuval, Janni, Nitzan, Mor, Tannenbaum, Neta Ravid, Barak, Boaz

Subject Terms: Physics - Physics and Society, Quantitative Biology - Populations and Evolution

Access URL: http://arxiv.org/abs/2007.04827