Phi-4 Technical Report

Authors: Abdin, Marah, Aneja, Jyoti, Behl, Harkirat, Bubeck, Sébastien, Eldan, Ronen, Gunasekar, Suriya, Harrison, Michael, Hewett, Russell J., Javaheripi, Mojan, Kauffmann, Piero, Lee, James R., Lee, Yin Tat, Li, Yuanzhi, Liu, Weishung, Mendes, Caio C. T., Nguyen, Anh, Price, Eric, de Rosa, Gustavo, Saarikivi, Olli, Salim, Adil, Shah, Shital, Wang, Xin, Ward, Rachel, Wu, Yue, Yu, Dingli, Zhang, Cyril, Zhang, Yi

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2412.08905

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Authors: Abdin, Marah, Aneja, Jyoti, Awadalla, Hany, Awadallah, Ahmed, Awan, Ammar Ahmad, Bach, Nguyen, Bahree, Amit, Bakhtiari, Arash, Bao, Jianmin, Behl, Harkirat, Benhaim, Alon, Bilenko, Misha, Bjorck, Johan, Bubeck, Sébastien, Cai, Martin, Cai, Qin, Chaudhary, Vishrav, Chen, Dong, Chen, Dongdong, Chen, Weizhu, Chen, Yen-Chun, Chen, Yi-Ling, Cheng, Hao, Chopra, Parul, Dai, Xiyang, Dixon, Matthew, Eldan, Ronen, Fragoso, Victor, Gao, Jianfeng, Gao, Mei, Gao, Min, Garg, Amit, Del Giorno, Allie, Goswami, Abhishek, Gunasekar, Suriya, Haider, Emman, Hao, Junheng, Hewett, Russell J., Hu, Wenxiang, Huynh, Jamie, Iter, Dan, Jacobs, Sam Ade, Javaheripi, Mojan, Jin, Xin, Karampatziakis, Nikos, Kauffmann, Piero, Khademi, Mahoud, Kim, Dongwoo, Kim, Young Jin, Kurilenko, Lev, Lee, James R., Lee, Yin Tat, Li, Yuanzhi, Li, Yunsheng, Liang, Chen, Liden, Lars, Lin, Xihui, Lin, Zeqi, Liu, Ce, Liu, Liyuan, Liu, Mengchen, Liu, Weishung, Liu, Xiaodong, Luo, Chong, Madan, Piyush, Mahmoudzadeh, Ali, Majercak, David, Mazzola, Matt, Mendes, Caio César Teodoro, Mitra, Arindam, Modi, Hardik, Nguyen, Anh, Norick, Brandon, Patra, Barun, Perez-Becker, Daniel, Portet, Thomas, Pryzant, Reid, Qin, Heyang, Radmilac, Marko, Ren, Liliang, de Rosa, Gustavo, Rosset, Corby, Roy, Sambudha, Ruwase, Olatunji, Saarikivi, Olli, Saied, Amin, Salim, Adil, Santacroce, Michael, Shah, Shital, Shang, Ning, Sharma, Hiteshi, Shen, Yelong, Shukla, Swadheen, Song, Xia, Tanaka, Masahiro, Tupini, Andrea, Vaddamanu, Praneetha, Wang, Chunyu, Wang, Guanhua, Wang, Lijuan, Wang, Shuohang, Wang, Xin, Wang, Yu, Ward, Rachel, Wen, Wen, Witte, Philipp, Wu, Haiping, Wu, Xiaoxia, Wyatt, Michael, Xiao, Bin, Xu, Can, Xu, Jiahang, Xu, Weijian, Xue, Jilong, Yadav, Sonali, Yang, Fan, Yang, Jianwei, Yang, Yifan, Yang, Ziyi, Yu, Donghan, Yuan, Lu, Zhang, Chenruidong, Zhang, Cyril, Zhang, Jianwen, Zhang, Li Lyna, Zhang, Yi, Zhang, Yue, Zhang, Yunan, Zhou, Xiren

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2404.14219

Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack

Authors: Russinovich, Mark, Salem, Ahmed, Eldan, Ronen

Subject Terms: Computer Science - Cryptography and Security, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2404.01833

Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains (extended abstract)

Authors: Chen, Yuansi, Eldan, Ronen

Source: 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS) FOCS Foundations of Computer Science (FOCS), 2022 IEEE 63rd Annual Symposium on. :110-122 Oct, 2022

Relation: 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS)

TinyGSM: achieving >80% on GSM8k with small language models

Authors: Liu, Bingbin, Bubeck, Sebastien, Eldan, Ronen, Kulkarni, Janardhan, Li, Yuanzhi, Nguyen, Anh, Ward, Rachel, Zhang, Yi

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2312.09241

Fast relaxation of the random field Ising dynamics

Authors: Alaoui, Ahmed El, Eldan, Ronen, Gheissari, Reza, Piana, Arianna

Subject Terms: Mathematics - Probability, Computer Science - Data Structures and Algorithms, Mathematical Physics

Access URL: http://arxiv.org/abs/2311.06171

Who's Harry Potter? Approximate Unlearning in LLMs

Authors: Eldan, Ronen, Russinovich, Mark

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2310.02238

Textbooks Are All You Need II: phi-1.5 technical report

Authors: Li, Yuanzhi, Bubeck, Sébastien, Eldan, Ronen, Del Giorno, Allie, Gunasekar, Suriya, Lee, Yin Tat

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2309.05463

Textbooks Are All You Need

Authors: Gunasekar, Suriya, Zhang, Yi, Aneja, Jyoti, Mendes, Caio César Teodoro, Del Giorno, Allie, Gopi, Sivakanth, Javaheripi, Mojan, Kauffmann, Piero, de Rosa, Gustavo, Saarikivi, Olli, Salim, Adil, Shah, Shital, Behl, Harkirat Singh, Wang, Xin, Bubeck, Sébastien, Eldan, Ronen, Kalai, Adam Tauman, Lee, Yin Tat, Li, Yuanzhi

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2306.11644

TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

Authors: Eldan, Ronen, Li, Yuanzhi

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2305.07759

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Authors: Bubeck, Sébastien, Chandrasekaran, Varun, Eldan, Ronen, Gehrke, Johannes, Horvitz, Eric, Kamar, Ece, Lee, Peter, Lee, Yin Tat, Li, Yuanzhi, Lundberg, Scott, Nori, Harsha, Palangi, Hamid, Ribeiro, Marco Tulio, Zhang, Yi

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2303.12712

Hit-and-run mixing via localization schemes

Authors: Chen, Yuansi, Eldan, Ronen

Subject Terms: Mathematics - Probability, Computer Science - Computational Complexity, Statistics - Computation

Access URL: http://arxiv.org/abs/2212.00297

Noise stability on the Boolean hypercube via a renormalized Brownian motion

Authors: Eldan, Ronen, Mikulincer, Dan, Raghavendra, Prasad

Subject Terms: Mathematics - Probability, Computer Science - Information Theory, Mathematics - Functional Analysis

Access URL: http://arxiv.org/abs/2208.06508

An Optimal 'It Ain't Over Till It's Over' Theorem

Authors: Eldan, Ronen, Wigderson, Avi, Wu, Pei

Subject Terms: Computer Science - Computational Complexity, Computer Science - Discrete Mathematics, Mathematics - Probability

Access URL: http://arxiv.org/abs/2208.03450

Unveiling Transformers with LEGO: a synthetic reasoning task

Authors: Zhang, Yi, Backurs, Arturs, Bubeck, Sébastien, Eldan, Ronen, Gunasekar, Suriya, Wagner, Tal

Subject Terms: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2206.04301

Isoperimetric Inequalities Made Simpler

Authors: Eldan, Ronen, Kindler, Guy, Lifshitz, Noam, Minzer, Dor

Subject Terms: Mathematics - Combinatorics, Computer Science - Discrete Mathematics

Access URL: http://arxiv.org/abs/2204.06686

Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains

Authors: Chen, Yuansi, Eldan, Ronen

Subject Terms: Mathematics - Probability, Computer Science - Data Structures and Algorithms, Mathematical Physics, Statistics - Computation

Access URL: http://arxiv.org/abs/2203.04163

Non-asymptotic approximations of neural networks by Gaussian processes

Authors: Eldan, Ronen, Mikulincer, Dan, Schramm, Tselil

Subject Terms: Mathematics - Probability, Computer Science - Machine Learning, Statistics - Machine Learning

Access URL: http://arxiv.org/abs/2102.08668

Log concavity and concentration of Lipschitz functions on the Boolean hypercube

Authors: Eldan, Ronen, Shamir, Omer

Subject Terms: Mathematics - Probability, Mathematics - Combinatorics, Mathematics - Functional Analysis

Access URL: http://arxiv.org/abs/2007.13108

A Spectral Condition for Spectral Gap: Fast Mixing in High-Temperature Ising Models

Authors: Eldan, Ronen, Koehler, Frederic, Zeitouni, Ofer

Subject Terms: Mathematics - Probability, Mathematical Physics, Mathematics - Functional Analysis

Access URL: http://arxiv.org/abs/2007.08200