Artificial intelligence\u00a0models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best\u00a0\u2014 and who decides that?\u00a0Arena, formerly LM Arena, has\u00a0emerged\u00a0as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a\u00a0UC\u00a0Berkeley PhD research project to\u00a0being valued at\u00a0$1.7 billion.\u00a0<\/p>\n
Watch as Equity\u00a0host\u00a0Rebecca Bellan catches up with Arena co-founders\u00a0Anastasios Angelopoulos\u00a0and\u00a0Wei-Lin Chiang\u00a0about how their platform became the go-to leaderboard for frontier AI models, and how they\u2019re trying to build a neutral benchmark even as companies like OpenAI, Google, and Anthropic back the project. <\/p>\n
Subscribe to Equity on\u00a0YouTube,\u00a0Apple Podcasts,\u00a0Overcast,\u00a0Spotify\u00a0and all the casts. You\u00a0also can\u00a0follow Equity on\u00a0X\u00a0and\u00a0Threads, at @EquityPod.<\/p>\n
Chapters: <\/p>\n
00:00 Intro <\/p>\n
03:00 How Arena’s leaderboard works, and why it’s different from static benchmarks <\/p>\n
07:00 Reproducibility concerns and how to scale <\/p>\n
08:45 Can Arena stay independent while taking money from the labs it ranks? <\/p>\n
11:15 Diversity, fraud prevention, and abuse mitigation <\/p>\n
18:15 Arena’s “data moat” <\/p>\n
19:20 Agent benchmarking and expert leaderboards <\/p>\n
21:40 Open sourcing data <\/p>\n
22:45 How do Arena’s rankings shape AI development? <\/p>\n
24:15 Outro<\/p>\n","protected":false},"excerpt":{"rendered":"
Artificial intelligence\u00a0models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be<\/p>\n","protected":false},"author":1,"featured_media":88005,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[12],"tags":[],"class_list":["post-87990","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science-technology"],"_links":{"self":[{"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/posts\/87990","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/comments?post=87990"}],"version-history":[{"count":0,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/posts\/87990\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/media\/88005"}],"wp:attachment":[{"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/media?parent=87990"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/categories?post=87990"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nicheblog.top\/news\/wp-json\/wp\/v2\/tags?post=87990"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}