Updates

lmgame-org · Feb 11, 2025 · b24dc21 · b24dc21
1 parent 739aa30
commit b24dc21
Show file tree

Hide file tree

Showing 9 changed files with 7 additions and 13 deletions.
diff --git a/blogs/ai_space_escape.md b/blogs/ai_space_escape.md
@@ -72,7 +72,7 @@ Static evaluations, such as MMLU, Spider, and HumanEval, offer capability-specif
 
 To address the challenges, Game Arena:
 
-- An incentivized, dynamic benchmark using live computer games to evaluate the interactive and strategic aspect of many other reasoning tasks required in real-life.
+- Introduces an incentivized, dynamic benchmark using live computer games to evaluate the interactive and strategic aspect of many other reasoning tasks required in real-life.
 
 - Involves three reasoning games, each target at different reasoning capabilities.
 
@@ -88,7 +88,6 @@ To address the challenges, Game Arena:
 
 Stay tuned and we will release more details about how we generated the leaderboard! 🔔
 
-
 ---
 
 ## Results
@@ -99,7 +98,7 @@ Stay tuned and we will release more details about how we generated the leaderboa
 
 Our evaluation results show the following findings:
 
-- Models with strong reasoning capabilities and multi-turn instruction-following capabilities, such as **claude-3.5-sonnet**, **gemini-2.0-flash-thinking-exp-01-21**, and **gemini-1.5-pro** are ranked high in GameArena.
+- Models with both strong reasoning capability and multi-turn instruction-following capability, such as **claude-3.5-sonnet**, **gemini-2.0-flash-thinking-exp-01-21**, and **gemini-1.5-pro** are ranked high in GameArena.
 
 - Models that excel at short conversations but with poor reasoning in extended game sessions, such as **Mistral-Large-2**, usually rank low in GameArena (not shown).
 
@@ -118,7 +117,7 @@ Our evaluation results show the following findings:
 | grok-2-beta                         | 994.91         | 977.67         | 973.24      | 981.94        |
 
 
-![hidetable](placeholder.jpg "Table 2: Game Arena model ranking (sorted by average score across three games) as of Feburary 2025. For more fine-grained analysis with detailed metrics, please check our paper.")
+![hidetable](placeholder.jpg "Table 2: Game Arena model ranking based on outcome-based metrics (sorted by average score across three games) as of Feburary the 10th, 2025. For more fine-grained analysis and other detailed evaluation metrics, please check our paper.")
 
 ### User Tests
 
@@ -157,7 +156,7 @@ We also invite you to try out [game engine](https://github.com/lmgame-org) and b
 
 ## Acknowledgement
 
-We would like to thank Yonghao Zhuang, Xin (Kris) Gao, Yinmin Zhong, Yao Fu, Anastasios Angelopoulos, Roger Wang for providing insightful feedbacks.
+We would like to thank Yonghao Zhuang, Xin (Kris) Gao, Yinmin Zhong, Yao Fu, Anastasios Angelopoulos, Roger Wang, Ligeng Zhu for providing insightful feedbacks.
 
 ---
 

diff --git a/blogs/backup_ai_space_escape.md → blogs/legacy/backup_ai_space_escape.md b/blogs/backup_ai_space_escape.md → blogs/legacy/backup_ai_space_escape.md
diff --git a/favicon.ico b/favicon.ico
diff --git a/index.html b/index.html
@@ -1 +1 @@
-<!doctype html><html lang="en"><head><meta charset="utf-8"/><link rel="icon" href="/favicon.ico"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="Online games and gamified AI evaluations."/><link rel="apple-touch-icon" href="/logo192.png"/><link rel="manifest" href="/manifest.json"/><title>Game Arena</title><script defer="defer" src="/static/js/main.ac7bc3b3.js"></script><link href="/static/css/main.30750e69.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>
+<!doctype html><html lang="en"><head><meta charset="utf-8"/><link rel="icon" href="/favicon.ico"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="Online games and gamified AI evaluations."/><link rel="apple-touch-icon" href="/logo.png"/><link rel="manifest" href="/manifest.json"/><title>Game Arena</title><script defer="defer" src="/static/js/main.ac7bc3b3.js"></script><link href="/static/css/main.30750e69.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>
diff --git a/legacy/favicon.ico b/legacy/favicon.ico
diff --git a/logo192.png → legacy/logo192.png b/logo192.png → legacy/logo192.png
diff --git a/logo512.png → legacy/logo512.png b/logo512.png → legacy/logo512.png
diff --git a/logo.png b/logo.png
diff --git a/manifest.json b/manifest.json
@@ -8,14 +8,9 @@
       "type": "image/x-icon"
     },
     {
-      "src": "logo192.png",
+      "src": "logo.png",
       "type": "image/png",
-      "sizes": "192x192"
-    },
-    {
-      "src": "logo512.png",
-      "type": "image/png",
-      "sizes": "512x512"
+      "sizes": "1134x1134"
     }
   ],
   "start_url": ".",
Original file line number	Diff line number	Diff line change
		@@ -1 +1 @@
		<!doctype html><html lang="en"><head><meta charset="utf-8"/><link rel="icon" href="/favicon.ico"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="Online games and gamified AI evaluations."/><link rel="apple-touch-icon" href="/logo192.png"/><link rel="manifest" href="/manifest.json"/><title>Game Arena</title><script defer="defer" src="/static/js/main.ac7bc3b3.js"></script><link href="/static/css/main.30750e69.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>
		<!doctype html><html lang="en"><head><meta charset="utf-8"/><link rel="icon" href="/favicon.ico"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="Online games and gamified AI evaluations."/><link rel="apple-touch-icon" href="/logo.png"/><link rel="manifest" href="/manifest.json"/><title>Game Arena</title><script defer="defer" src="/static/js/main.ac7bc3b3.js"></script><link href="/static/css/main.30750e69.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>