BigCodeArena: Judging code generations end to end with code executions
• 22
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
Running
Agents
37
BigCodeArena
🚀
Compare two AI models by sending them code and seeing their responses
Running
1
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running on CPU Upgrade
21
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
Agents
231
BigCodeBench Leaderboard
🥇
Explore code-generation model leaderboards and task details
Running
25
BigCode Model License Agreement
🤝
Display a PDF file in a web app
Runtime error
BigCodeBench Interaction
🥇
Running
Agents
1.51k
Big Code Models Leaderboard
📈
Explore and compare code model performance on a leaderboard
Runtime error
BigCodeBench Evaluator
🥇
Running
README
✨
Running on CPU Upgrade
Agents
Featured
91
Am I in The Stack?
📑
Check if your GitHub repo is in The Stack dataset
Sleeping
Agents
14
StarCoder2 Search
🔎
Search code snippets in the StarCoder2 dataset
Sleeping
3
Data Inspection
🕵
Running
Agents
40
StarCoder Search
🔎
Search code snippets in the StarCoder dataset for matches
Runtime error
15
Near Deduplication
⚡
Runtime error
Agents
13
OctoCoder Demo
🐙
Runtime error
Agents
1
In The CommitPack
👁
Sleeping
Agents
Stack V2 Extensions
🏆
Runtime error
Agents
Featured
414
BigCode - Playground
🪐
Sleeping
Agents
Featured
32
Reasoning With StarCoder
🧐
Generate and run Python code from natural language queries
Running
Agents
54
BigCode - Editor
💻
Start a FastAPI web server on port 7860
Runtime error
Agents
10
Santa Explains Code
🎅
Runtime error
Agents
Featured
170
SantaCoder Demo
🎅
Generate code snippets in Python, Java, JavaScript
Build error
Tokenizer Testing
😻
Runtime error
Bot Issues Visualization
🐨