On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards
Paper • 2407.04065 • Published • 1
Zhimin Zhao PRO
zhiminy
AI & ML interests
SE4AI, AI4SE, LLMOps, LLM4Code
Recent Activity
authored a paper 2 days ago
Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild updated a dataset 3 days ago
SWE-Arena/leaderboard_dataOrganizations
authored 2
papers 2 days ago
updated 3
datasets 3 days ago
updated a
Space 3 days ago
updated a
dataset 3 days ago
liked a
dataset 4 days ago
updated a
dataset 4 days ago
published a
dataset 4 days ago
upvoted a paper 4 days ago
submitted a
paper to Daily Papers 4 days ago
upvoted a changelog about 1 month ago
Hugging Face Changelog
Introducing Kernels
• 193
updated 6
Spaces about 2 months ago
SWE-Chatbot-Arena
🎯
30
Chatbot arena for software engineering tasks
SWE-Model-Arena
🎯
1
Model arena for software engineering tasks
SWE-Release
📢
13
Track GitHub releases statistics for SWE assistants
SWE-PR
⚙
14
Track GitHub PR, review & commit stats for SWE agents
SWE-Issue
❓
15
Track GitHub issue statistics for SWE assistants
SWE-Community
🌐
13
Track GitHub community statistics for SWE assistants
liked a
Space 2 months ago