Hasty Briefsbeta

performance evaluation

2 stories total

Bilingual

Moby Dick Workout
24 days ago
- The 'Moby Dick Workout' is a test using the novel 'Moby Dick' to evaluate app performance.
- Key test steps include opening the file, scrolling, resizing, editing, and checking memory usage.
- The test aims to ensure apps can handle user-generated content without performance issues.
- Test files like MobyDick.bike, MobyDick.opml, and MobyDick.markdown are provided for different app types.
CursorBench 3.1
a month ago
- CursorBench 3.1 evaluates agents on ambiguous, multi-file tasks from real Cursor sessions, with higher scores indicating better performance.
- The benchmark includes models like Fable 5 Max (72.9%), Fable 5 Extra High (72.0%), and others, with scores ranging down to 31.9% for Kimi 2.5.
- Avg cost per task is calculated using each model's published per-million-token pricing applied to tokens used on CursorBench 3.1 tasks, averaged across tasks.

firstprev0next