GitHub / France-Travail / benchmark_llm_serving
A library to benchmark LLMs via their API exposure
Stars: 7
Forks: 1
Open issues: 0
License: agpl-3.0
Language: Python
Size: 8.04 MB
Dependencies parsed at:
0
Created at: about 1 year ago
Updated at: about 1 month ago
Pushed at: 3 months ago
Last synced at: about 10 hours ago
Topics: benchmark, llm, llm-serving, vllm
No dependencies found