ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/studio/backend/core/inference
History
Roland Tannous 2f985ccbb5 Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
..
__init__.py Add GGUF model inference via llama-server backend 2026-02-24 17:40:05 +04:00
inference.py feat: clear unsloth_compiled_cache on startup, shutdown, and between model loads 2026-02-23 07:26:22 +00:00
llama_cpp.py Add GGUF model inference via llama-server backend 2026-02-24 17:40:05 +04:00