mirror of
https://github.com/ivuorinen/cheatsheet-tldr.git
synced 2026-03-01 02:54:10 +00:00
Update cheatsheets
This commit is contained in:
29
tldr/koboldcpp
Normal file
29
tldr/koboldcpp
Normal file
@@ -0,0 +1,29 @@
|
||||
---
|
||||
syntax: markdown
|
||||
tags: [tldr, common]
|
||||
source: https://github.com/tldr-pages/tldr.git
|
||||
---
|
||||
# koboldcpp
|
||||
|
||||
> An AI text-generation application for GGML and GGUF models.
|
||||
> More information: <https://github.com/LostRuins/koboldcpp/wiki#command-line-arguments-reference>.
|
||||
|
||||
- Load one or more model files:
|
||||
|
||||
`koboldcpp {{[-m|--model]}} {{path/to/model_file}}`
|
||||
|
||||
- Set port to listen on (defaults to 5001):
|
||||
|
||||
`koboldcpp --port {{port}}`
|
||||
|
||||
- Set amount of threads to use:
|
||||
|
||||
`koboldcpp {{[-t|--threads]}} {{amount_of_threads}}`
|
||||
|
||||
- Launch web browser when boot is complete:
|
||||
|
||||
`koboldcpp --launch`
|
||||
|
||||
- Start without the GUI launcher:
|
||||
|
||||
`koboldcpp --skiplauncher`
|
||||
Reference in New Issue
Block a user