Model Manager

Warmup prompt (one-time)

ctx-size n-gpu-layers tensor-split split-mode cache-type-k cache-type-v flash-attn temp top-k top-p repeat-penalty repeat-last-n frequency-penalty presence-penalty extra args Apply Parameters