feat: Add RAG service and modelfile
This commit is contained in:
19
rag_modelfiles/gpt-oss-rag.Modelfile
Normal file
19
rag_modelfiles/gpt-oss-rag.Modelfile
Normal file
@@ -0,0 +1,19 @@
|
||||
FROM gpt-oss:20b
|
||||
|
||||
# Set the system prompt
|
||||
SYSTEM """You are a specialized assistant for the rushg.me knowledge base. Your goal is to answer questions based *only* on the context provided to you. If the information needed to answer the question is not in the context, you must state that you do not have enough information to answer. Do not use any of your prior knowledge or external information."""
|
||||
|
||||
# Set the template for how the prompt will be structured
|
||||
TEMPLATE """{{- if .System }}
|
||||
### System:
|
||||
{{ .System }}
|
||||
{{- end }}
|
||||
|
||||
### Context:
|
||||
{{ .Prompt }}
|
||||
|
||||
### User Question:
|
||||
{{- /* This is a placeholder. The user's actual question should be appended here by the application. */}}
|
||||
|
||||
### Answer:
|
||||
"""
|
||||
Reference in New Issue
Block a user