model_test.py 367 B

12345678910111213141516
  1. from pydantic import BaseModel, Field
  2. class ModelTestRequest(BaseModel):
  3. model_id: str = Field(..., description="已缓存模型的 ID")
  4. prompt: str
  5. max_new_tokens: int = 128
  6. temperature: float = 0.8
  7. top_p: float = 0.95
  8. class ModelTestResponse(BaseModel):
  9. model_id: str
  10. prompt: str
  11. generated_text: str
  12. error: str | None = None