私有化部署gpt

有两个工具选择gpt4all和ollama安装完成后下载模型运行就好了。

ollama部署使用

官网下载然后安装，然后看下面命令跟着来，模型在ollama官网的Models找

Microsoft Windows [版本 10.0.22631.4169]
(c) Microsoft Corporation。保留所有权利。

C:\Users\Administrator>ollama
Usage:
  ollama [flags]
  ollama [command]

Available Commands:
  serve       Start ollama
  create      Create a model from a Modelfile
  show        Show information for a model
  run         Run a model
  pull        Pull a model from a registry
  push        Push a model to a registry
  list        List models
  ps          List running models
  cp          Copy a model
  rm          Remove a model
  help        Help about any command

Flags:
  -h, --help      help for ollama
  -v, --version   Show version information

Use "ollama [command] --help" for more information about a command.

C:\Users\Administrator>ollama run llama3.1
pulling manifest
pulling 8eeb52dfb3bb...  18% ▕██████████████████████████████████████████████                                                                                                                                                                                                               ▏ 848 MB/4.7 GB   10 MB/s   5m57s

需要通过powershell使用相应的命令做相应的事