A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required.
GTP4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer grade CPUs. The goal is simple—be the best instruction tuned assistant-style language model that any person or enterprise can freely use, distribute and build on.
Features:
• Fast CPU and GPU based inference using ggml for open source LLM’s
• The UI is made to look and feel like you’ve come to expect from a chatty gpt
• Check for updates so you can always stay fresh with latest models
• Easy to install with precompiled binaries available for all three major desktop platforms
• Multi-model – Ability to load more than one model and switch between them
• Supports llama.cpp style models
• Model downloader in GUI featuring many popular open source models
• Settings dialog to change temp, top_p, top_k, threads, etc
• Copy your conversation to clipboard
Two different licensing options to choose from:
Community Edition (MIT License)
Enterprise Edition (Commercial License)
Source about licensing at https://www.nomic.ai/gpt4all/legal/terms-of-service

 
                 
                