Looking for a Microsoft Copilot alternative without recurring inference costs? Consider using llama.cpp with local LLMs directly within Microsoft Word. Llama.cpp is designed to facilitate LLM inference with minimal setup while delivering state-of-the-art performance across diverse hardware platforms, both locally and in the cloud. Its standout features include: Plain C/C++ implementation without any dependencies, Apple silicon is a first-class citizen and optimized via, Custom CUDA kernels for running LLMs on NVIDIA GPUs, CPU+GPU hybrid inference to partially accelerate models larger than the total VRAM capacity, etc.
To see how easily llama.cpp can be integrated into Microsoft Word without incurring additional costs, check out this demonstration video. For more examples, visit our video library at @GPTLocalhost!