GGUF vs GGML : Understanding the Differences
Introduction
The year 2023 was a landmark year for the Large Language Models (LLMS) ecosystem which saw a large number of proprietary models and open-source models becoming accessible to the public at large. It also saw LLMs getting published for CPUs in GGML format thus making LLMs accessible to people who lacked powerful GPUs. Soon in August 2023, another format called GGUF was released for CPU-based LLMs. With such rapid changes in the ecosystem many people especially beginners are confused as to what is the difference between GGUF and GGML. In this article, we will do a comparison of GGUF vs GGML and understand their differences and similarities to help clear the confusion among beginners.
What is GGML
1) Library
GGML