Gemma.cpp

Compile and run the C++ version of the GEMMA LLM(2 billion parameters) on my own laptop. The CPU is maxed out, but it still can’t produce a single word output after a long time.😃

在自己的笔记本上编译运行C++版gemma大模型(20亿参数),CPU拉满,但还是半天蹦不出一个单词输出。看来要考虑升级一下电脑了。

Running Gemma.cpp on a laptop
CPU is maxed out when running Gemma.cpp on a laptop

Pull down the latest codes, compile and run, it’s OK, great.

下了最新代码,重新编译运行,正常了。

Running Gemma.cpp
Prompt is “Variational Autoencoders (VAE) are currently applied in various scenarios, list some.”, get 476 tokens output in 4.44sec.

发表评论

您的邮箱地址不会被公开。 必填项已用 * 标注