fastllm

单 CPU 如果您使用的是单个 CPU，请使用 -t 参数设置线程数（通常设置为 CPU 核心数 - 2）。 使用环境变量 FASTLLMNUMATHREADS 设置线程数（通常设置为每个 NUMA 节点的核心数 - 2）。 single CPU If you are using a single CPU, set the number of threads with the -t parameter (generally set to CPU core count - 2). If the speed is extremely slow, it may be due to too many threads—consider reducing them. If using a multi-socket CPU machine, you need to enable CUDA + NUMA heterogeneous acceleration mode. Set the number of threads using the environment variable FASTLLMNUMATHREADS (typically set to the number of cores per NUMA node - 2). If performance is extremely slow, it may be due to excessive threads—consider reducing them.