magnitudedev/magnitude

Magnitude is an open source inference server that automatically detects hardware and runs the best local models. It supports offline and private use, and can be seamlessly integrated into mainstream AI agents such as Pi and Cline to achieve localized intelligent development assistance.