Foundry Local CLI

Foundry Local CLI 0.12.1.0

Foundry Local enables local execution of Small Language Models using the hardware on your device.

  • By Microsoft Corporation
  • Proprietary
Download for Windows

About Foundry Local CLI

Foundry Local brings the power of Azure AI Foundry to your local device. It allows you to run large language models (LLMs) directly on your hardware and keep all data processing on device for enhanced privacy and security. It also has an OpenAI compatible API and hardware acceleration out of the box, ensuring you are getting a simple and performant experience regardless of what hardware you are using.

Technical details

PublisherMicrosoft Corporation
Version0.12.1.0
LicenseProprietary
Installer typemsix
Architecturex64, arm64
Package IDMicrosoft.FoundryLocal

Links & install command

Install Foundry Local CLI from the command line with Windows Package Manager (winget):

winget install --id=Microsoft.FoundryLocal -e

agentaiartificial-intelligencecpucudagpuinferencellmmachine-learningmlnpuslm

Older versions

  • 0.12.0.0
  • 0.11.0.0
  • 0.10.3.0
  • 0.10.2.0
  • 0.8.119.102
  • 0.8.117.0
  • 0.8.115.60133
  • 0.8.113.28694
  • 0.8.103.41180