Docker Model Runner: Streamlining Local AI Model Execution

2025-04-14
Docker Model Runner: Streamlining Local AI Model Execution

Docker launched Model Runner, a tool designed to simplify running and testing AI models locally. It tackles the challenges developers face with fragmented tooling, hardware compatibility issues, and disconnected workflows when working with AI models locally. Model Runner integrates a llama.cpp-based inference engine, supports GPU acceleration on Apple silicon, and utilizes OCI Artifacts for standardized model packaging, enabling easy sharing and version control. Furthermore, Docker has partnered with companies like Google and Hugging Face to provide a rich ecosystem of models and tools, making local AI development significantly easier.

Read more
Development

Docker Bake GA: Streamlining Complex Docker Builds

2025-02-08
Docker Bake GA: Streamlining Complex Docker Builds

Docker announces the General Availability of Docker Bake in Docker Desktop 4.38. This powerful build orchestration tool simplifies complex Docker builds using a declarative configuration file. Bake handles multiple images, parallelization, and caching for faster build times, addressing challenges like managing lengthy commands and dependencies. It's compatible with Docker Compose and offers advanced features like matrix builds and custom functions. The GA release includes enhancements such as deduplicated context transfers, entitlements for enhanced security, composable attributes, and variable validation, improving efficiency and ease of use.

Read more
Development Build Tool