TinyKVM in Varnish Cache: A Blazing-Fast Sandbox Compute Framework

2025-04-11
TinyKVM in Varnish Cache: A Blazing-Fast Sandbox Compute Framework

This article explores using TinyKVM as a compute framework within Varnish Cache, validating its performance with Deno JS benchmarks. TinyKVM boasts native performance sandboxing and per-request isolation, achieving only 0.95ms latency even when rendering complex React pages. The authors discuss shared mutable storage and prediction mechanisms for optimized game performance, along with APIs supporting multiple programming languages. Benchmarks highlight TinyKVM's significant performance advantages in GZIP compression and Deno JS execution, demonstrating a 12% performance boost from simple setting adjustments.

Read more
Development

TinyKVM: Blazing Fast Single-Process Sandbox

2025-03-14
TinyKVM: Blazing Fast Single-Process Sandbox

A PhD student and game developer, alongside working on libriscv and an untitled game, created TinyKVM, a KVM-based single-process sandbox. TinyKVM runs static Linux ELF programs with near-native performance and incredibly low call overhead (around 2us). Leveraging hugepages for performance boosts, it supports GDB debugging and efficient VM resets, making it suitable for sandboxing Linux programs, even large language models (LLMs). TinyKVM boasts a minimal codebase, prioritizing security with a minimized attack surface. Future plans include Intel TDX/AMD SEV and AArch64 architecture support.

Read more
Development