Running LLMs Locally: A Developer's Guide

2024-12-29
Running LLMs Locally: A Developer's Guide

A developer shares their experience running Large Language Models (LLMs) on a personal computer. Using a high-spec machine (i9 CPU, 4090 GPU, 96GB RAM), along with open-source tools like Ollama and Open WebUI, they successfully run several LLMs for tasks such as code completion and note querying. The article details the hardware, software, models used, and update methods, highlighting the data security and low-latency advantages of running LLMs locally.

Read more

Making Apple Watch Work with Android: An Open-Source Odyssey

2024-12-18
Making Apple Watch Work with Android: An Open-Source Odyssey

The author details their journey to connect an Apple Watch to an Android phone, bypassing Apple's walled garden. This involved using open-source apps, interoperable protocols, and third-party services, even requiring a secondary, home-based iPhone for initial setup. The author overcame challenges with notifications, calendar syncing, and contact integration, sharing their code on GitHub. This project highlights the power of open-source and the author's commitment to tech freedom, offering a compelling counterpoint to the closed ecosystems of tech giants.

Read more
Tech