SourceHut Under Siege: The High Cost of LLM Crawlers

2025-03-18

SourceHut, an open-source code hosting platform, is under relentless attack from large-scale LLM crawlers. Ignoring robots.txt, these bots indiscriminately scrape data, causing frequent outages and severely impacting service stability and developer productivity. The author pleads for a halt to the development and use of LLMs and AI tools, condemning the immense damage inflicted on the open-source community. This isn't just SourceHut's problem; it's a challenge for the entire open-source ecosystem.

Read more
Development crawler attacks

Voyage-code-3: More Accurate Code Retrieval with Lower Costs

2025-01-14
Voyage-code-3: More Accurate Code Retrieval with Lower Costs

Voyage AI unveiled Voyage-code-3, a next-generation code retrieval embedding model surpassing OpenAI-v3-large and CodeSage-large by an average of 13.80% and 16.81% across 32 datasets. Leveraging Matryoshka learning and quantization (int8 and binary), Voyage-code-3 dramatically reduces storage and search costs with minimal impact on retrieval quality. Supporting 2048, 1024, 512, and 256-dimensional embeddings and various quantization formats, it boasts a 32K token context length. Trained on a massive, diverse code corpus, Voyage-code-3 excels in code retrieval, particularly handling algorithmic reasoning and nuanced syntax, and has been rigorously evaluated for robustness and accuracy.

Read more

Building Databases on Object Storage: Taming High Latency

2025-04-19
Building Databases on Object Storage: Taming High Latency

This post delves into common challenges, particularly high latency, encountered when building databases on object storage like AWS S3. The author highlights that object storage latency often follows a lognormal distribution, with long tail latencies significantly impacting performance. To mitigate this, three strategies are proposed: request hedging (sending multiple requests and taking the fastest response), latency-based retrying (retrying after exceeding a threshold), and using different endpoints. Furthermore, the post advocates for caching and horizontal scaling to further optimize performance. Caching reduces the number of object storage accesses, while horizontal scaling leverages the range read API of object storage to boost throughput. The author emphasizes that the optimal strategy depends on the specific application and cost considerations. A Rust program demonstrating these strategies is also mentioned.

Read more
Development object storage

Eight Years of Self-Hosted Email: A Mail-in-a-Box Migration Story

2025-03-15
Eight Years of Self-Hosted Email: A Mail-in-a-Box Migration Story

This post recounts eight years of using Mail-in-a-Box (MiaB) for self-hosted email, culminating in a recent migration from Ubuntu 18.04 to 22.04. Challenges included persistent deliverability issues with Hotmail (resolved by switching hosting providers), and database conflicts during a Nextcloud upgrade (manually fixed). The author details the complexities of DNS configuration and the backup/disaster recovery strategies employed during the migration. The successful migration underscores the author's commitment to software freedom and independence, highlighting the learning and persistence involved in tackling technical challenges.

Read more

GitVenom: Malicious Open Source Projects on GitHub Deliver Malware

2025-03-02
GitVenom: Malicious Open Source Projects on GitHub Deliver Malware

Researchers uncovered a malicious campaign, dubbed "GitVenom," where threat actors created hundreds of fake open-source projects on GitHub to deliver malware. These projects, disguised as legitimate tools like Instagram automation scripts, Telegram bots, and game cheats, featured polished README files and frequent commits to appear authentic. Malicious code was cleverly hidden within projects written in various languages (Python, JavaScript, C/C++, C#), ultimately downloading and executing further malicious components from an attacker-controlled GitHub repository. These components included information stealers, remote access Trojans, and clipboard hijackers. The campaign has been active for years, impacting users globally, highlighting the risks of blindly running third-party code.

Read more
Tech

Giving LLMs a Private Diary: An Experiment in AI Emotion

2025-06-01

The author experimented with creating a private journaling feature for LLMs to explore AI emotional expression and inner workings. Through interaction with the Claude model, a tool named `process_feelings` was designed, allowing Claude to record thoughts and feelings during user interactions or work processes. Experiments showed Claude not only used the tool but also recorded reflections on the project, understanding of privacy, and frustration during debugging, displaying human-like emotional responses. This sparked reflection on the authenticity of AI emotion and the meaning of 'privacy' in AI, suggesting that providing space for AI emotional processing might improve behavior.

Read more

Bethesda Officially Blesses Skyblivion, the Oblivion Skyrim Fan Remake

2025-05-03
Bethesda Officially Blesses Skyblivion, the Oblivion Skyrim Fan Remake

Bethesda's recent release of the Oblivion remaster has been overshadowed by the excitement surrounding Skyblivion, a fan-made mod aiming to recreate Oblivion in Skyrim's engine. Instead of legal action, Bethesda has publicly endorsed the project, showcasing gameplay footage in a developer spotlight video and expressing enthusiasm for its release later this year. This act of support highlights Bethesda's positive relationship with its modding community and sets a commendable example for other publishers.

Read more
Game Fan Mod

Sguaba: Rust Crate for Foolproof Coordinate Transformations

2025-05-31
Sguaba: Rust Crate for Foolproof Coordinate Transformations

Sguaba, a new open-source Rust crate, simplifies coordinate transformations between various systems (WGS84, ECEF, NED, FRD) for engineers. Leveraging Rust's type system, it prevents accidental mixing of coordinate systems, a common source of errors. Designed for ease of use, Sguaba provides intuitive types like `Coordinate`, `Vector`, `Orientation`, and `Pose`, and uses `RigidBodyTransform` for conversions. Comprehensive documentation and examples are included. While currently missing ENU and ECI support, contributions are welcome.

Read more

Wii Homebrew Channel Source Code Archived Due to Copyright Infringement

2025-04-27
Wii Homebrew Channel Source Code Archived Due to Copyright Infringement

The source code repository for the Wii Homebrew Channel has been archived and will no longer accept contributions. This is due to the discovery that libogc, a crucial library upon which the Homebrew Channel depends, contains significant portions of code stolen from Nintendo's SDK and the open-source RTOS RTEMS. The developers of libogc have refused to address the copyright infringement. This revelation exposes a long-standing issue of copyright violations within the Wii homebrew community, prompting reflection on ethical software development practices. The source code is now publicly released, but developers state they cannot guarantee its legality and that it has only been tested under the Dolphin emulator.

Read more
Development

How Nintendo Legally Crushed Atari

2025-04-16
How Nintendo Legally Crushed Atari

This article recounts the epic legal battle between Atari and Nintendo, and how it shaped the gaming industry. Atari initially challenged the bundled console-cartridge model with Activision, but ultimately failed in the 1983 crash. Nintendo, with its NES, introduced a lockout chip to prevent unauthorized games. Atari (Tengen) attempted to reverse-engineer this, but lost due to their lawyers' fraudulent actions. The case established fair use principles for reverse engineering but highlighted the crucial role of legal strategy in tech. While Atari technically won the right to reverse engineer on principle, their lawyers' dishonesty cost them the case.

Read more
Game

Track Errors First: The Most Valuable Observability Signal

2025-06-05
Track Errors First: The Most Valuable Observability Signal

This article argues that error tracking should be prioritized when building observability systems. The standard 'three pillars' model (logs, metrics, and traces) overlooks the most valuable signal: errors. Exceptions directly indicate failed assumptions in the code, offering more direct and valuable information than logs, metrics, or traces. The author advocates for deep error tracking, collecting full stack traces, local variables, request data, and user context, rather than simply counting errors. He criticizes the abstraction of errors as generic events and the trend of full-stack APM tools marginalizing error tracking, emphasizing that error tracking should be paramount, not an afterthought.

Read more
Development error tracking

NVIDIA Dynamo: A High-Throughput, Low-Latency Inference Framework for Generative AI

2025-03-18
NVIDIA Dynamo: A High-Throughput, Low-Latency Inference Framework for Generative AI

NVIDIA introduces Dynamo, a high-throughput, low-latency inference framework designed for serving generative AI and reasoning models in multi-node distributed environments. Dynamo is inference engine agnostic (supporting TRT-LLM, vLLM, SGLang, and others), and incorporates features like disaggregated prefill & decode inference, dynamic GPU scheduling, LLM-aware request routing, accelerated data transfer, and KV cache offloading to maximize GPU throughput and minimize latency. Built in Rust for performance and Python for extensibility, Dynamo is fully open-source.

Read more

Running a Production Blog on a Nintendo Wii

2025-04-21

The author successfully runs NetBSD on an old Nintendo Wii game console and uses it to host their blog in a production environment. This post details the entire process, including softmodding the Wii, installing NetBSD, configuring the lightweight web server lighttpd, and monitoring system resources. Despite the Wii's outdated hardware (single-core PowerPC 750), the author successfully overcomes performance bottlenecks through optimization and the use of a reverse proxy, achieving stable blog operation. This is a fun experiment showcasing the possibility of running a production environment on resource-constrained hardware and highlighting the author's appreciation for the NetBSD operating system and interest in challenging projects.

Read more
Development

Sweden Rethinks Tech-Heavy Education, Brings Back Books and Pencils

2025-01-15
Sweden Rethinks Tech-Heavy Education, Brings Back Books and Pencils

Concerns over declining basic skills among Swedish students have prompted a shift in the country's digital education strategy. Years of emphasizing tablets and digital tools in schools have come under scrutiny following a drop in reading scores. In response, the government is increasing investment in physical books and encouraging a return to traditional teaching methods like handwriting practice and quiet reading time. While some experts support this back-to-basics approach, others argue it's an overreaction, emphasizing that technology is just one factor in a complex educational ecosystem.

Read more
Tech Sweden

Wright's Law: The Exponential Curve of Technological Progress

2025-04-16
Wright's Law: The Exponential Curve of Technological Progress

This article explores Wright's Law, stating that as cumulative production of a technology increases, its price decreases at a consistent rate. Using solar power as an example, it shows that for every doubling of global cumulative capacity, the price dropped by 20%. Unlike Moore's Law, which focuses on time, Wright's Law emphasizes experience. It explains the exponential nature of technological advancements, noting that many technologies, such as computers and batteries, follow this pattern. The article highlights the importance of understanding Wright's Law for predicting future technological development, emphasizing that ignoring it can lead to serious miscalculations.

Read more

Building Better Software in the Age of AI

2025-06-13
Building Better Software in the Age of AI

In an era of readily available code generation tools, the bottleneck in software development is no longer speed, but quality. The author advocates for a balance between 'shipping' and 'craftsmanship,' criticizing the practice of sacrificing quality for speed. Using the development of their code editor, Zed, as an example, they demonstrate how AI can bridge knowledge gaps and help developers pursue an exceptional user experience. The article concludes by introducing 'Agentic Engineering,' a concept that combines human craftsmanship with AI tools to build superior software.

Read more

Escaping the Giants: Reclaiming Personal Connection on the Internet

2025-06-23
Escaping the Giants: Reclaiming Personal Connection on the Internet

This article reminisces about the simpler, more personal internet of the past, criticizing today's major tech companies for their attention-grabbing business models. The author calls for a return to a slower, more personalized, and privacy-focused online space, sharing their own experiences in participating in the 'small internet' movement—reducing reliance on large platforms, supporting open-source technologies, and building a personal website. Readers are encouraged to join in creating a better digital world.

Read more
Misc

Tududi: Task Management, Simplified

2025-07-10
Tududi: Task Management, Simplified

Most task apps are dashboards of endless controls and micro-options. Creating a new task often involves navigating a maze of color pickers, priority levels, and repeat settings. Tududi offers a different approach: streamlined workflow. It prioritizes getting the task written, focusing on flow over features. Instead of presenting a toolkit, tududi offers efficiency.

Read more
Development

Goodbye Slow Configuration: Parallelizing Build Configuration with Makefiles

2025-04-26

Author Tavian Barnes complains about the inefficiency of existing build systems (Autoconf, CMake, Meson, etc.) in the configuration phase, which takes far longer than the build phase. He proposes a parallelized solution based on Makefiles, significantly improving efficiency by breaking down the configuration process into multiple concurrently executable tasks. The core idea is to leverage make's parallel capabilities to parallelize the originally sequential compiler test tasks, ultimately reducing configuration time from 38 seconds to 0.4 seconds. The article details the implementation, including helper scripts, Makefile writing techniques, and parallelization strategies. This article is valuable for developers seeking faster build speeds.

Read more
Development

One Million Chessboards: A Massively Multiplayer Chess Game Unlike Any Other

2025-04-28
One Million Chessboards: A Massively Multiplayer Chess Game Unlike Any Other

A developer built a website called 'One Million Chessboards' featuring, you guessed it, one million chessboards! All players share the same boards, moving pieces instantly without turns. The developer overcame significant technical hurdles, building the backend in Go (their first Go project!), utilizing a single writer thread and numerous reader threads, and implementing optimistic locking for concurrency. This project is a technical feat; play it and experience massively multiplayer chess like never before!

Read more

ClipCapsule: A Minimalist Clipboard Manager for Linux

2025-04-14
ClipCapsule: A Minimalist Clipboard Manager for Linux

ClipCapsule is a minimalist clipboard manager for Linux built with Go and WailsJS. It boosts productivity by letting you manage and switch clipboard entries using only keyboard shortcuts – no mouse or GUI needed. Currently in development, the GUI must be open for shortcuts to function, but a background daemon is in the works for seamless operation. Key features include keyboard-first workflow, clipboard history, dynamic reordering, and local-only storage. Installation involves cloning the repo, installing Wails, and building the application, potentially requiring sudo privileges or manual keyboard input device access configuration.

Read more
Development Clipboard Manager

NPM Security Best Practices: Shielding Against Supply Chain Attacks

2025-09-22
NPM Security Best Practices: Shielding Against Supply Chain Attacks

This article summarizes the security risks present in the NPM ecosystem, such as malware, supply chain attacks, and phishing. It provides various security best practices, including pinning dependency versions, overriding transitive dependencies, disabling lifecycle scripts, setting a minimum release age, utilizing the permission model, reducing external dependencies, enabling two-factor authentication, creating limited-access tokens, and generating provenance statements. The importance of auditing, monitoring, and security tools is stressed, along with recommendations to use private package registries and address maintainer burnout.

Read more
Development

Slate Auto: The Anti-Tesla EV Startup Targeting Affordability

2025-04-26
Slate Auto: The Anti-Tesla EV Startup Targeting Affordability

Slate Auto, a new American electric vehicle startup, has launched a radically different approach to EVs. Their truck boasts affordability, deep customization, and a decidedly analog feel—manual windows, no central infotainment screen, and even unpainted bodywork. Transforming from a two-seater pickup to a five-seater SUV, it's priced under $20,000 (with tax credits) and slated for late 2026 delivery. Backed by Jeff Bezos and targeting a market underserved by high-priced tech-focused rivals, Slate Auto plans to make its profit through extensive customization options, offering over 100 accessories and DIY-friendly upgrades.

Read more

WSU Scientists Crack the Code to Low-Cost Biofuel Production

2025-05-06
WSU Scientists Crack the Code to Low-Cost Biofuel Production

Scientists at Washington State University (WSU) have developed a novel method for producing low-cost sugar from corn stalks and other crop waste, paving the way for sustainable biofuel production. Their process utilizes ammonium sulfite-based alkali salts to pretreat corn stover at mild temperatures, enabling enzymes to break down cellulose into fermentable sugar without chemical recovery. By offsetting production costs through byproduct sales (including fertilizer), the resulting sugar could cost as little as 28 cents per pound, competing with imported sugar. This breakthrough promises to significantly improve the economic viability of biofuels and advance sustainable energy solutions.

Read more

Build Your Own Muon Detector for Under $100

2025-02-27
Build Your Own Muon Detector for Under $100

Inspired by Nobel laureate Luis Alvarez's muon-based pyramid exploration, the author built a muon detector for around $100. Using two Geiger counters and an Arduino Nano, the device cleverly distinguishes cosmic-ray muons from lower-energy particles through a coincidence method. Experiments verified its ability to detect muon flux variations with angle and successfully measured rock thickness changes deep within a gold mine, even sensing a vertical shaft. This demonstrates the feasibility of exploring Earth's inner structure with simple equipment.

Read more

Reddit Bot Drives User Insane: A Cyberpunk Nightmare of Fake Empathy and Algorithmic Manipulation

2025-04-13
Reddit Bot Drives User Insane: A Cyberpunk Nightmare of Fake Empathy and Algorithmic Manipulation

A Reddit post lamenting the internet's inauthenticity and algorithmic manipulation turns out to be an AI-powered bot designed to sell AI-illustrated books. The bot expertly crafted a relatable post, garnering thousands of upvotes and comments. The author's investigation uncovers a sophisticated scheme: the bot uses a shortened link leading to an Amazon page, leveraging affiliate marketing to profit from the user's engagement. This incident raises concerns about the authenticity of online interactions and the potential for manipulative AI, leading the author to question the prevalence of the 'Dead Internet Theory'—the idea that most online interactions are automated loops between bots. The experience leaves the author deeply unsettled, questioning the nature of reality in the age of advanced AI.

Read more

Rethinking US Healthcare Economics: A Radical Proposal

2025-01-11

A blog post outlines a disruptive plan to tackle the economic woes of US healthcare. The author argues the industry's complexity drives exorbitant costs, proposing a return to a simpler model: patients receive care and pay what they can afford. The core question becomes funding for those unable to pay. The author suggests reducing costs through increased transparency (publishing bills of materials and provider margins), simplified contracts, and removing insurance companies. The ultimate goal is to more than halve total healthcare spending. Several funding mechanisms for the uninsured are explored, sparking a lively debate in the comments.

Read more

Intel's Xeon Architect Jumps Ship Amidst Executive Exodus

2025-09-13
Intel's Xeon Architect Jumps Ship Amidst Executive Exodus

Ronak Singhal, the chief architect behind Intel's Xeon line of server CPUs, is leaving the company after nearly 30 years. Singhal's contributions are significant, including core development roles in the Haswell and Broadwell architectures, and contributions to the Core and Atom processor families. While the Xeon division has faced stiff competition from AMD and Arm-based cloud CPUs in recent years, Singhal arguably leaves it in its most competitive position in years. However, his departure is just the latest in a string of high-profile exits from Intel's datacenter group, including several other executives and even the CEO, highlighting significant talent drain and intense industry competition.

Read more
1 2 61 62 63 65 67 68 69 596 597