#Gpu

TPU vs GPU: The Architecture and Software Trade-offs

Choosing between GPUs and TPUs requires balancing CUDA's dynamic flexibility against the static compilation efficiency of systolic arrays.

Article · 1mo ago1

Disaggregating LLM Inference: Inside AMD's ATOM and ATOMesh Stack

AMD's native ROCm serving stack splits prefill and decode to eliminate head-of-line blocking on Instinct hardware.

Article · 1mo ago0

NVIDIA's cuTile Brings Fearless Concurrency to GPU Kernels in Rust

A new tile-based DSL from NVIDIA Labs extends Rust's strict ownership model directly to high-performance GPU programming.

Article · 1mo ago5

xAI Is Becoming the Landlord of the AI Compute Stack — and That Matters for Developers

xAI's deals to lease GPU capacity to Anthropic and Google reframe it as infrastructure provider first, frontier lab second. Here's what that means for the APIs you're building on.

Article · 2mos ago1

Xiaomi's MiMo-V2.5-Pro-UltraSpeed Pushes a 1T Model Past 1000 Tokens/Sec on Commodity GPUs

Through FP4 quantization, block-level speculative decoding, and the TileRT system stack, Xiaomi claims trillion-parameter decode speeds normally reserved for custom silicon — on a single 8-GPU node.

News · 2mos ago5