181: Memory Management

Intro topic: Video Game Prices News/Links: Step one: Jump in the Lava - Abyssoft https://youtu.be/WdadpHLAfdA?si=oXYnhB0EdkR_RaPE Scalable world models for continuous control https://www.tdmpc2.com/ Clever code is probably the worst code you could write - Engineer’s Codex https://read.engineerscodex.com/p/clever-code-is-probably-the-worst A new, open source text-to-speech model called Dia has arrived to challenge ElevenLabs, OpenAI and more https://venturebeat.com/ai/a-new-open-source-text-to-speech-model-called-dia-has-arrived-to-challenge-elevenlabs-openai-and-more/ Book of the Show Patrick The Muscle Ladder - Jeff Nippard https://amzn.to/44Dznsz Jason Metaphysics of War https://amzn.to/4jMjvZ5 Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h Tool of the Show Patrick Pokemon Trading Card Game Pocket Jason Phi-4 https://huggingface.co/spaces/microsoft/phi-4-multimodal Topic: Memory Management Motivation Avoid thrashing / crashes Allocate resources efficiently Keep high uptime Where OS Level Heap management Virtual Memory Language/Compiler Level Cpp Garbage collection Ownership Tools Instrumentation Export to Datadog / Grafana Python: psutil & tracemalloc Valgrind What to do when your program uses too much memory? Reduce data sizes Compression References Lazy initializer Generators & Back Pressure Ring buffers Arena allocators Disk based caching ★ Support this podcast on Patreon ★