---
aliases:
  - inspo
cssclasses:
  - nolist
date: '2024-10-24'
description: My run-down version of are[dot]na
id: are.na
metadata:
  ebnf: |-
    channel        = "##" , ws , heading , newline , channel_body ;
    channel_body   = [ meta_section , newline ] , block , { block } ;
    block          = list_entry , newline , meta_section , { note_line } ;
    list_entry     = "-" , ws , link , [ ws "--" ws title ] , [ ws "[**]" ] ;
    meta_section   = ws , "-" , ws , "[meta]:" , newline , meta_pair , { meta_pair } ;
    meta_pair      = ws , ws , "-" , ws , key , ":" , ws , value ;
    key            = "date" | "tags" | "pinned" | "later" | "unlocked" | "socials" | "view" | identifier ;
    value          = date | tag_list | boolean | text ;
    tag_list       = "[" , tag , { "," , ws , tag } , "]" ;
    tag            = identifier ;
    date           = digit , digit , "/" , digit , digit , "/" , digit , digit , digit , digit ;
    boolean        = "true" | "false" ;
    note_line      = ws , "-" , ws , text ;
    link           = uri ;
    title          = text ;
    heading        = text ;
    identifier     = letter , { letter | digit | "-" } ;
    text           = { character - newline } ;
    uri            = ? valid http uri ? ;
    letter         = "a".."z" ;
    digit          = "0".."9" ;
    character      = ? any printable ascii except newline ? ;
modified: 2026-09-24 00:14:31 GMT-04:00
permalinks:
  - /website
  - /tweets
  - /resources
socials:
  are.na: https://www.are.na/aaron-pham/channels
  curius: /curius
  home: /
  print: https://print.are.na/
tags:
  - evergreen
  - llm
  - design
  - love
  - friend
  - r/pedagogy
  - alignment
  - philosophy
  - P-Complete
  - interpretability
  - math/linalg
title: '#repository'
created: '2024-10-24'
published: '2024-10-24'
pageLayout: default
slug: arena/repository
permalink: https://aarnphm.xyz/arena/repository.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# #repository

- [flashinfer-ai/flashinfer-bench](https://github.com/flashinfer-ai/flashinfer-bench/blob/main/flashinfer_bench/agents/sanitizer.py) — flashinfer-bench/flashinfer\_bench/agents/sanitizer.py at main · flashinfer-ai/flashinfer-bench

  - \[meta]:

    - date: 09/15/2026
    - tags: \["repository","agents"]
    - later: true

- <https://huggingface.co/kernels/kernels-community/relu/tree/v1/build/torch210-cxx11-cu126-aarch64-linux> — kernels-community/relu at v1

  - \[meta]:

    - date: 09/15/2026
    - tags: \["repository"]
    - later: true

- [cohere-ai/cohere-megakernel](https://github.com/cohere-ai/cohere-megakernel/blob/main/src/kv/cache.cpp) — cohere-megakernel KV cache

  - \[meta]:

    - date: 09/12/2026
    - tags: \["repository","model serving"]
    - later: true

- [yifanzhang-pro/recurrent-looped-tranformer](https://github.com/yifanzhang-pro/recurrent-looped-tranformer) — Recurrent Looped Transformer

  - \[meta]:

    - date: 09/12/2026
    - tags: \["repository","transformers"]
    - later: true

- [get-bb/bb](https://github.com/get-bb/bb) — GitHub - get-bb/bb: The agent IDE that builds itself

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","agents"]
    - later: true

- [PrimeIntellect-ai/prime-agent](https://github.com/PrimeIntellect-ai/prime-agent) — GitHub - PrimeIntellect-ai/prime-agent: A self-improving RLM agent for coding workflows and long-running autonomous tasks

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","agents"]
    - later: true

- [anthropics/zeta-23-lean](https://github.com/anthropics/zeta-23-lean) — GitHub - anthropics/zeta-23-lean

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","lean"]
    - later: true

- [lyramakesmusic/neuralese-leaker](https://github.com/lyramakesmusic/neuralese-leaker) — GitHub - lyramakesmusic/neuralese-leaker: web app for chatting with LLMs on OpenRouter with leaked unabridged reasoning

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","language models"]
    - later: true

- [agda/cubical](https://github.com/agda/cubical/blob/master/Cubical/Cohomology/Base.agda) — Cubical/Cohomology/Base.agda at master agda/cubical

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","cubical agda"]
    - later: true

- [HazyResearch/ThunderKittens](https://github.com/HazyResearch/ThunderKittens) — GitHub - HazyResearch/ThunderKittens: Tile primitives for speedy kernels

  - \[meta]:

    - date: 08/26/2026
    - tags: \["repository","gpu"]
    - later: true

- [yoheinakajima/babyagi](https://github.com/yoheinakajima/babyagi) — GitHub - yoheinakajima/babyagi

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository","agents"]
    - later: true

- [TransluceAI/observatory](https://github.com/TransluceAI/observatory) — GitHub - TransluceAI/observatory: A toolkit for model feature description and intervention

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository","interpretability"]
    - later: true

- [drbh/power-message](https://github.com/drbh/power-message) — GitHub - drbh/power-message: Free the blue message. Finally a simple REST API for iMessage

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [stas00/ml-engineering](https://github.com/stas00/ml-engineering/blob/master/performance/software.md) — ML Engineering: Software Performance

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [google-deepmind/uncertain\_ground\_truth](https://github.com/google-deepmind/uncertain_ground_truth) — GitHub - google-deepmind/uncertain\_ground\_truth: Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncer

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [valeman/awesome-conformal-prediction](https://github.com/valeman/awesome-conformal-prediction) — GitHub - valeman/awesome-conformal-prediction: A professionally curated list of awesome Conformal Prediction videos, tutorials, books, papers, PhD and MSc theses, articles and open-source libraries.

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [rasbt/LLMs-from-scratch](https://github.com/rasbt/LLMs-from-scratch/blob/main/ch05/07_gpt_to_llama/converting-gpt-to-llama2.ipynb) — LLMs-from-scratch/ch05/07\_gpt\_to\_llama/converting-gpt-to-llama2.ipynb at main rasbt/LLMs-from-scratch

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [tensor-fusion/sophia-jax](https://github.com/tensor-fusion/sophia-jax) — GitHub - tensor-fusion/sophia-jax: JAX implementation of ‘Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training’

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository","language models"]
    - later: true

- [xjdr-alt/entropix](https://github.com/xjdr-alt/entropix) — GitHub - xjdr-alt/entropix: Entropy Based Sampling and Parallel CoT Decoding

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [slavachalnev/SAE-TS](https://github.com/slavachalnev/SAE-TS/blob/main/src/sae_ts/steering/patch.py) — SAE-TS/src/sae\_ts/steering/patch.py at main slavachalnev/SAE-TS

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [newfrgmnt/bitspace](https://github.com/newfrgmnt/bitspace) — GitHub - emilwidlund/bitspace: A prototype of a creative environment for the 21st century

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [Wangmerlyn/MCTS-GSM8k-Demo](https://github.com/Wangmerlyn/MCTS-GSM8k-Demo) — GitHub - Wangmerlyn/MCTS-GSM8k-Demo: This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [safety-research/circuit-tracer](https://github.com/safety-research/circuit-tracer) — GitHub - decoderesearch/circuit-tracer

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [facebookresearch/LayerSkip](https://github.com/facebookresearch/LayerSkip/blob/main/self_speculation/self_speculation_generator.py) — LayerSkip/self\_speculation/self\_speculation\_generator.py at main facebookresearch/LayerSkip

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- <https://gist.github.com/boknilev/c4eeeaf4a8400b95f9af8be98a13fb52> — Some misconceptions about probes

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [MoonshotAI/Attention-Residuals](https://github.com/MoonshotAI/Attention-Residuals/blob/master/Attention_Residuals.pdf) — Attention-Residuals/Attention\_Residuals.pdf at master MoonshotAI/Attention-Residuals

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository","attention"]
    - later: true

- [jonbarron/gaussid](https://github.com/jonbarron/gaussid/blob/main/gaussid.md) — gaussid/gaussid.md at main jonbarron/gaussid

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- <https://gist.github.com/rebane2001/8b83121a7ea9263f136928231b6737eb> — CSS + SVG filters only version of <https://twitter.com/mattrothenberg/status/2040416074710102300>

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [nervanasystems/maxas](https://github.com/nervanasystems/maxas/wiki/sgemm) — SGEMM

  - \[meta]:

    - date: 08/25/2026
    - tags: \["repository"]
    - later: true

- [Alain00/blobatar](https://github.com/Alain00/blobatar) — blobatar

  - \[meta]:

    - date: 08/20/2026
    - tags: \["avatar","web"]
    - later: true

- [danyuchn/asd-ste100-skill](https://github.com/danyuchn/asd-ste100-skill) — ASD-STE100 skill

  - \[meta]:

    - date: 08/20/2026
    - tags: \["writing","claude code"]
    - later: true

- [firecracker-microvm/firecracker](https://github.com/firecracker-microvm/firecracker/blob/main/docs/design.md) — Firecracker Design

  - \[meta]:

    - date: 08/06/2026
    - tags: \["microvm","virtualization"]
    - later: true

- [vllm-project/tml-fa4](https://github.com/vllm-project/tml-fa4/) — vllm-project/tml-fa4

  - \[meta]:

    - date: 07/31/2026
    - tags: \["flashattention","attention"]
    - later: true

- [lucidrains/rotary-embedding-torch](https://github.com/lucidrains/rotary-embedding-torch/blob/main/rotary_embedding_torch/flash_attn_with_rotary.py) — flash\_attn\_with\_rotary.py

  - \[meta]:

    - date: 07/31/2026
    - tags: \["rotary embeddings","flash attention"]
    - later: true

- [ShouqiaoW/erdos](https://github.com/ShouqiaoW/erdos/blob/main/788/prompt.md) — erdos prompt

  - \[meta]:

    - date: 07/31/2026
    - tags: \["prompts","math"]
    - later: true

- [marcelroed/gigatoken](https://github.com/marcelroed/gigatoken/) — gigatoken

  - \[meta]:

    - date: 07/31/2026
    - tags: \["tokenization","performance"]
    - later: true

- [lightseekorg/tokenspeed](https://github.com/lightseekorg/tokenspeed/blob/main/tokenspeed-scheduler/csrc/core/token_container.h) — tokenspeed token\_container.h

  - \[meta]:

    - date: 07/31/2026
    - tags: \["scheduling","inference"]
    - later: true

- [vllm-project/vllm#47189](https://github.com/vllm-project/vllm/pull/47189) — Cohere chat v2 API support

  - \[meta]:

    - date: 07/31/2026
    - tags: \["vllm","api"]
    - later: true

- [vllm-project/vllm#43015](https://github.com/vllm-project/vllm/issues/43015) — Cohere v2 chat API RFC

  - \[meta]:

    - date: 07/31/2026
    - tags: \["vllm","api"]
    - later: true

- [z-lab/dflash](https://github.com/z-lab/dflash) — DFlash

  - \[meta]:

    - date: 07/31/2026
    - tags: \["speculative decoding","diffusion"]
    - later: true

- [Tencent/AngelSpec](https://github.com/Tencent/AngelSpec) — AngelSpec

  - \[meta]:

    - date: 07/31/2026
    - tags: \["speculative decoding","training"]
    - later: true

- [MoonshotAI/Kimi-K3](https://github.com/MoonshotAI/Kimi-K3) — Kimi K3

  - \[meta]:

    - date: 07/28/2026
    - tags: \["language models","open weights"]
    - later: true

- [MoonshotAI/Attention-Residuals](https://github.com/MoonshotAI/Attention-Residuals) — Attention Residuals

  - \[meta]:

    - date: 07/28/2026
    - tags: \["transformers","residuals"]
    - later: true

- [MoonshotAI/MoonEP](https://github.com/MoonshotAI/MoonEP) — MoonEP

  - \[meta]:

    - date: 07/28/2026
    - tags: \["expert parallelism","moe"]
    - later: true

- [MoonshotAI/FlashKDA](https://github.com/MoonshotAI/FlashKDA) — FlashKDA

  - \[meta]:

    - date: 07/28/2026
    - tags: \["kimi delta attention","cuda"]
    - later: true

- [rosetta-rs/string-rosetta-rs](https://github.com/rosetta-rs/string-rosetta-rs) — string-rosetta-rs

  - \[meta]:

    - date: 07/16/2026
    - tags: \["rust","strings"]
    - later: true

- [ryota2357/lean\_string](https://github.com/ryota2357/lean_string) — lean\_string

  - \[meta]:

    - date: 07/16/2026
    - tags: \["rust","strings"]
    - later: true

- [kayba-ai/agentic-context-engine](https://github.com/kayba-ai/agentic-context-engine) — agentic-context-engine

  - \[meta]:

    - date: 07/16/2026
    - tags: \["agents","memory"]
    - later: true

- [random-unknown-username/Thintensor](https://github.com/random-unknown-username/Thintensor) — Thintensor

  - \[meta]:

    - date: 07/16/2026
    - tags: \["llm","compression"]
    - later: true

- [deepseek-ai/DeepSpec](https://github.com/deepseek-ai/DeepSpec) — DeepSpec

  - \[meta]:

    - date: 06/30/2026
    - tags: \["speculative decoding","deepseek"]
    - later: true

- [bruits/satteri](https://github.com/bruits/satteri/tree/main) — satteri

  - \[meta]:

    - date: 06/29/2026
    - tags: \["markdown","mdx"]
    - later: true

- [shreyashankar/plain-writing-skill](https://github.com/shreyashankar/plain-writing-skill) — plain-writing-skill

  - \[meta]:

    - date: 06/29/2026
    - tags: \["writing","agents"]
    - later: true

- [crusoecloud/fastokens](https://github.com/crusoecloud/fastokens) — Fast Tokens

  - \[meta]:

    - date: 06/29/2026
    - tags: \["tokenization","performance"]
    - later: true

- [lwouis/alt-tab-macos](https://github.com/lwouis/alt-tab-macos) — AltTab macOS

  - \[meta]:

    - date: 06/29/2026
    - tags: \["macos","window management"]
    - later: true

- [Th0rgal/open\_oura](https://github.com/Th0rgal/open_oura) — open\_oura

  - \[meta]:

    - date: 06/29/2026
    - tags: \["oura","rust"]
    - later: true

- [uellenberg/Insert](https://github.com/uellenberg/Insert) — Insert programming language

  - \[meta]:

    - date: 06/29/2026
    - tags: \["programming languages","self-modifying code"]
    - later: true

- [callummcdougall/ARENA\_3.0](https://github.com/callummcdougall/ARENA_3.0) — ARENA 3.0

  - \[meta]:

    - date: 06/28/2026
    - tags: \["alignment","safety"]
    - later: true

- [guidance-ai/llguidance](https://github.com/guidance-ai/llguidance/tree/main/parser) — llguidance parser

  - \[meta]:

    - date: 06/19/2026
    - tags: \["structured outputs","parser"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/ecd49ce7e69a50892be7f9841941ca2d7e3b12ea/vllm/v1/core/kv_cache_utils.py#L1298) — vLLM KV cache utilities

  - \[meta]:

    - date: 06/19/2026
    - tags: \["kv cache","inference"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/7a8375f8a0cd37ee7e3d2be8498b5ae543694179/vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py#L46) — vLLM DeepEP low-latency prepare/finalize

  - \[meta]:

    - date: 06/19/2026
    - tags: \["deepep","moe"]
    - later: true

- [vllm-project/vllm#24685](https://github.com/vllm-project/vllm/issues/24685) — Decode Context Parallel for GQA

  - \[meta]:

    - date: 06/19/2026
    - tags: \["context parallelism","gqa"]
    - later: true

- [vllm-project/vllm#25749](https://github.com/vllm-project/vllm/issues/25749) — Support Prefill Context Parallel

  - \[meta]:

    - date: 06/19/2026
    - tags: \["context parallelism","prefill"]
    - later: true

- [vllm-project/vllm#22918](https://github.com/vllm-project/vllm/issues/22918) — Complete redesign of tool calling

  - \[meta]:

    - date: 06/19/2026
    - tags: \["tool calling","architecture"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/main/vllm/v1/attention/backends/mla/indexer.py) — vLLM MLA indexer

  - \[meta]:

    - date: 06/19/2026
    - tags: \["mla","attention"]
    - later: true

- [vllm-project/vllm#26133](https://github.com/vllm-project/vllm/issues/26133) — Context parallelism with fully sharded KV cache and ring attention

  - \[meta]:

    - date: 06/19/2026
    - tags: \["context parallelism","ring attention"]
    - later: true

- [vllm-project/vllm#23734](https://github.com/vllm-project/vllm/pull/23734) — Support Decode Context Parallel for MLA

  - \[meta]:

    - date: 06/19/2026
    - tags: \["context parallelism","mla"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/deepseek_v2.py) — vLLM DeepSeek V2 model implementation

  - \[meta]:

    - date: 06/19/2026
    - tags: \["deepseek","model"]
    - later: true

- [vllm-project/vllm#24845](https://github.com/vllm-project/vllm/pull/24845) — DeepEP high-throughput support for dual-batch overlap

  - \[meta]:

    - date: 06/19/2026
    - tags: \["deepep","dbo"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/8471b27df97c3eb79f891802fc0e858f8f7ac6a0/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_connector.py#L72) — vLLM LMCache connector

  - \[meta]:

    - date: 06/19/2026
    - tags: \["lmcache","kv connector"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/8471b27df97c3eb79f891802fc0e858f8f7ac6a0/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/vllm_v1_adapter.py#L73) — vLLM LMCache V1 adapter

  - \[meta]:

    - date: 06/19/2026
    - tags: \["lmcache","kv connector"]
    - later: true

- [attentiontech/gtm-superintelligence](https://github.com/attentiontech/gtm-superintelligence) — gtm-superintelligence

  - \[meta]:

    - date: 06/15/2026
    - tags: \["agents","sales"]
    - later: true

- [google/re2](https://github.com/google/re2/wiki/syntax) — RE2 syntax

  - \[meta]:

    - date: 06/12/2026
    - tags: \["regex"]
    - later: true

- [kyx0r/pikevm](https://github.com/kyx0r/pikevm) — pikevm regex engine

  - \[meta]:

    - date: 06/12/2026
    - tags: \["regex","nfa"]
    - later: true

- [ekmett/lens](https://github.com/ekmett/lens) — lens

  - \[meta]:

    - date: 06/12/2026
    - tags: \["haskell","optics"]
    - later: true

- [alexnask/ctregex.zig](https://github.com/alexnask/ctregex.zig/tree/master) — ctregex.zig

  - \[meta]:

    - date: 06/12/2026
    - tags: \["regex","zig"]
    - later: true

- [jameysharp/pikevm](https://github.com/jameysharp/pikevm) — Pike VM regex implementation

  - \[meta]:

    - date: 06/12/2026
    - tags: \["regex","nfa"]
    - later: true

- [rust-lang/regex](https://github.com/rust-lang/regex/blob/master/regex-syntax/src/ast/parse.rs) — regex-syntax AST parser

  - \[meta]:

    - date: 06/12/2026
    - tags: \["regex","rust"]
    - later: true

- [abhinav/git-spice](https://github.com/abhinav/git-spice) — git-spice

  - \[meta]:

    - date: 06/12/2026
    - tags: \["git","tooling"]
    - later: true

- [google/re2](https://github.com/google/re2) — RE2 implementation

  - \[meta]:

    - date: 06/08/2026
    - tags: \["regex"]

- [ryoppippi/ccusage](https://github.com/ryoppippi/ccusage) — Token Usage

  - \[meta]:

    - date: 06/08/2026
    - tags: \["agents"]

- [vllm-project/vllm](https://github.com/vllm-project/vllm/pull/37160/changes) — vLLM CPU KV cache offloading PR

  - \[meta]:

    - date: 06/08/2026
    - tags: \["kv","offloading"]
    - later: true

- [ovg-project/kvcached](https://github.com/ovg-project/kvcached) — ovg-project/kvcached

  - \[meta]:

    - date: 06/08/2026
    - tags: \["kv","virtualization"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/pull/39446/changes) — vLLM parse\_delta streaming parser refactor

  - \[meta]:

    - date: 06/08/2026
    - tags: \["vllm","parser"]
    - later: true

- [vllm-project/vllm#39728](https://github.com/vllm-project/vllm/pull/39728) — vLLM parse\_delta simplification

  - \[meta]:

    - date: 06/08/2026
    - tags: \["vllm","parser"]
    - later: true

- [stas00/the-art-of-debugging](https://github.com/stas00/the-art-of-debugging/blob/master/pytorch/README.md#auto-dumping-desired-tensor-attributes) — PyTorch tensor attribute auto-dumping

  - \[meta]:

    - date: 06/08/2026
    - tags: \["debugging","pytorch"]
    - later: true

- [xl0/lovely-tensors](https://github.com/xl0/lovely-tensors/) — lovely-tensors

  - \[meta]:

    - date: 06/08/2026
    - tags: \["pytorch","visualization"]
    - later: true

- [LaurieWired/tailslayer](https://github.com/LaurieWired/tailslayer/blob/main/README.md) — TailSlayer README

  - \[meta]:

    - date: 06/08/2026
    - tags: \["latency","memory"]
    - later: true

- [copilot/c](https://github.com/copilot/c/4a332a3a-f088-4de2-bea5-2ec5fac400ce) — Copilot coding session [`4a332a3`](https://github.com/aarnphm/aarnphm.github.io/commit/4a332a3a)

  - \[meta]:

    - date: 06/08/2026
    - tags: \["agents","coding"]
    - later: true

- [karpathy/autoresearch](https://github.com/karpathy/autoresearch/blob/master/program.md) — autoresearch program

  - \[meta]:

    - date: 06/08/2026
    - tags: \["agents","research"]
    - later: true

- [flashinfer-ai/flashinfer-bench](https://github.com/flashinfer-ai/flashinfer-bench) — flashinfer-bench

  - \[meta]:

    - date: 06/08/2026
    - tags: \["benchmark","inference"]
    - later: true

- [deepseek-ai/DeepGEMM#304](https://github.com/deepseek-ai/DeepGEMM/pull/304) — DeepGEMM Mega MoE and FP4 indexer PR

  - \[meta]:

    - date: 06/08/2026
    - tags: \["gemm","moe"]
    - later: true

- [GeeeekExplorer/nano-vllm](https://github.com/GeeeekExplorer/nano-vllm) — nano-vllm

  - \[meta]:

    - date: 06/08/2026
    - tags: \["inference","llm"]
    - later: true

- [cloudflare/pingora](https://github.com/cloudflare/pingora) — Pingora

  - \[meta]:

    - date: 06/08/2026
    - tags: \["networking","rust"]
    - later: true

- [modularml/modular](https://github.com/modularml/modular) — Modular

  - \[meta]:

    - date: 06/08/2026
    - tags: \["mojo","max"]
    - later: true

- [safety-research/petri](https://github.com/safety-research/petri/blob/main/src/petri/scorers/judge.py) — PETRI judge scorer

  - \[meta]:

    - date: 06/08/2026
    - tags: \["evals","alignment"]
    - later: true

- [mlc-ai/xgrammar](https://github.com/mlc-ai/xgrammar/blob/main/cpp/earley_parser.cc) — xgrammar Earley parser

  - \[meta]:

    - date: 06/08/2026
    - tags: \["structured outputs","parser"]
    - later: true

- [triton-lang/triton](https://github.com/triton-lang/triton/blob/main/lib/Dialect/TritonInstrument/Transforms/FpSanitizer.cpp) — Triton FPSanitizer transform

  - \[meta]:

    - date: 06/08/2026
    - tags: \["triton","sanitizer"]
    - later: true

- [triton-lang/triton#10177](https://github.com/triton-lang/triton/pull/10177) — Triton FPSAN docs PR

  - \[meta]:

    - date: 06/08/2026
    - tags: \["triton","sanitizer"]
    - later: true

- [UKPLab/tmlr2026-manifold-analysis](https://github.com/UKPLab/tmlr2026-manifold-analysis) — TMLR 2026 manifold analysis

  - \[meta]:

    - date: 06/08/2026
    - tags: \["manifolds","interpretability"]
    - later: true

- [ruipeterpan/marconi](https://github.com/ruipeterpan/marconi) — Marconi prefix caching

  - \[meta]:

    - date: 06/08/2026
    - tags: \["prefix caching","inference"]
    - later: true

- <https://gist.github.com/aparente/e48c353755958621b3c0004593105a90> — tufte-viz Claude Code skill

  - \[meta]:

    - date: 06/08/2026
    - tags: \["visualization","skills"]
    - later: true

- [folke/todo-comments.nvim](https://github.com/folke/todo-comments.nvim) — todo-comments.nvim

  - \[meta]:

    - date: 06/08/2026
    - tags: \["neovim","plugin"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/tree/main/vllm/renderers) — vLLM renderers

  - \[meta]:

    - date: 06/08/2026
    - tags: \["vllm","templates"]
    - later: true

- [nuvic/flexoki-nvim](https://github.com/nuvic/flexoki-nvim/blob/main/lua/flexoki.lua) — flexoki-nvim color scheme

  - \[meta]:

    - date: 06/08/2026
    - tags: \["neovim","colors"]
    - later: true

- [lukas-reineke/cbfmt](https://github.com/lukas-reineke/cbfmt) — cbfmt

  - \[meta]:

    - date: 06/08/2026
    - tags: \["markdown","formatter"]
    - later: true

- [jackyzha0/quartz](https://github.com/jackyzha0/quartz/blob/v5/quartz.lock.json) — Quartz v5 lockfile

  - \[meta]:

    - date: 06/08/2026
    - tags: \["quartz","dependencies"]
    - later: true

- [google/afl](https://github.com/google/afl) — American Fuzzy Lop

  - \[meta]:

    - date: 06/08/2026
    - tags: \["fuzzing","security"]
    - later: true

- [pierrecomputer/pierre](https://github.com/pierrecomputer/pierre/blob/main/packages/trees/src/render/FileTree.ts) — pierre FileTree renderer

  - \[meta]:

    - date: 06/08/2026
    - tags: \["file tree","ui"]
    - later: true

- [Yifei-Zuo/Parallax](https://github.com/Yifei-Zuo/Parallax/) — Parallax

  - \[meta]:

    - date: 06/08/2026
    - tags: \["attention","architecture"]
    - later: true

- [russellromney/honker](https://github.com/russellromney/honker) — honker

  - \[meta]:

    - date: 06/08/2026
    - tags: \["sqlite","pubsub"]
    - later: true

- [SWE-agent/mini-swe-agent](https://github.com/SWE-agent/mini-swe-agent) — mini-swe-agent

  - \[meta]:

    - date: 06/08/2026
    - tags: \["agents","cli"]
    - later: true

- [ai-dynamo/frontend-crates](https://github.com/ai-dynamo/frontend-crates/tree/main/parsers) — Dynamo frontend parsers

  - \[meta]:

    - date: 06/08/2026
    - tags: \["parser","inference"]
    - later: true

- [vllm-project/vllm](https://github.com/vllm-project/vllm/blob/main/rust/src/tool-parser/src/qwen_coder.rs) — vLLM Qwen Coder tool parser

  - \[meta]:

    - date: 06/08/2026
    - tags: \["vllm","parser"]
    - later: true

- [modularml/mammoth#3321](https://github.com/modularml/mammoth/pull/3321) — Mammoth tokenizer subsystem rewrite PR

  - \[meta]:

    - date: 06/08/2026
    - tags: \["tokenizer","max"]
    - later: true

- [modularml/modular](https://github.com/modularml/modular/pull/86427/changes#diff-0a17e0d187ae85d6197018d02acd3ff76f7692668c3cd33b0b154ad49bd6a70c) — Modular Kimi K2.5 Mojo BPE PR

  - \[meta]:

    - date: 06/08/2026
    - tags: \["tokenizer","mojo"]
    - later: true

- [rust-lang/regex](https://github.com/rust-lang/regex/blob/master/regex-automata/src/lib.rs) — regex-automata lib.rs

  - \[meta]:

    - date: 06/08/2026
    - tags: \["regex","rust"]
    - later: true

- [open-spaced-repetition/awesome-fsrs](https://github.com/open-spaced-repetition/awesome-fsrs/wiki/The-mechanism-of-optimization) — FSRS mechanism of optimization

  - \[meta]:

    - date: 06/08/2026
    - tags: \["spaced repetition","optimization"]
    - later: true

- [kvcache-ai/ktransformers](https://github.com/kvcache-ai/ktransformers/blob/main/doc/en/Kimi-K2.5.md) — Running Kimi-K2.5 with SGLang and KT-Kernel

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","sglang"]
    - later: true

- [kvcache-ai/ktransformers](https://github.com/kvcache-ai/ktransformers) — KTransformers

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","optimization"]
    - later: true

- [lucasb-eyer/dotfiles](https://github.com/lucasb-eyer/dotfiles/blob/master/_codex/prompts/lbreview.md) — lbreview prompt

  - \[meta]:

    - date: 06/07/2026
    - tags: \["code review","prompts"]
    - later: true

- [VikramKarLex/mamba3-minimal](https://github.com/VikramKarLex/mamba3-minimal) — Mamba-3 minimal

  - \[meta]:

    - date: 06/07/2026
    - tags: \["mamba","pytorch"]
    - later: true

- [tim-hua-01/ai-psychosis](https://github.com/tim-hua-01/ai-psychosis/blob/main/characters/colin_reality.txt) — Colin reality character file

  - \[meta]:

    - date: 06/07/2026
    - tags: \["ai psychosis","evals"]
    - later: true

- [gpu-mode/resource-stream](https://github.com/gpu-mode/resource-stream) — GPU Mode resource stream

  - \[meta]:

    - date: 06/07/2026
    - tags: \["gpu","resources"]
    - later: true

- [karpathy/autoresearch](https://github.com/karpathy/autoresearch/blob/master/train.py) — autoresearch train.py

  - \[meta]:

    - date: 06/07/2026
    - tags: \["research","training"]
    - later: true

- [tanishqkumar/ssd](https://github.com/tanishqkumar/ssd/blob/main/ssd/engine/speculator_async.py) — SSD async speculator

  - \[meta]:

    - date: 06/07/2026
    - tags: \["speculative decoding","inference"]
    - later: true

- [allenai/olmo-core](https://github.com/allenai/olmo-core) — OLMo-core

  - \[meta]:

    - date: 06/07/2026
    - tags: \["llm","training"]
    - later: true

- [novitalabs/pegaflow](https://github.com/novitalabs/pegaflow/blob/master/python/README.md) — Pegaflow Python README

  - \[meta]:

    - date: 06/07/2026
    - tags: \["kv","inference"]
    - later: true

- [novitalabs/pegaflow](https://github.com/novitalabs/pegaflow/blob/master/pegaflow-transfer/README.md) — Pegaflow transfer README

  - \[meta]:

    - date: 06/07/2026
    - tags: \["kv","rdma"]
    - later: true

- <https://github.com/paradigms-of-intelligence> — Paradigms of Intelligence

  - \[meta]:

    - date: 06/07/2026
    - tags: \["organization","intelligence"]
    - later: true

- [aarnphm/aarnphm.github.io@`cb0a032` (comment)](https://github.com/aarnphm/aarnphm.github.io/commit/cb0a0326fb02bc6f873ed88095c9c196cbf6994b#diff-f624a8618d0410d4fb3081584fd87c7e21656303bd90eb8afc0de5f021cdad68) — aarnphm.github.io commit [`cb0a032`](https://github.com/aarnphm/aarnphm.github.io/commit/cb0a032)

  - \[meta]:

    - date: 06/07/2026
    - tags: \["garden","commit"]
    - later: true

- [openai/parameter-golf](https://github.com/openai/parameter-golf/blob/main/records/track_10min_16mb/2026-03-17_NaiveBaseline/train_gpt.py) — parameter-golf train\_gpt.py

  - \[meta]:

    - date: 06/07/2026
    - tags: \["llm","challenge"]
    - later: true

- [mlc-ai/xgrammar](https://github.com/mlc-ai/xgrammar/blob/main/python/xgrammar/kernels/apply_token_bitmask_inplace_torch_compile.py) — xgrammar token bitmask kernel

  - \[meta]:

    - date: 06/07/2026
    - tags: \["structured outputs","kernel"]
    - later: true

- [NVIDIA/TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs%2Fsource%2Fblogs%2Ftech_blog%2Fblog12_Combining_Guided_Decoding_and_Speculative_Decoding.md) — Combining guided decoding and speculative decoding

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","decoding"]
    - later: true

- [jakubkrehel/make-interfaces-feel-better](https://github.com/jakubkrehel/make-interfaces-feel-better) — make interfaces feel better

  - \[meta]:

    - date: 06/07/2026
    - tags: \["design","skills"]
    - later: true

- [aarnphm/agents](https://github.com/aarnphm/agents/blob/main/agents/cartographer.md) — cartographer agent

  - \[meta]:

    - date: 06/07/2026
    - tags: \["agents","cartography"]
    - later: true

- [jaxson/ai-policy-course](https://github.com/jaxson/ai-policy-course) — Applied AI systems and governance course

  - \[meta]:

    - date: 06/07/2026
    - tags: \["ai policy","course"]
    - later: true

- [firecracker-microvm/firecracker](https://github.com/firecracker-microvm/firecracker) — Firecracker

  - \[meta]:

    - date: 06/07/2026
    - tags: \["microvm","serverless"]
    - later: true

- [dreadnode/agent-lens](https://github.com/dreadnode/agent-lens) — Agent Lens

  - \[meta]:

    - date: 06/07/2026
    - tags: \["agents","observability"]
    - later: true

- [NVlabs/cutile-rs](https://github.com/NVlabs/cutile-rs) — cuTile Rust

  - \[meta]:

    - date: 06/07/2026
    - tags: \["rust","gpu"]
    - later: true

- [FlashSampling/FlashSampling](https://github.com/FlashSampling/FlashSampling) — FlashSampling

  - \[meta]:

    - date: 06/07/2026
    - tags: \["sampling","inference"]
    - later: true

- [iree-org/iree](https://github.com/iree-org/iree/blob/main/runtime/src/iree/tokenizer/README.md) — IREE tokenizer README

  - \[meta]:

    - date: 06/07/2026
    - tags: \["tokenizer","runtime"]
    - later: true

- [jakubkrehel/make-interfaces-feel-better](https://github.com/jakubkrehel/make-interfaces-feel-better/blob/main/skills/make-interfaces-feel-better/SKILL.md) — make interfaces feel better skill

  - \[meta]:

    - date: 06/07/2026
    - tags: \["design","skills"]
    - later: true

- [imbue-ai/offload](https://github.com/imbue-ai/offload) — Offload

  - \[meta]:

    - date: 06/07/2026
    - tags: \["testing","compute"]
    - later: true

- [ai-dynamo/nixl](https://github.com/ai-dynamo/nixl) — NIXL

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","transfer"]
    - later: true

- [copilot/c](https://github.com/copilot/c/61c0659d-1840-42aa-a738-d9cdf45ed745) — Copilot coding session [`61c0659`](https://github.com/aarnphm/aarnphm.github.io/commit/61c0659d)

  - \[meta]:

    - date: 06/07/2026
    - tags: \["agents","coding"]
    - later: true

- [llm-d/llm-d-kv-cache](https://github.com/llm-d/llm-d-kv-cache/tree/main/kv_connectors/llmd_fs_backend) — llm-d filesystem KV connector

  - \[meta]:

    - date: 06/07/2026
    - tags: \["kv","inference"]
    - later: true

- [flashinfer-ai/flashinfer](https://github.com/flashinfer-ai/flashinfer/pull/2917/changes#diff-6669e2f453f75b5b113ff05d8eeb153517a361322c48e56f7444316fdb43860b) — FlashInfer PR 2917 changes

  - \[meta]:

    - date: 06/07/2026
    - tags: \["kernel","inference"]
    - later: true

- [llm-d/llm-d-inference-scheduler?tab=readme-ov-file](https://github.com/llm-d/llm-d-inference-scheduler?tab=readme-ov-file) — llm-d inference scheduler

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","scheduler"]
    - later: true

- [llm-d/llm-d-inference-scheduler](https://github.com/llm-d/llm-d-inference-scheduler/blob/main/docs/architecture.md) — llm-d inference scheduler architecture

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","architecture"]
    - later: true

- [llm-d/llm-d-inference-scheduler](https://github.com/llm-d/llm-d-inference-scheduler/tree/main) — llm-d inference scheduler tree

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","scheduler"]
    - later: true

- [ratatui/ratatui](https://github.com/ratatui/ratatui) — Ratatui

  - \[meta]:

    - date: 06/07/2026
    - tags: \["rust","tui"]
    - later: true

- [ShishirPatil/gorilla](https://github.com/ShishirPatil/gorilla/tree/main/berkeley-function-call-leaderboard) — Berkeley function-call leaderboard

  - \[meta]:

    - date: 06/07/2026
    - tags: \["tools","evaluation"]
    - later: true

- [viemccoy/excalibur](https://github.com/viemccoy/excalibur/blob/main/README.md) — Excalibur README

  - \[meta]:

    - date: 06/07/2026
    - tags: \["agents","harness"]
    - later: true

- [Dao-AILab/quack](https://github.com/Dao-AILab/quack/blob/main/quack/gemm_symmetric.py) — QuACK symmetric GEMM

  - \[meta]:

    - date: 06/07/2026
    - tags: \["kernel","gemm"]
    - later: true

- [Dao-AILab/gram-newton-schulz](https://github.com/Dao-AILab/gram-newton-schulz) — Gram Newton-Schulz

  - \[meta]:

    - date: 06/07/2026
    - tags: \["optimization","muon"]
    - later: true

- [modular/modular](https://github.com/modular/modular/blob/main/max/kernels/examples/pmpp/chapter_02/fig2_10.mojo) — Mojo PMPP fig2\_10

  - \[meta]:

    - date: 06/07/2026
    - tags: \["mojo","gpu"]
    - later: true

- [jd-opensource/xllm](https://github.com/jd-opensource/xllm/tree/main/xllm) — xLLM

  - \[meta]:

    - date: 06/07/2026
    - tags: \["inference","engine"]
    - later: true

- [WeianMao/triattention](https://github.com/WeianMao/triattention/blob/main/triattention/vllm/core/kernels/triton_scoring.py) — TriAttention vLLM triton scoring

  - \[meta]:

    - date: 06/07/2026
    - tags: \["vllm","kernel"]
    - later: true

- [guidance-ai/llguidance](https://github.com/guidance-ai/llguidance/tree/d787735640aebfe363b1a43ce8c79677432b65bc) — llguidance

  - \[meta]:

    - date: 06/07/2026
    - tags: \["structured outputs","inference"]
    - later: true

- [cloudflare/cloudflared](https://github.com/cloudflare/cloudflared) — cloudflared

  - \[meta]:

    - date: 06/07/2026
    - tags: \["cloudflare","tunnel"]
    - later: true

- [prinsss/node-tikzjax@`b85f302`](https://github.com/prinsss/node-tikzjax/commit/b85f30276c0a402af2d5b6f20279f31d7c291840) — node-tikzjax commit [`b85f302`](https://github.com/aarnphm/aarnphm.github.io/commit/b85f302)

  - \[meta]:

    - date: 06/07/2026
    - tags: \["latex","rendering"]
    - later: true

- [johndpope/ltx2-castlehill](https://github.com/johndpope/ltx2-castlehill) — CastleHill

  - \[meta]:

    - date: 06/07/2026
    - tags: \["video","diffusion"]
    - later: true

- [ai-dynamo/flextensor](https://github.com/ai-dynamo/flextensor) — FlexTensor

  - \[meta]:

    - date: 06/07/2026
    - tags: \["offloading","pytorch"]
    - later: true

- [prosekit/prosekit](https://github.com/prosekit/prosekit) — ProseKit

  - \[meta]:

    - date: 06/06/2026
    - tags: \["editor","framework"]
    - later: true

- [teorth/erdosproblems](https://github.com/teorth/erdosproblems/wiki/AI-contributions-to-Erd%C5%91s-problems) — AI contributions to Erdős problems

  - \[meta]:

    - date: 06/06/2026
    - tags: \["math","ai"]
    - later: true

- [facebook/lexical](https://github.com/facebook/lexical/blob/main/AGENTS.md) — Lexical agent guide

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","editor"]
    - later: true

- [modular/max-llm-book](https://github.com/modular/max-llm-book) — Build an LLM from scratch with MAX

  - \[meta]:

    - date: 06/06/2026
    - tags: \["max","llm"]
    - later: true

- [modular/stack-pr](https://github.com/modular/stack-pr) — stack-pr

  - \[meta]:

    - date: 06/06/2026
    - tags: \["github","workflow"]
    - later: true

- [anthropics/original\_performance\_takehome](https://github.com/anthropics/original_performance_takehome) — Anthropic original performance take-home

  - \[meta]:

    - date: 06/06/2026
    - tags: \["performance","interview"]
    - later: true

- [NVIDIA/TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/models/core/deepseek_v3#b200-fp4-max-throughput-config) — DeepSeek-V3 B200 FP4 throughput config in TensorRT-LLM

  - \[meta]:

    - date: 06/06/2026
    - tags: \["inference","blackwell"]
    - later: true

- [perplexityai/pplx-garden](https://github.com/perplexityai/pplx-garden) — Perplexity inference garden

  - \[meta]:

    - date: 06/06/2026
    - tags: \["inference","systems"]
    - later: true

- [deepseek-ai/DeepEP](https://github.com/deepseek-ai/DeepEP/blob/main/third-party/README.md) — DeepEP third-party dependencies

  - \[meta]:

    - date: 06/06/2026
    - tags: \["moe","distributed"]
    - later: true

- [NVIDIA/gdrcopy?tab=readme-ov-file](https://github.com/NVIDIA/gdrcopy?tab=readme-ov-file#build-and-installation) — GDRCopy build and installation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["gpudirect","rdma"]
    - later: true

- [HazyResearch/cartridges](https://github.com/HazyResearch/cartridges/blob/main/cartridges/cache.py) — Cartridges cache implementation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","long context"]
    - later: true

- [udecode/plate](https://github.com/udecode/plate) — Plate editor

  - \[meta]:

    - date: 06/06/2026
    - tags: \["editor","react"]
    - later: true

- [20urc3/Astra](https://github.com/20urc3/Astra) — Astra fuzzer

  - \[meta]:

    - date: 06/06/2026
    - tags: \["fuzzing","rust"]
    - later: true

- [NVIDIA/cutlass](https://github.com/NVIDIA/cutlass/blob/main/examples/python/CuTeDSL/notebooks/elementwise_add.ipynb) — CuTeDSL elementwise add notebook

  - \[meta]:

    - date: 06/06/2026
    - tags: \["cute","kernel"]
    - later: true

- [cannoneyed/isometric-nyc](https://github.com/cannoneyed/isometric-nyc/blob/main/inference/server.py) — isometric.nyc inference server

  - \[meta]:

    - date: 06/06/2026
    - tags: \["generative art","inference"]
    - later: true

- <https://gist.github.com/grahamhelton/f5c8ce265161990b0847ac05a74e466a> — Detection script for nodes/proxy

  - \[meta]:

    - date: 06/06/2026
    - tags: \["security","script"]
    - later: true

- [deepseek-ai/DeepSeek-OCR-2](https://github.com/deepseek-ai/DeepSeek-OCR-2/blob/main/DeepSeek_OCR2_paper.pdf) — DeepSeek-OCR 2 paper

  - \[meta]:

    - date: 06/06/2026
    - tags: \["ocr","vlm"]
    - later: true

- [LMCache/LMCache](https://github.com/LMCache/LMCache) — LMCache

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [tobi/qmd](https://github.com/tobi/qmd) — qmd

  - \[meta]:

    - date: 06/06/2026
    - tags: \["search","notes"]
    - later: true

- [M4THYOU/TokenDagger](https://github.com/M4THYOU/TokenDagger/blob/main/tokendagger/wrapper.py) — TokenDagger wrapper

  - \[meta]:

    - date: 06/06/2026
    - tags: \["tokenizer","performance"]
    - later: true

- [sgl-project/sglang](https://github.com/sgl-project/sglang/blob/e9d727cb9218f30a7352f2d17614d74ec0577062/python/sglang/bench_serving.py) — SGLang serving benchmark

  - \[meta]:

    - date: 06/06/2026
    - tags: \["benchmark","inference"]
    - later: true

- [sgl-project/sglang](https://github.com/sgl-project/sglang/blob/main/benchmark/mtbench/bench_sglang.py) — SGLang MT-Bench benchmark

  - \[meta]:

    - date: 06/06/2026
    - tags: \["benchmark","evaluation"]
    - later: true

- [rlplays/PufferLib?tab=readme-ov-file](https://github.com/rlplays/PufferLib?tab=readme-ov-file#multithreaded-libtorch-fork-of-pufferlib) — PufferLib multithreaded libtorch fork

  - \[meta]:

    - date: 06/06/2026
    - tags: \["rl","performance"]
    - later: true

- [deepseek-ai/DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3/tree/main) — DeepSeek-V3

  - \[meta]:

    - date: 06/06/2026
    - tags: \["models","moe"]
    - later: true

- [modular/mojo-gpu-puzzles](https://github.com/modular/mojo-gpu-puzzles/tree/main/book) — Mojo GPU puzzles book

  - \[meta]:

    - date: 06/06/2026
    - tags: \["mojo","gpu"]
    - later: true

- [excalidraw/excalidraw-mcp](https://github.com/excalidraw/excalidraw-mcp) — Excalidraw MCP

  - \[meta]:

    - date: 06/06/2026
    - tags: \["mcp","drawing"]
    - later: true

- [modular/modular](https://github.com/modular/modular/blob/main/max/CONTRIBUTING.md) — MAX contributor guide

  - \[meta]:

    - date: 06/06/2026
    - tags: \["max","contributing"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/fault_tolerance/graceful_shutdown.md) — Dynamo graceful shutdown

  - \[meta]:

    - date: 06/06/2026
    - tags: \["inference","fault tolerance"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_architecture.md) — Dynamo KVBM architecture

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_components.md) — Dynamo KVBM components

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_design_deepdive.md) — Dynamo KVBM design deep dive

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_integrations.md) — Dynamo KVBM integrations

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_intro.rst) — Dynamo KVBM intro

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/kvbm_motivation.md) — Dynamo KVBM motivation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","inference"]
    - later: true

- [ai-dynamo/dynamo](https://github.com/ai-dynamo/dynamo/blob/main/docs/kvbm/vllm-setup.md) — Dynamo KVBM vLLM setup

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","vllm"]
    - later: true

- <https://gist.github.com/gcr/47a8f2baaa5810087615b4a858619fe5> — undoing-the-pain.org.md

  - \[meta]:

    - date: 06/06/2026
    - tags: \["notes","psychology"]
    - later: true

- [NVIDIA/cutlass](https://github.com/NVIDIA/cutlass/blob/main/examples/python/CuTeDSL/blackwell/grouped_blockscaled_gemm.py) — CuTeDSL Blackwell grouped blockscaled GEMM

  - \[meta]:

    - date: 06/06/2026
    - tags: \["cute","blackwell"]
    - later: true

- [AnswerDotAI/mojokernel](https://github.com/AnswerDotAI/mojokernel/blob/main/mojokernel/engines/server_engine.py) — mojokernel server engine

  - \[meta]:

    - date: 06/06/2026
    - tags: \["mojo","jupyter"]
    - later: true

- [LMCache/LMCache](https://github.com/LMCache/LMCache/blob/dev/lmcache/integration/vllm/vllm_v1_adapter.py) — LMCache vLLM V1 adapter

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","vllm"]
    - later: true

- [can1357/oh-my-pi](https://github.com/can1357/oh-my-pi/tree/main/packages/react-edit-benchmark) — react-edit-benchmark in oh-my-pi

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","benchmark"]
    - later: true

- [jessfraz/dotfiles@`8bdbf7f`](https://github.com/jessfraz/dotfiles/commit/8bdbf7f63d9f53d807995b3c41b87b935fb8e7ec) — Jess Frazelle dotfiles commit

  - \[meta]:

    - date: 06/06/2026
    - tags: \["dotfiles","linux"]
    - later: true

- [orozery/playground](https://github.com/orozery/playground/tree/kv-offloading-blog-dec-2025/kvcache/gpu_cpu_benchmark) — GPU/CPU KV-cache benchmark

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kv","benchmark"]
    - later: true

- [EleutherAI/lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness/blob/98c8a2423b5b2bfdc946585c5f75dd420c57a87b/lm_eval/models/api_models.py) — lm-evaluation-harness API models

  - \[meta]:

    - date: 06/06/2026
    - tags: \["evaluation","llm"]
    - later: true

- [bentoml/modularcloud](https://github.com/bentoml/modularcloud/blob/main/dashboard/src/UiApp.tsx) — Modular Cloud dashboard UI

  - \[meta]:

    - date: 06/06/2026
    - tags: \["frontend","dashboard"]
    - later: true

- [NVIDIA/gdrcopy#315](https://github.com/NVIDIA/gdrcopy/issues/315) — GDR D2H much slower than H2D and cudaMemcpy

  - \[meta]:

    - date: 06/06/2026
    - tags: \["gpudirect","performance"]
    - later: true

- [eudoxia0/flashcards](https://github.com/eudoxia0/flashcards) — eudoxia0 flashcards

  - \[meta]:

    - date: 06/06/2026
    - tags: \["flashcards","spaced repetition"]
    - later: true

- [badlogic/pi-mono](https://github.com/badlogic/pi-mono/) — pi-mono

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","cli"]
    - later: true

- [facebookexperimental/triton](https://github.com/facebookexperimental/triton) — facebookexperimental/triton

  - \[meta]:

    - date: 06/06/2026
    - tags: \["triton","compiler"]
    - later: true

- <https://gist.github.com/karpathy/8627fe009c40f57531cb18360106ce95> — Karpathy gist

  - \[meta]:

    - date: 06/06/2026
    - tags: \["notes","ai"]
    - later: true

- [Dao-AILab/quack](https://github.com/Dao-AILab/quack/blob/main/media/2025-07-10-membound-sol.md) — mem-bound solution in QuACK

  - \[meta]:

    - date: 06/06/2026
    - tags: \["kernel","memory"]
    - later: true

- [lucidrains/hyper-connections](https://github.com/lucidrains/hyper-connections) — Hyper Connections

  - \[meta]:

    - date: 06/06/2026
    - tags: \["architecture","residuals"]
    - later: true

- [tokenbender/mHC-manifold-constrained-hyper-connections](https://github.com/tokenbender/mHC-manifold-constrained-hyper-connections) — mHC manifold-constrained hyper-connections

  - \[meta]:

    - date: 06/06/2026
    - tags: \["architecture","residuals"]
    - later: true

- <https://gist.github.com/mikasenghaas/f3663a1f26acbb95cc880db12e9547ea> — Dot Product Benchmark (NVIDIA A100-PCIE-40GB)

  - \[meta]:

    - date: 06/06/2026
    - tags: \["benchmark","gpu"]
    - later: true

- [tokenbender/mHC-manifold-constrained-hyper-connections](https://github.com/tokenbender/mHC-manifold-constrained-hyper-connections/tree/feat/vres-mhc-combined) — vres-mhc-combined

  - \[meta]:

    - date: 06/06/2026
    - tags: \["architecture","residuals"]
    - later: true

- [NVlabs/alpamayo](https://github.com/NVlabs/alpamayo) — NVlabs/alpamayo

  - \[meta]:

    - date: 06/06/2026
    - tags: \["models"]
    - later: true

- [fla-org/flash-linear-attention](https://github.com/fla-org/flash-linear-attention/blob/main/fla/layers/delta_net.py) — DeltaNet layer in Flash Linear Attention

  - \[meta]:

    - date: 06/06/2026
    - tags: \["architecture","attention"]
    - later: true

- [tile-ai/tilelang](https://github.com/tile-ai/tilelang) — TileLang

  - \[meta]:

    - date: 06/06/2026
    - tags: \["gpu","kernel"]
    - later: true

- [NVIDIA/cutlass](https://github.com/NVIDIA/cutlass/blob/v3.5.1/media/docs/cute/01_layout.md) — CuTe layout documentation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["gpu","kernel"]
    - later: true

- [python/cpython](https://github.com/python/cpython/blob/51a56a3a7bd8cf05ceda65e843fb7bae40509799/Python/ceval_gil.c#L88) — CPython GIL eval loop

  - \[meta]:

    - date: 06/06/2026
    - tags: \["python","concurrency"]
    - later: true

- [AI-Hypercomputer/JetStream](https://github.com/AI-Hypercomputer/JetStream) — JetStream

  - \[meta]:

    - date: 06/06/2026
    - tags: \["inference","tpu"]
    - later: true

- [python/cpython](https://github.com/python/cpython/blob/main/Objects/genobject.c) — CPython generator object implementation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["python","runtime"]
    - later: true

- [socketteer/Claude-Conversation-Exporter](https://github.com/socketteer/Claude-Conversation-Exporter) — Claude Conversation Exporter

  - \[meta]:

    - date: 06/06/2026
    - tags: \["claude","tools"]
    - later: true

- [deepseek-ai/DeepSeek-V3.2-Exp](https://github.com/deepseek-ai/DeepSeek-V3.2-Exp/blob/main/DeepSeek_V3_2.pdf) — DeepSeek V3.2-Exp technical report

  - \[meta]:

    - date: 06/06/2026
    - tags: \["models","papers"]
    - later: true

- [repomirrorhq/repomirror](https://github.com/repomirrorhq/repomirror/blob/main/repomirror.md) — RepoMirror

  - \[meta]:

    - date: 06/06/2026
    - tags: \["repository","agents"]
    - later: true

- [jasmineee-li/zap-writing-plugin](https://github.com/jasmineee-li/zap-writing-plugin) — Zap Writing Plugin

  - \[meta]:

    - date: 06/06/2026
    - tags: \["writing","obsidian"]
    - later: true

- [aarnphm/aarnphm.github.io](https://github.com/aarnphm/aarnphm.github.io/blob/main/content/influence.md) — influence.md

  - \[meta]:

    - date: 06/06/2026
    - tags: \["garden","writing"]
    - later: true

- [Piebald-AI/claude-code-system-prompts](https://github.com/Piebald-AI/claude-code-system-prompts) — Claude Code system prompts

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","prompts"]
    - later: true

- [anthropics/claude-code](https://github.com/anthropics/claude-code/tree/main/plugins/ralph-wiggum) — Ralph Wiggum plugin for Claude Code

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","orchestration"]
    - later: true

- [ekzhang/jax-js](https://github.com/ekzhang/jax-js/blob/main/packages/loaders/src/tokenizers.ts) — tokenizers.ts in jax-js

  - \[meta]:

    - date: 06/06/2026
    - tags: \["tokenizer","webgpu"]
    - later: true

- [anthropics/claude-code](https://github.com/anthropics/claude-code/blob/main/plugins/ralph-wiggum/README.md) — Ralph Wiggum plugin README

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","orchestration"]
    - later: true

- [mikeyobrien/ralph-orchestrator](https://github.com/mikeyobrien/ralph-orchestrator/blob/main/PROMPT.md) — Ralph orchestrator prompt

  - \[meta]:

    - date: 06/06/2026
    - tags: \["agents","orchestration"]
    - later: true

- [drizzle-team/drizzle-orm](https://github.com/drizzle-team/drizzle-orm/discussions/1388) — Drizzle ORM discussion 1388

  - \[meta]:

    - date: 06/06/2026
    - tags: \["database","orm"]
    - later: true

- [rough-stuff/rough-notation](https://github.com/rough-stuff/rough-notation/blob/main/README.md) — Rough Notation README

  - \[meta]:

    - date: 06/06/2026
    - tags: \["annotation","design"]
    - later: true

- [rough-stuff/rough-notation](https://github.com/rough-stuff/rough-notation/blob/master/src/rough-notation.ts) — rough-notation.ts

  - \[meta]:

    - date: 06/06/2026
    - tags: \["annotation","design"]
    - later: true

- [ceselder/dreaming-vectors](https://github.com/ceselder/dreaming-vectors) — dreaming vectors

  - \[meta]:

    - date: 06/06/2026
    - tags: \["interpretability","steering"]
    - later: true

- [deepseek-ai/Engram](https://github.com/deepseek-ai/Engram) — Engram

  - \[meta]:

    - date: 06/06/2026
    - tags: \["memory","sparsity"]
    - later: true

- [robert-mcdermott/ai-knowledge-graph](https://github.com/robert-mcdermott/ai-knowledge-graph) — AI Knowledge Graph

  - \[meta]:

    - date: 06/06/2026
    - tags: \["knowledge graph","llm"]
    - later: true

- [pygma-tau/reverse-rss-reader](https://github.com/pygma-tau/reverse-rss-reader) — reverse-rss-reader

  - \[meta]:

    - date: 06/06/2026
    - tags: \["rss","reader"]
    - later: true

- [patrick-toulme/justabyte](https://github.com/patrick-toulme/justabyte/blob/main/tpu_pallas_post/pallas_reference.py) — Pallas reference implementation

  - \[meta]:

    - date: 06/06/2026
    - tags: \["tpu","pallas"]
    - later: true

- [mixmark-io/turndown](https://github.com/mixmark-io/turndown) — Turndown

  - \[meta]:

    - date: 06/06/2026
    - tags: \["markdown","parser"]
    - later: true

- [trailofbits/skills](https://github.com/trailofbits/skills/blob/main/plugins/culture-index/skills/interpreting-culture-index/SKILL.md) — Culture Index skill

  - \[meta]:

    - date: 06/06/2026
    - tags: \["skills","agents"]
    - later: true

- [NVIDIA/TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/tech_blog/blog2_DeepSeek_R1_MTP_Implementation_and_Optimization.md) — DeepSeek-R1 MTP in TensorRT-LLM

  - \[meta]:

    - date: 06/06/2026
    - tags: \["inference","optimization"]
    - later: true

- [deepseek-ai/DeepEP#101](https://github.com/deepseek-ai/DeepEP/issues/101) — Why not DeepSeek-V3 choose EP128\*PP16 during pretraining

  - \[meta]:

    - date: 06/06/2026
    - tags: \["moe","distributed"]
    - later: true

- [deepseek-ai/DeepEP](https://github.com/deepseek-ai/DeepEP) — DeepEP

  - \[meta]:

    - date: 06/06/2026
    - tags: \["moe","distributed"]
    - later: true

- [uccl-project/uccl](https://github.com/uccl-project/uccl/tree/main/ep) — UCCL expert parallelism

  - \[meta]:

    - date: 06/06/2026
    - tags: \["moe","distributed"]
    - later: true

- [antgroup/DeepXTrace](https://github.com/antgroup/DeepXTrace) — DeepXTrace

  - \[meta]:

    - date: 06/06/2026
    - tags: \["profiling","deepep"]
    - later: true

- [anthropics/skills](https://github.com/anthropics/skills) — Anthropic Skills

  - \[meta]:

    - date: 06/06/2026
    - tags: \["skills","agents"]
    - later: true

- [ROCm/mori](https://github.com/ROCm/mori) — MORI

  - \[meta]:

    - date: 06/06/2026
    - tags: \["rdma","rocm"]
    - later: true

- [upstash/context7](https://github.com/upstash/context7) — Context7

  - \[meta]:

    - date: 06/06/2026
    - tags: \["mcp","documentation"]
    - later: true

- [vosen/ZLUDA](https://github.com/vosen/ZLUDA) — ZLUDA

  - \[meta]:

    - date: 06/06/2026
    - tags: \["cuda","rocm"]
    - later: true

- [cassidoo/blahg](https://github.com/cassidoo/blahg) — blahg

  - \[meta]:

    - date: 06/06/2026
    - tags: \["blog","astro"]
    - later: true

- [saghen/frizbee](https://github.com/saghen/frizbee) — frizbee

  - \[meta]:

    - date: 06/06/2026
    - tags: \["fuzzy matching","simd"]
    - later: true

- [PrimeIntellect-ai/prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) — prime-rl

  - \[meta]:

    - date: 06/06/2026
    - tags: \["rl","training"]
    - later: true

- [trailofbits/skills](https://github.com/trailofbits/skills) — Trail of Bits skills

  - \[meta]:

    - date: 06/06/2026
    - tags: \["skills","security"]
    - later: true

- [eudoxia0/hashcards](https://github.com/eudoxia0/hashcards) — Hashcards

  - \[meta]:

    - date: 06/05/2026
    - socials: {"blog":"https\://borretti.me/article/effective-spaced-repetition"}
    - tags: \["spaced repetition"]

- [kitft/natural\_language\_autoencoders](https://github.com/kitft/natural_language_autoencoders) — NLA

  - \[meta]:

    - date: 06/03/2026
    - tags: \["interpretability"]

- [google-deepmind/gemma\_penzai](https://github.com/google-deepmind/gemma_penzai)

  - \[meta]:

    - date: 01/19/2026
    - tags: \["interpretability","visualisation"]
    - later: true

- [Dao-AILab/sonic-moe](https://github.com/Dao-AILab/sonic-moe)

  - \[meta]:

    - date: 01/02/2026
    - tags: \["kernel"]

- [Noumena-Network/nmoe](https://github.com/Noumena-Network/nmoe)

  - \[meta]:

    - date: 01/02/2026
    - tags: \["inference"]

- [pranjalssh/fast.cu](https://github.com/pranjalssh/fast.cu) — fast kernels, in [CUDA](/thoughts/GPU-programming)

  - \[meta]:

    - date: 10/02/2025
    - tags: \["kernel"]

- [IST-DASLab/FP-Quant](https://github.com/IST-DASLab/FP-Quant) — IST-DASLab/FP-Quant

  - \[meta]:

    - date: 10/06/2025
    - tags: \["quantisation"]

  - Microscaling FP4 Quantisation

- [NVlabs/QeRL](https://github.com/NVlabs/QeRL) — NVlabs/QeRL

  - \[meta]:

    - date: 10/24/2025
    - tags: \["rl"]

- [triton-lang/triton](https://github.com/triton-lang/triton/blob/a758c595ddb149381b7ee888982f1afbeb02823c/python/triton_kernels/triton_kernels/matmul_ogs_details/_matmul_ogs.py#L291) — matmul\_ogs for [mxfp4](/thoughts/quantization#mxfp4)

  - \[meta]:

    - date: 08/10/2025
    - tags: \["kernel"]

- [bitsandbytes-foundation/bitsandbytes](https://github.com/bitsandbytes-foundation/bitsandbytes/blob/63f538a4e492017dd4a52edfde142c4ca818d401/bitsandbytes/backends/triton/kernels_4bit.py#L155) — 4bit blockwise triton kernels

  - \[meta]:

    - date: 11/09/2025
    - tags: \["programming","inference"]

- [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention/blob/main/flash_attn/cute/flash_fwd_sm100.py) — FlashAttention 4 CuTE kernels for B200 \[\*\*]

  - \[meta]:

    - date: 11/09/2025
    - tags: \["kernel"]
    - highlighted: true

- [HazyResearch/cartridges](https://github.com/HazyResearch/cartridges)

  - \[meta]:

    - date: 11/27/2025
    - tags: \["inference","kv"]

- [facebookresearch/coconut](https://github.com/facebookresearch/coconut) — Training Large Language Model to Reason in a Continuous Latent Space

  - \[meta]:

    - date: 11/28/2025
    - tags: \["ml"]

  - see also [Hao et al. (2025)](#bib-hao2025traininglargelanguagemodels)

- [NVIDIA-NeMo/Emerging-Optimizers](https://github.com/NVIDIA-NeMo/Emerging-Optimizers)

  - \[meta]:

    - date: 12/17/2025
    - tags: \["training","algorithm"]

- [NVIDIA/cuda-tile](https://github.com/NVIDIA/cuda-tile)

  - \[meta]:

    - date: 01/02/2026
    - tags: \["gpu","ir"]
    - pinned: true

- [teorth/pfr](https://github.com/teorth/pfr) — formalization of the Polynomial Freiman Ruzsa conjecture

  - \[meta]:

    - date: 10/12/2025
    - tags: \["math"]

- [NVIDIA/tilus](https://github.com/NVIDIA/tilus) — NVIDIA/tilus

  - \[meta]:

    - date: 10/02/2025
    - tags: \["gpu programming"]
    - pinned: true

  - Tile-level GPU programming

  - lower level comparing to CuTe

  - uses [hidet](https://github.com/hidet-org/hidet) IR

- [replit/ruspty#93](https://github.com/replit/ruspty/pull/93) — dont drop user fd until node reads a synthetic EOF

  - \[meta]:

    - date: 10/02/2025
    - tags: \["engineering"]

- [francoismichel/ssh3](https://github.com/francoismichel/ssh3) — ssh3

  - \[meta]:

    - date: 09/29/2025
    - tags: \["protocol"]

- [Keen-Technologies/physical\_atari](https://github.com/Keen-Technologies/physical_atari) — Physical Atari

  - \[meta]:

    - date: 09/17/2025
    - tags: \["ai","physics","robots"]

- [luhmann/tufte-markdown](https://github.com/luhmann/tufte-markdown) — tufte-css \[\*\*]

  - \[meta]:

    - date: 10/07/2025
    - tags: \["design"]
    - highlighted: true

- [pytorch/helion](https://github.com/pytorch/helion)

  - \[meta]:

    - date: 12/16/2025
    - tags: \["gpu","kernel"]

  - Similar to CuteDSL, but similar primitives.

  - It does autotuning but most masking is implicit in Helion.

  - PyTorch with tiles

- [zhaochenyang20/Awesome-ML-SYS-Tutorial](https://github.com/zhaochenyang20/Awesome-ML-SYS-Tutorial) — RL Infra notes

  - \[meta]:

    - date: 12/16/2025
    - tags: \["inference","scaling"]

- [zechenzhangAGI/AI-research-SKILLs](https://github.com/zechenzhangAGI/AI-research-SKILLs) — Claude Skills for AI Research

  - \[meta]:

    - date: 12/15/2025
    - tags: \["foundry"]

  - have some vLLM skills, pretty neat

- [databricks/megablocks](https://github.com/databricks/megablocks) — Megablocks

  - \[meta]:

    - date: 12/15/2025
    - tags: \["training","moe"]

- [MoonshotAI/checkpoint-engine](https://github.com/MoonshotAI/checkpoint-engine) — MoonshotAI/checkpoint-engine

  - \[meta]:

    - date: 10/24/2025
    - tags: \["rl"]

- [modular/modular](https://github.com/modular/modular/blob/main/mojo/stdlib/stdlib/algorithm/_sorting_network.mojo)

  - \[meta]:

    - date: 10/17/2025
    - tags: \["topology","network"]

  - see also: <https://bertdobbelaere.github.io/sorting_networks.html>

- [bytedance/flux](https://github.com/bytedance/flux) — bytedance/flux

  - \[meta]:

    - date: 10/16/2025
    - tags: \["communication","networking"]

  - A fast communication-overlapping library for tensor/expert parallelism on GPUs.

  - COMET @ ByteDance

- [Dao-AILab/gemm-cublas](https://github.com/Dao-AILab/gemm-cublas) —GEMM cuBLAS

  - \[meta]:

    - date: 10/11/2025
    - tags: \["machine learning","kernel"]

- [pytorch/pytorch](https://github.com/pytorch/pytorch/blob/539c46b6e82e16d22b745d8b320ae0bf9b1df90b/torch/distributed/_functional_collectives.py#L333) — AllReduce coalesce implementation in PyTorch

  - \[meta]:

    - date: 10/06/2025
    - tags: \["programming","distributed"]