Efficient Triton Kernels for LLM Training
-
Updated
Jun 29, 2026 - Python
#
triton
Here are 424 public repositories matching this topic...
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
cuda triton attention vit quantization video-generation mlsys inference-acceleration efficient-attention llm llm-infra video-generate
-
Updated
Jan 17, 2026 - Cuda
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
-
Updated
Jan 28, 2026 - Jupyter Notebook
Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels.
-
Updated
Mar 19, 2026 - Python
A service for autodiscovery and configuration of applications running in containers
-
Updated
Sep 20, 2023 - Go
FlagGems is an operator library for large language models implemented in the Triton Language.
-
Updated
Jun 29, 2026 - Python
🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系
-
Updated
Jun 26, 2026 - Jupyter Notebook
Playing with the Tigress software protection. Break some of its protections and solve their reverse engineering challenges. Automatic deobfuscation using symbolic execution, taint analysis and LLVM.
llvm reverse-engineering symbolic-execution deobfuscation triton taint-analysis tigress tigress-protections solution-tigress-challenge
-
Updated
Nov 21, 2023 - LLVM
🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.
reinforcement-learning cuda yolo triton awesome-list llama gpt datasets vla r1 vlm ai4science aigc llm langchain mllm qwen deepseek ai4s qwen3
-
Updated
Aug 1, 2025
Trainable fast and memory-efficient sparse attention
-
Updated
Jun 30, 2026 - Python
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
-
Updated
May 13, 2026 - Python
🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
awesome hpc gpu cuda pytorch cublas triton blas llama cutlass cudnn gemm vlm tensorrt ptx tvm mlir llm tensorrt-llm deepseek
-
Updated
Aug 2, 2025
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
rust cuda pytorch triton quantization knowledge-distillation inference-engine jax kv-cache ml-systems llm mechanistic-interpretability fsdp flash-attention speculative-decoding paged-attention
-
Updated
Jun 5, 2026 - Python
LLVM based static binary analysis framework
analysis binary x86-64 llvm static-analysis deobfuscation triton x86 instruction-semantics program-analysis lifter llvm-ir
-
Updated
May 25, 2026 - C++
Automatic ROPChain Generation
reverse-engineering symbolic-execution triton pwn ctf rop rop-exploitation rop-gadgets binary-exploitation rop-chain exploit-development exploitdev
-
Updated
Mar 20, 2026 - Python
LLM algorithm practice lab with theory, solutions, and test cases.《大模型算法实战教程》面向大模型入门到进阶的算法实战教程，覆盖原理讲解、答案解析、测试用例与 CUDA/Triton 实战。
-
Updated
Jun 28, 2026 - Jupyter Notebook
Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
-
Updated
Jun 27, 2026 - Python
Improve this page
Add a description, image, and links to the triton topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton topic, visit your repo's landing page and select "manage topics."