rllm
rLLM is an open-source framework for training reinforcement learning AI agents.
- Region
- Overseas
- Pricing
- Free
- Open source
- Yes
- GitHub Stars
- ★ 5.6k
- Source
- GitHub
- Added
- 2026-06-06
- Last verified
- 2026-06-06
- GitHub
- github.com/rllm-org/rllm

Overview
rLLM is an open-source framework designed to train reinforcement learning AI agents. It addresses the issue of requiring extensive code modifications when training agents across different frameworks by supporting multiple existing agent frameworks and enabling automatic tracking and reward function definition with minimal code changes. Users can quickly get started with rLLM via command line or Python API to evaluate and train models. It is ideal for researchers and developers looking to simplify the reinforcement learning process.
Key features
- ▪Compatible with any agent framework
- ▪Minimal changes to existing code
- ▪50+ built-in benchmark tests
- ▪Supports multiple RL algorithms
- ▪Two optional training backends
Use cases
Pros
- +Easy integration with existing projects
- +Strong community support
- +Significantly improves performance for small models
Limitations / notes
- -Requires Python 3.11 or higher
- -Some features may depend on specific hardware
Who it's for
This overview was compiled by AI from public sources and may contain inaccuracies — please refer to the official site.
FAQ
How to install rLLM?
Install via pip: uv pip install 'rllm @ git+https://github.com/rllm-org/rllm.git'
Which RL algorithms does rLLM support?
Includes GRPO, REINFORCE, RLOO, and more
Similar agents
Cursor
FeaturedAI-powered code editor with Agent mode
Dify
FeaturedOpen-source LLMOps + Agent orchestration platform
扣子 Coze
FeaturedByteDance's no-code Agent/Bot building platform
Trae
FeaturedAI IDE (with Agent) from ByteDance
LangChain
FeaturedThe most mainstream LLM/Agent orchestration framework
Devin
FeaturedAutonomous software engineer Agent by Cognition
Something wrong? Let us know on the About page and we'll fix it.