Context
As part of the P1: End-to-End Loop and Joint Validation goal, we are shipping a credible end-to-end path that integrates vLLM rollout with RL-Kernel's logprob/loss kernels.
To seamlessly support post-training distributed scheduling and application frameworks like veRL and slime and vime, we need to establish a clear, non-intrusive backend identification mechanism. This ensures the upper-level frameworks can dynamically route computations to our optimized kernels without hardcoding.
Description
Introduce a configuration flag (e.g., use_rl_kernel_backend=True) within the integration layers of veRL and slime. When enabled, this flag will instruct the framework's actor/learner to dispatch rollout, logprob, and loss computations to the RL-Kernel backend instead of the default paths.
Proposed Implementation
Acceptance Criteria
Context
As part of the P1: End-to-End Loop and Joint Validation goal, we are shipping a credible end-to-end path that integrates vLLM rollout with RL-Kernel's logprob/loss kernels.
To seamlessly support post-training distributed scheduling and application frameworks like veRL and slime and vime, we need to establish a clear, non-intrusive backend identification mechanism. This ensures the upper-level frameworks can dynamically route computations to our optimized kernels without hardcoding.
Description
Introduce a configuration flag (e.g., use_rl_kernel_backend=True) within the integration layers of veRL and slime. When enabled, this flag will instruct the framework's actor/learner to dispatch rollout, logprob, and loss computations to the RL-Kernel backend instead of the default paths.
Proposed Implementation
Acceptance Criteria