Search results

Can I use Nemo evaluator without launcher?

bugSomething isn't workingSomething isn't working

community-request

Status: Open.

#605 In NVIDIA-NeMo/Evaluator;

· hyunwoongko opened on Jan 2, 2026

The supported tasks of nemo-evaluator-launcher are much less than nemo-evaluator

bugSomething isn't workingSomething isn't working

community-request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#436 In NVIDIA-NeMo/Evaluator;

· mianzhang opened on Nov 6, 2025

Support asynchronous evaluation during training

backlog

enhancementNew feature or requestNew feature or request

Status: Open.

#377 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 23, 2025

Support evaluation of TRTLLM checkpoints on logprob benchmarks

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#368 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 21, 2025

·  

26.02

Support chat benchmarks with MBridge, HF and TRTLLM models

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#332 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 15, 2025

·  

26.02

Evaluation support for multimodal models in NeMo 2.0

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#279 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 6, 2025

·  

26.02

[Feature Request] Support chat format in the llm generate APi

support

Status: Open.

#49 In NVIDIA-NeMo/Evaluator;

· snowmanwwg opened on Aug 4, 2025

Support evaluation of TRTLLM checkpoints on generation benchmarks

support

Status: Open.

#46 In NVIDIA-NeMo/Evaluator;

· snowmanwwg opened on Aug 3, 2025

·  

26.02