Skip to content

Is the uploaded code the final version? #1

Open

Description

@fugaga

Thank you very much for sharing this excellent work.
I tried running the program under the condition of Qwen2.5-7B-Instruct + Graph-Based Text Retriever, but the accuracy of the model after reinforcement learning (HippoRAG2_average_f1) does not exceed that of the model before reinforcement learning.
I was able to confirm that the model you uploaded to Hugging Face, “gzone0111/AutoGraphR1-musique_hotpotqa_train-qwen2.5-7b-text-retriever-grpo,” achieves higher accuracy than the original “Qwen2.5-7B-Instruct.”

There is a possibility that I may have made a mistake in my verification, but if the code currently uploaded is not the final version, I would greatly appreciate it if you could upload the final version.

Activity

  1. gzone0111 commented on Mar 13, 2026

    @gzone0111
    Collaborator

    Could you provide more details on the version of VeRL used and the configuration of the training so that I can better assist you?
    Since there have been several major updates from the VeRL side, some parts of the code may be deprecated. However, I can help take a look to determine the possible reasons for the performance difference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions