You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thank you very much for sharing this excellent work.
I tried running the program under the condition of Qwen2.5-7B-Instruct + Graph-Based Text Retriever, but the accuracy of the model after reinforcement learning (HippoRAG2_average_f1) does not exceed that of the model before reinforcement learning.
I was able to confirm that the model you uploaded to Hugging Face, “gzone0111/AutoGraphR1-musique_hotpotqa_train-qwen2.5-7b-text-retriever-grpo,” achieves higher accuracy than the original “Qwen2.5-7B-Instruct.”
There is a possibility that I may have made a mistake in my verification, but if the code currently uploaded is not the final version, I would greatly appreciate it if you could upload the final version.
Could you provide more details on the version of VeRL used and the configuration of the training so that I can better assist you?
Since there have been several major updates from the VeRL side, some parts of the code may be deprecated. However, I can help take a look to determine the possible reasons for the performance difference.
Activity
gzone0111 commentedon Mar 13, 2026
Could you provide more details on the version of VeRL used and the configuration of the training so that I can better assist you?
Since there have been several major updates from the VeRL side, some parts of the code may be deprecated. However, I can help take a look to determine the possible reasons for the performance difference.