HuggingEnvs/geoguesser-qwen3.5-4b-grpo-v3
Text Generation • Updated
AI & ML interests
RL Environments at Scale
Recent Activity
View all activity
AdithyaSK
updated a
model 14 minutes ago
AdithyaSK
published a
model 14 minutes ago
AdithyaSK
updated a
bucket about 15 hours ago
sergiopaniego
posted an update 1 day ago
Post
898
Can you do RL over taste?
I've spent some time reproducing, in the open, Surya N's idea of training a model to paint with code. It's a coding model that learns to paint watercolours by writing JS code, trained with GRPO. I used TRL and OpenEnv for this, with the whole pipeline running on Hugging Face.
The interesting part is that the reward has no correct answer, unlike a math problem. In this case it's based on the artistic preferences of the person who builds the dataset.
Everything is published: the environment, the reference pool, the trained adapters, every painting of every run with the code that made it, and a write-up with all the decisions, including the ones that went wrong.
Blog post: https://huggingface.co/blog/train-to-paint-with-code
I've spent some time reproducing, in the open, Surya N's idea of training a model to paint with code. It's a coding model that learns to paint watercolours by writing JS code, trained with GRPO. I used TRL and OpenEnv for this, with the whole pipeline running on Hugging Face.
The interesting part is that the reward has no correct answer, unlike a math problem. In this case it's based on the artistic preferences of the person who builds the dataset.
Everything is published: the environment, the reference pool, the trained adapters, every painting of every run with the code that made it, and a write-up with all the decisions, including the ones that went wrong.
Blog post: https://huggingface.co/blog/train-to-paint-with-code
sergiopaniego
updated 3
models 1 day ago
AdithyaSK
updated a
Space 1 day ago
AdithyaSK
published a
bucket 1 day ago
AdithyaSK
published a
Space 1 day ago
sergiopaniego
updated 3
datasets 1 day ago
sergiopaniego
updated a
collection 1 day ago
sergiopaniego
updated a
Space 1 day ago
sergiopaniego
published a
Space 1 day ago
AdithyaSK
updated a
model 1 day ago
AdithyaSK
published a
model 1 day ago
AdithyaSK
updated a
bucket 1 day ago
AdithyaSK
updated a
Space 2 days ago