Upload Robo4D v5 class-balanced Qwen2.5-VL LoRA

README.md

@@ -0,0 +1,47 @@
+---
+base_model: Qwen/Qwen2.5-VL-7B-Instruct
+library_name: peft
+pipeline_tag: image-text-to-text
+tags:
+- lora
+- qwen2.5-vl
+- video-vqa
+- robot-learning
+---
+
+# Robo4D v5 Qwen2.5-VL-7B LoRA
+
+This is a PEFT LoRA adapter for `Qwen/Qwen2.5-VL-7B-Instruct`, fine-tuned on the Robo4D v5 robot-manipulation video QA task. It is **not** a standalone checkpoint.
+
+## Intended use
+
+The adapter is intended for four-choice video questions about a robot-held object's direction, distance, or speed during manipulation. Direction labels may be relative to the robot base or the camera, depending on the prompt.
+
+Load it with the exact base model and a PEFT-compatible Qwen2.5-VL inference path. The training answer format is a single choice letter.
+
+## Training
+
+- Training set: 18,000 episode-capped Robo4D v5 examples.
+- Sampling: balanced by question type, source view, and answer class where data availability permits.
+- One epoch; LoRA rank 16, alpha 32, dropout 0.05.
+- Base model: `Qwen/Qwen2.5-VL-7B-Instruct`.
+
+On the held-out Robo4D v5 eval set (2,300 questions), this adapter scored 56.52% overall. This is an in-domain, episode-disjoint result.
+
+## Limitations
+
+Robo4D training clips are deliberately filtered for grounded, sustained held-object motion. This adapter should not be assumed to improve broad video reasoning or premise checking, including cases with no visible target or no meaningful motion. Early VLM4D transfer checks showed degradation relative to the base model; treat it as a task-specific research adapter.
+
+## Loading
+
+```python
+from transformers import Qwen2_5_VLForConditionalGeneration
+from peft import PeftModel
+
+base = Qwen2_5_VLForConditionalGeneration.from_pretrained(
+    "Qwen/Qwen2.5-VL-7B-Instruct", device_map="auto"
+)
+model = PeftModel.from_pretrained(base, "cpsu04/Robo4D-v5-Qwen2.5-VL-7B-LoRA")
+```
+
+The adapter contains no training videos or question data. Use of the underlying model and any downstream dataset remains subject to their respective licenses and terms.

adapter_config.json

@@ -0,0 +1,48 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-VL-7B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "up_proj",
+    "down_proj",
+    "gate_proj",
+    "q_proj",
+    "v_proj",
+    "o_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2653990c2c7fc63110c453ebce03ae988ce7dfdf731369dc5b52e92f0bf3fcf7
+size 190442760

run_config.json

@@ -0,0 +1,13 @@
+{
+  "model": "Qwen/Qwen2.5-VL-7B-Instruct",
+  "questions": "outputs/robo4d_vlm4d/grid_v5/train_ft18k_type_source_class_balanced.jsonl",
+  "split_ids": ".",
+  "clips_dir": "outputs/robo4d_vlm4d/grid_v5/train_ft18k_clips",
+  "clip_key": "qid",
+  "out_dir": "outputs/robo4d_vlm4d/grid_v5/ft_qwen25/type_source_class_balanced",
+  "grad_accum": 16,
+  "epochs": 1,
+  "lr": 0.0002,
+  "limit": 0,
+  "choice_rotation": "qid_hash"
+}