feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 36a72e5 Running DebasishDhal99 commited on 26 days ago
feat: made attention logits plot more interactive and added intuitive logic fir attention logits and attention scores 4f0e23c DebasishDhal99 commited on Sep 8
feat: enhance attention visualization with token context and improve markdown explanations 0342a67 DebasishDhal99 commited on Sep 7
fix: made the sequence length accurate for real model setup and also added information on which attention head is attending which set of dims 3a74c51 DebasishDhal99 commited on Sep 6
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 4ed3b70 DebasishDhal99 commited on Sep 6
feat: increase seq_len and auto-update of dim on UI during compute c9744fe DebasishDhal99 commited on Sep 6
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding aa7bfed DebasishDhal99 commited on Sep 6
fix: add spaces to comply with mandatory use og nvidia gpu on huggingface 1d852fb DebasishDhal99 commited on Sep 5
feat: basic setup with docker, no real code has been added for visualization yet 80699e5 DebasishDhal99 commited on Sep 5