Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
science-of-finetuning 's Collections
Synthetic Document Finetuning Datasets
Chat-data datasets
BatchTopK gemma-2-2b chat SAEs
Base-Chat middle layer Crosscoders

Base-Chat middle layer Crosscoders

updated Jun 3, 2025

A collection of crosscoders trained for our paper "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" https://arxiv.org/abs/2504.0

Upvote
-

  • science-of-finetuning/gemma-2-2b-crosscoder-l13-mu4.1e-02-lr1e-04

    Feature Extraction • Updated Nov 22, 2024 • 4 • 5

  • science-of-finetuning/gemma-2-2b-L13-k100-lr1e-04-local-shuffling-CCLoss

    Updated Mar 5, 2025 • 5

  • science-of-finetuning/Llama-3.2-1B-L8-mu3.6e-02-lr1e-04-local-shuffling-CrosscoderLoss

    Updated May 15, 2025 • 1

  • science-of-finetuning/Llama-3.2-1B-L8-k100-lr1e-04-local-shuffling-Crosscoder

    Updated May 15, 2025 • 2

  • science-of-finetuning/Meta-Llama-3.1-8B-L16-k200-lr1e-04-local-shuffling-Crosscoder-ni0.3-ka1k5k

    Updated May 21, 2025 • 4

  • science-of-finetuning/Meta-Llama-3.1-8B-L16-mu2.1e-02-lr1e-04-local-shuffling-CrosscoderLoss

    Updated May 21, 2025 • 2
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs