Instructions to use mlx-community/tasksource-ModernBERT-base-embed-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mlx-community/tasksource-ModernBERT-base-embed-4bit with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("mlx-community/tasksource-ModernBERT-base-embed-4bit")

sentences = [
"Daniel went to the kitchen. Sandra went back to the kitchen. Daniel moved to the garden. Sandra grabbed the apple. Sandra went back to the office. Sandra dropped the apple. Sandra went to the garden. Sandra went back to the bedroom. Sandra went back to the office. Mary went back to the office. Daniel moved to the bathroom. Sandra grabbed the apple. Sandra travelled to the garden. Sandra put down the apple there. Mary went back to the bathroom. Daniel travelled to the garden. Mary took the milk. Sandra grabbed the apple. Mary left the milk there. Sandra journeyed to the bedroom. John travelled to the office. John went back to the garden. Sandra journeyed to the garden. Mary grabbed the milk. Mary left the milk. Mary grabbed the milk. Mary went to the hallway. John moved to the hallway. Mary picked up the football. Sandra journeyed to the kitchen. Sandra left the apple. Mary discarded the milk. John journeyed to the garden. Mary dropped the football. Daniel moved to the bathroom. Daniel journeyed to the kitchen. Mary travelled to the bathroom. Daniel went to the bedroom. Mary went to the hallway. Sandra got the apple. Sandra went back to the hallway. Mary moved to the kitchen. Sandra dropped the apple there. Sandra grabbed the milk. Sandra journeyed to the bathroom. John went back to the kitchen. Sandra went to the kitchen. Sandra travelled to the bathroom. Daniel went to the garden. Daniel moved to the kitchen. Sandra dropped the milk. Sandra got the milk. Sandra put down the milk. John journeyed to the garden. Sandra went back to the hallway. Sandra picked up the apple. Sandra got the football. Sandra moved to the garden. Daniel moved to the bathroom. Daniel travelled to the garden. Sandra went back to the bathroom. Sandra discarded the football.",
"In the adulthood stage, it can jump, walk, run",
"The chocolate is bigger than the container.",
"The football before the bathroom was in the garden."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]

MLX

How to use mlx-community/tasksource-ModernBERT-base-embed-4bit with MLX:

# Download the model from the Hub
pip install huggingface_hub[hf_xet]

huggingface-cli download --local-dir tasksource-ModernBERT-base-embed-4bit mlx-community/tasksource-ModernBERT-base-embed-4bit

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio
Atomic Chat

tasksource-ModernBERT-base-embed-4bit / sentence_bert_config.json

prince-canuma

Upload folder using huggingface_hub

e8e4409 verified over 1 year ago

Raw History Blame Contribute Delete

54 Bytes

	{
	"max_seq_length": 8192,
	"do_lower_case": false
	}