jankovicsandras/Llama-2-13b-chat-norwegian-Q5_K_M-GGUF

This is the Q5_K_M quantized GGUF format ( see https://github.com/ggerganov/llama.cpp ) version of this model: https://huggingface.co/RuterNorway/Llama-2-13b-chat-norwegian

Description (copied and edited from RuterNorway/Llama-2-13b-chat-norwegian) :

Llama 2 13b Chat Norwegian

Llama-2-13b-chat-norwegian is a variant of Meta´s Llama 2 13b Chat model, finetuned on a mix of norwegian datasets created in Ruter AI Lab the summer of 2023.

The model is tuned to understand and generate text in Norwegian. It's trained for one epoch on norwegian-alpaca + 15000 samples of machine-translated data from OpenOrca. A small subset of custom-made instructional data is also included.

For other versions of this model see: https://huggingface.co/RuterNorway/Llama-2-13b-chat-norwegian

Data

• Norwegian alpaca
• 15k Norwegian OpenOrcra (to be released)
• Small subset of custom made instructional data

Limitations

• This is an LLM, not a knowledge model. It can not be expected to have more information about Norway than the basemodel.
• It will generally preform better on tasks that involves summarization, question answering and chat, than on tasks that requires more knowledge about Norway, specific domains, or tasks where the model can answer freely.
• The data used for training is machine translated, and may contain grammatical errors and other errors.
• The model is released as is, and would in most cases need prompt tuning to achieve optimal results.

License

Llama 2 is licensed under the LLAMA 2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved. See the original model card for more information.

From norwegian-alpaca we also note that "the current version uses OpenAI's gpt-3.5-turbo; hence, this dataset cannot be used to create models that compete in any way against OpenAI." Disclaimer

The model is available "as is". Ruter As takes no responsibility for further use.

During testing, it seems that the safeguards implemented by Meta, still work as expected in this model. However, we want to point to the Ethical Considerations and Limitations from the origenal model card:

Llama 2 is a new technology that carries risks with use. Testing conducted to date has been in English, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, Llama 2’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of Llama 2, developers should perform safety testing and tuning tailored to their specific applications of the model. Please see the Responsible Use Guide available at https://ai.meta.com/llama/responsible-use-guide/

Credits

This model was made at Ruters AI Lab which is a part of Ruters Data & AI division.