Add model files

.gitattributes

@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.const filter=lfs diff=lfs merge=lfs -text
+*.fconst filter=lfs diff=lfs merge=lfs -text
+*.ctrlpkt filter=lfs diff=lfs merge=lfs -text
+*.meta filter=lfs diff=lfs merge=lfs -text
+*.onnx.data filter=lfs diff=lfs merge=lfs -text
+dd_metastate_Llm_Prefill_rms_norm_7_18_0.state filter=lfs diff=lfs merge=lfs -text
+dd_metastate_Llm_Token_Token_rms_norm_9_18_0.state filter=lfs diff=lfs merge=lfs -text
+model.onnx.data filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,179 @@
+---
+license: llama2
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- amd
+- ryzenai
+- onnx
+- npu_4K
+---
+
+# CodeLlama-7b-Instruct-hf_rai_1.7.1_npu_4K
+
+- ## Introduction
+
+  This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment (Full Fusion 4K context).
+
+- ## Quantization Strategy
+  - AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 Weights
+
+- ## Quick Start
+
+  For quickstart, refer to [Ryzen AI documentation](https://ryzenai.docs.amd.com/en/latest/hybrid_oga.html)
+
+#### Evaluation scores
+
+  _Benchmark scores not yet available for this model._
+
+#### License
+
+Modifications copyright(c) 2025 Advanced Micro Devices,Inc. All rights reserved.
+
+MIT License
+
+Copyright (c) 2025 Advanced Micro Devices, Inc
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+
+
+---
+
+#### Base Model License
+
+LLAMA 2 COMMUNITY LICENSE AGREEMENT
+Llama 2 Version Release Date: July 18, 2023
+
+"Agreement" means the terms and conditions for use, reproduction, distribution and
+modification of the Llama Materials set forth herein.
+
+"Documentation" means the specifications, manuals and documentation
+accompanying Llama 2 distributed by Meta at ai.meta.com/resources/models-and-
+libraries/llama-downloads/.
+
+"Licensee" or "you" means you, or your employer or any other person or entity (if
+you are entering into this Agreement on such person or entity’s behalf), of the age
+required under applicable laws, rules or regulations to provide legal consent and that
+has legal authority to bind your employer or such other person or entity if you are
+entering in this Agreement on their behalf.
+
+"Llama 2" means the foundational large language models and software and
+algorithms, including machine-learning model code, trained model weights,
+inference-enabling code, training-enabling code, fine-tuning enabling code and other
+elements of the foregoing distributed by Meta at ai.meta.com/resources/models-and-
+libraries/llama-downloads/.
+
+"Llama Materials" means, collectively, Meta’s proprietary Llama 2 and
+Documentation (and any portion thereof) made available under this Agreement.
+
+"Meta" or "we" means Meta Platforms Ireland Limited (if you are located in or, if you
+are an entity, your principal place of business is in the EEA or Switzerland) and Meta
+Platforms, Inc. (if you are located outside of the EEA or Switzerland).
+
+By clicking "I Accept" below or by using or distributing any portion or element of the
+Llama Materials, you agree to be bound by this Agreement.
+
+1. License Rights and Redistribution.
+
+      a. Grant of Rights. You are granted a non-exclusive, worldwide, non-
+transferable and royalty-free limited license under Meta’s intellectual property or
+other rights owned by Meta embodied in the Llama Materials to use, reproduce,
+distribute, copy, create derivative works of, and make modifications to the Llama
+Materials.
+
+      b. Redistribution and Use.
+
+            i. If you distribute or make the Llama Materials, or any derivative works
+thereof, available to a third party, you shall provide a copy of this Agreement to such
+third party.
+            ii.  If you receive Llama Materials, or any derivative works thereof, from
+a Licensee as part of an integrated end user product, then Section 2 of this
+Agreement will not apply to you.
+
+            iii. You must retain in all copies of the Llama Materials that you
+distribute the following attribution notice within a "Notice" text file distributed as a
+part of such copies: "Llama 2 is licensed under the LLAMA 2 Community License,
+Copyright (c) Meta Platforms, Inc. All Rights Reserved."
+
+            iv. Your use of the Llama Materials must comply with applicable laws
+and regulations (including trade compliance laws and regulations) and adhere to the
+Acceptable Use Policy for the Llama Materials (available at
+https://ai.meta.com/llama/use-policy), which is hereby incorporated by reference into
+this Agreement.
+
+            v. You will not use the Llama Materials or any output or results of the
+Llama Materials to improve any other large language model (excluding Llama 2 or
+derivative works thereof).
+
+2. Additional Commercial Terms. If, on the Llama 2 version release date, the
+monthly active users of the products or services made available by or for Licensee,
+or Licensee’s affiliates, is greater than 700 million monthly active users in the
+preceding calendar month, you must request a license from Meta, which Meta may
+grant to you in its sole discretion, and you are not authorized to exercise any of the
+rights under this Agreement unless or until Meta otherwise expressly grants you
+such rights.
+
+3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE
+LLAMA MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE
+PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND,
+EITHER EXPRESS OR IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY
+WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR
+FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE
+FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING
+THE LLAMA MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR
+USE OF THE LLAMA MATERIALS AND ANY OUTPUT AND RESULTS.
+
+4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES BE
+LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT,
+NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS
+AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT, SPECIAL,
+CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN
+IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF
+ANY OF THE FOREGOING.
+
+5. Intellectual Property.
+
+      a. No trademark licenses are granted under this Agreement, and in
+connection with the Llama Materials, neither Meta nor Licensee may use any name
+or mark owned by or associated with the other or any of its affiliates, except as
+required for reasonable and customary use in describing and redistributing the
+Llama Materials.
+
+      b. Subject to Meta’s ownership of Llama Materials and derivatives made by or
+for Meta, with respect to any derivative works and modifications of the Llama
+Materials that are made by you, as between you and Meta, you are and will be the
+owner of such derivative works and modifications.
+
+      c. If you institute litigation or other proceedings against Meta or any entity
+(including a cross-claim or counterclaim in a lawsuit) alleging that the Llama
+Materials or Llama 2 outputs or results, or any portion of any of the foregoing,
+constitutes infringement of intellectual property or other rights owned or licensable
+by you, then any licenses granted to you under this Agreement shall terminate as of
+the date such litigation or claim is filed or instituted. You will indemnify and hold
+harmless Meta from and against any claim by any third party arising out of or related
+to your use or distribution of the Llama Materials.
+
+6. Term and Termination. The term of this Agreement will commence upon your
+acceptance of this Agreement or access to the Llama Materials and will continue in
+full force and effect until terminated in accordance with the terms and conditions
+herein. Meta may terminate this Agreement if you are in breach of any term or
+condition of this Agreement. Upon termination of this Agreement, you shall delete
+and cease use of the Llama Materials. Sections 3, 4 and 7 shall survive the
+termination of this Agreement.
+
+7. Governing Law and Jurisdiction. This Agreement will be governed and
+construed under the laws of the State of California without regard to choice of law
+principles, and the UN Convention on Contracts for the International Sale of Goods
+does not apply to this Agreement. The courts of California shall have exclusive
+jurisdiction of any dispute arising out of this Agreement.
+
+

chat_template.jinja

@@ -0,0 +1 @@
+{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% set system_message = false %}{% endif %}{% for message in loop_messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if loop.index0 == 0 and system_message != false %}{% set content = '<<SYS>>\n' + system_message + '\n<</SYS>>\n\n' + message['content'] %}{% else %}{% set content = message['content'] %}{% endif %}{% if message['role'] == 'user' %}{{ bos_token + '[INST] ' + content | trim + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ ' '  + content | trim + ' ' + eos_token }}{% endif %}{% endfor %}

config.json

@@ -0,0 +1 @@
+{}

dd_metastate_Llm_Prefill_rms_norm_7_18_0.fconst

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d5530611b2a24aeb2e695c389a80507f4e327f4e993e17451ca419de43a87945
+size 3533385792

dd_metastate_Llm_Prefill_rms_norm_7_18_0.state

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08a198f4365693c22361329860cfdfd7e24d1995fedd8b3157c223110db174c2
+size 860

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_1024_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1168dabc3195fc9863a359f027f59f817ab4bbd637922459c4726a1e1023c6bf
+size 111756217

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_128_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5d1aa8cdb29f963ed66e49b647b15222198773fc906be38bb657fb2fe134954
+size 27735116

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_1536_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35b757a8ef80c19b0b1450066b72567a33b59f79ded21fc15854ca317620425b
+size 94456857

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_1792_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6dae18b0915250bc831ec6e8c7863e0f22cd39385315dc0242e1cc79030723d
+size 106037465

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_2048_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2541ea399212e4352a66b84310815a0f0aaa85fd039ac85a22c7e5188e0015a
+size 224560251

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_2304_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd19b8f66ca12744c4442dfa6e057b234516205893b2fe4db33894a1fd3e6ced
+size 157572571

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_256_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b792b98c767efc1577be06671a3295dcb91470bcd2590185a4432c66e557ed8
+size 30377206

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_3072_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7dc85555e37a75d2b0136efaed7853a60d6485e62af7c18f9518d4d247779b63
+size 346596052

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_4096_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1dd7e51815608e7b408bb553179a0f05f3b71fb75b886aff3a4a3cbd7a3a4e81
+size 323265812

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_512_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37ebe07b58e75781b1456320936531797e3dc2d5dc1b52c887168ceba3e647ee
+size 62747446

dd_metastate_Llm_Prefill_rms_norm_7_18_0_sequence_length_padded_768_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c0d44d4bfac374af9736281aa0a5e08db591e09645095d4211d0666d477810e
+size 64521942

dd_metastate_Llm_Token_Token_rms_norm_9_18_0.fconst

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e493abbc521e5f9b6acee7e44115875f42a217d805845a339e8cc485dbda55ff
+size 3510136896

dd_metastate_Llm_Token_Token_rms_norm_9_18_0.state

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:becd13df890b1c749504b105124873141bfb67a8197014f1b6e4b05c0caa807f
+size 667

dd_metastate_Llm_Token_Token_rms_norm_9_18_0_attention_mask_padded_1024_.ctrlpkt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0256839255a634ed21f386c33af3ae987ddcff411c4334a980b9df9fc43a3a6e
+size 9731688

dd_metastate_Llm_Token_Token_rms_norm_9_18_0_attention_mask_padded_1024_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4406700c25b298ba352c3a24d424ad094fd3d7743eec1bceedc19b3af242e52d
+size 2494457

dd_metastate_Llm_Token_Token_rms_norm_9_18_0_attention_mask_padded_2048_.ctrlpkt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7914f9c8fcb802a4941d5384e5987b208e128916c794629b901e06c4c70289ce
+size 9731688

dd_metastate_Llm_Token_Token_rms_norm_9_18_0_attention_mask_padded_2048_.meta

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0dbc63e6924c619fc8020834b36da3c0834f261f8268a8ad7418229ca7ae0f1
+size 2494457

dd_metastate_Llm_Token_Token_rms_norm_9_18_0_attention_mask_padded_256_.ctrlpkt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc846c2728a493a594e98742fca134748f40ace33e54e9dc071d1d8352b29512
+size 9489000