upstage/open-ko-llm-leaderboard

#89 opened almost 2 years ago by

Chanjun

Announcement: Details on the Open Ko-LLM Leaderboard Season 2 Task

#84 opened about 2 years ago by

Chanjun

Announcement: Launch of Open Ko-LLM Leaderboard Season 2

🔥❤️ 7

#83 opened about 2 years ago by

Chanjun

⁉️ FAQ ⁉️ - Start here before opening an issue

10

#1 opened almost 3 years ago by

BearSean

1,166 models ranked on 198 questions: the ko_gpqa_diamond #1 has a 91% chance of not being the best model

#102 opened 6 days ago by

Ipezygj

Multi-metric evaluation tool for Korean + multilingual LLM benchmarking

#101 opened 2 months ago by

vigneshwar234

Fix: Update deprecated APIs and dependencies

#100 opened 4 months ago by

akseljoonas

update requirements.txt

#97 opened over 1 year ago by

update requirements.txt

#96 opened over 1 year ago by

transformers업데이트 관련 문의

#95 opened over 1 year ago by

Add Aya Expanse Models

#94 opened almost 2 years ago by

alexrs

대부분의 모델(유명모델들 포함)들이 fail인데 이유라도 알려주시죠

#92 opened almost 2 years ago by

Model "meta-llama/Llama-3.2-3B-Instruct" was not found on hub!

#91 opened almost 2 years ago by

navyanshmahla

Cannot submit Adapter model based on llama-3

#90 opened almost 2 years ago by

jun22

Add CohereForAI Aya Models

#85 opened about 2 years ago by

alexrs

Update requirements.txt

5

#82 opened about 2 years ago by

CombinHorizon

Model "JLee0/hyundai_car_chat_ko-gemma" was not found on hub!

#81 opened about 2 years ago by

JLee0

Correction to model-type of BAAI/Infinity-Instruct-3M-0625-Qwen2-7B

#80 opened about 2 years ago by

CombinHorizon

모델 평가 실패 문의

#79 opened about 2 years ago by

Jin0

submit error "trust_remote_code"

#77 opened about 2 years ago by

AIJUUD

모델 평가 요청 실패 로그 확인

#76 opened about 2 years ago by

sel303

모델 평가 요청 실패

#75 opened about 2 years ago by

ITT-AF

새로운 평가항목 추가에 대한 문의

#74 opened about 2 years ago by

crom1543

Model "kimdeokgi/ko-pt-model-test1" was not found on hub!

#71 opened about 2 years ago by deleted

Model "xxx" was not found on hub! error.

#70 opened about 2 years ago by

lcw99

Update leaderboard so can support newer models?

#69 opened about 2 years ago by

CombinHorizon

제출 시 입력하는 파라미터를 잘못 입력하여 fail됐습니다.

#68 opened over 2 years ago by

crom1543

LLM Benchmark 에 결과가 보이지 않습니다.

#67 opened over 2 years ago by

mssma

Model Evaluation Speed

#61 opened over 2 years ago by

hkss

Benchmark links

#60 opened over 2 years ago by

oiwio

제출 에러

👍 1

#58 opened over 2 years ago by

jylee420

모델 평가 실패

👍 1

#57 opened over 2 years ago by

sel303

evaluation prompt의 형식이 어떻게 되는지요?

👍 1

#56 opened over 2 years ago by

beomgon

모델 제출 관련 문의

5

#54 opened over 2 years ago by

julleong

[GPU 이슈 관련 해결 공지]

👍 2

#53 opened over 2 years ago by

choco9966

Orion-14B-Base 평가 지원을 위한 trust code 활성화 문의

#51 opened over 2 years ago by

rippertnt

평가지표 자체 학습 관련 건

8

#44 opened over 2 years ago by

Januaryyyy

모델 재평가 문의

#42 opened over 2 years ago by

DopeorNope

모델들 관련 점검이 필요합니다.

👍 4

#40 opened over 2 years ago by

DopeorNope

[FLAG] dasomysky/unv_test_v0.1.0

❤️👍 2

#35 opened over 2 years ago by

kyujinpy

How to download the leaderboard results as csv or json format?

#30 opened over 2 years ago by

zhiminy

Update on the Evaluation Method for Ko Common Gen V2

❤️ 10