Spaces:
Running
Running
Download assets/pipelines/pipeline_dev_v34.yaml from dev-strender/proofread-demo: direct link, hf CLI and curl.
- Browser
- Download file 1.68 kB
-
https://huggingface.co/spaces/dev-strender/proofread-demo/resolve/9c84f9d445e63e1b16bd1ab03855030fbe86034f/assets/pipelines/pipeline_dev_v34.yaml
- Command line
-
hf download hf://spaces/dev-strender/proofread-demo@9c84f9d445e63e1b16bd1ab03855030fbe86034f/assets/pipelines/pipeline_dev_v34.yaml
-
curl -L -o pipeline_dev_v34.yaml https://huggingface.co/spaces/dev-strender/proofread-demo/resolve/9c84f9d445e63e1b16bd1ab03855030fbe86034f/assets/pipelines/pipeline_dev_v34.yaml
1.68 kB
| name: pipeline_dev_v34 | |
| description: "v33 + yul_ryul_normalize (์จ/๋ฅ ๋ฐ์นจ ๊ท์น์ ๊ฒฐ์ ๋ก ์ ๊ฐ์ , ๋ง์ถค๋ฒ ์ 11ํญ). ์ด์ ๊ผฌ๋ฆฌ๊ฐ ์กฐ์ฌ์ด๊ฑฐ๋ ๋น์ด ์์ ๋๋ง ๋ฐ๋ํ๋ ์ธ๋ช ๊ฐ๋ + exceptions ํ ํฌํจ โ ์ฌ์ ์ค์ธก(v33 ์ถ๋ ฅ ์)์์ ๋ณ๊ฒฝ 4๊ฑด ์ ๋ถ ๊ณจ๋ ์ผ์นยท๋ถ์ ํผํด 0 (yul-ryul +1.49, ci-v2 +0.59, ci-v1 +0.58, paragraphยทci-v0 ๋ฌด๋ณํ), ์ ์ผ ์คํ์ด๋ '๊น์จํฌ๊ฐ' ๋ ์กฐ์ฌ ๊ฐ๋๊ฐ ์ฐจ๋จ. rule ์คํ ์ด๋ผ latency ๋น์ฉ 0. ์คํ ์ถ๊ฐ๋ผ extends ๋ถ๊ฐ, ์ ์ฒด ํ์ผ." | |
| text_split_size: 500 | |
| steps: | |
| - name: vocabulary_sub_pre | |
| type: rule | |
| rule_type: vocabulary_sub | |
| config: | |
| vocab_dataset: resources/vocabulary.csv | |
| - name: proofread | |
| type: llm | |
| model: ft:solar-news-correction | |
| prompt_key: proofread | |
| max_tokens: 2000 | |
| - name: basic_correction | |
| type: llm | |
| prompt_key: step1 | |
| user_template: | | |
| <์๋ฌธ> | |
| {steps.vocabulary_sub_pre} | |
| </์๋ฌธ> | |
| <๊ต์ด_๋ชจ๋ธ_์์ ๊ฒฐ๊ณผ> | |
| {current} | |
| </๊ต์ด_๋ชจ๋ธ_์์ ๊ฒฐ๊ณผ> | |
| - name: context_correction | |
| type: llm | |
| prompt_key: step2 | |
| - name: style_correction | |
| type: llm | |
| prompt_key: step3 | |
| - name: vocabulary_reapply | |
| type: rule | |
| config: | |
| vocab_dataset: resources/vocabulary.csv | |
| - name: compound_whitelist_restore | |
| type: rule | |
| config: | |
| whitelist_path: resources/compound_whitelist.txt | |
| - name: yul_ryul_normalize | |
| type: rule | |
| config: {} | |
| - name: post_process | |
| type: rule | |
| config: | |
| pronoun_replacements: | |
| ์ด์ฌ๋ช ๋ํ: ์ด์ฌ๋ช ๋ํต๋ น | |
| currency_compact: true | |
| comma_removal: true | |
| unit_unicode: true | |