๋ชฉ๋ก2024/04/27 (1)

SJ_Koding

LLaMA-1๋ฅผ ์•Œ์•„๋ณด์ž - 4ํŽธ, Instruction Finetuning๊ณผ Bias๋ฐ Toxicity, Misinformation

LLaMA์˜ Instruction finetuning๊ฒฐ๊ณผ์™€ bias, toxicity, misinformation๋“ฑ LLM์˜ ๋Œ€ํ‘œ์ ์ธ ๋ฌธ์ œ์  ์ •๋„๋ฅผ ๋””ํ…Œ์ผํ•˜๊ฒŒ ํ‰๊ฐ€ํ•œ๋‹ค. LLaMA-1์€ ๋ฌธ์ œ์ ์„ ํ•ด๊ฒฐํ•œ ํ…Œ์Šคํฌ๋„ ์ผ๋ถ€ ์žˆ์ง€๋งŒ, ์—ฌ์ „ํžˆ ํ•ด๊ฒฐํ•˜์ง€ ๋ชปํ•œ ํ…Œ์Šคํฌ๋„ ์กด์žฌํ–ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŒ…์€ ์ด์ „ ๊ธ€๋“ค๊ณผ ์ด์–ด์ง€๋Š” ๋‚ด์šฉ์ด๋‹ค. LLaMA: Open and Efficient Foundation Language Models๋ฅผ ์•Œ์•„๋ณด์ž - 3ํŽธ, Main ResultLLaMA์˜ ์„ฑ๋Šฅ ๋น„๊ต์‹คํ—˜ ๊ฒฐ๊ณผ๋ฅผ ์ž์„ธํžˆ ๊ธฐ์ˆ ํ•œ๋‹ค. ํ…Œ์Šคํฌ๋ณ„๋กœ ํ•˜์œ„ ์„น์…˜์„ ๋‚˜๋ˆ„์—ˆ์œผ๋ฉฐ ์–ด๋–ค์‹์œผ๋กœ ์‹คํ—˜์„ ๊ตฌ์„ฑํ–ˆ๋Š”์ง€ ์ž˜ ์„ค๋ช…๋˜์–ด์žˆ๋‹ค. LLaMA๊ฐ€ ๋‹น์‹œ ์™œ ๊ฐ๊ด‘๋ฐ›์•˜๋Š”์ง€ ์•Œ ์ˆ˜ ์žˆ๋Š” ์„น์…˜์ธ ๊ฒƒ ๊ฐ™๋‹ค.Intsjkoding.tistory.com 4. Instruction..

LLM 2024. 4. 27. 14:00