728x90
๋ฐ˜์‘ํ˜•

batch normalization 1

[๋ถ€์ŠคํŠธ์บ ํ”„ AI Tech 3๊ธฐ Pre-Course] ์ธ๊ณต์ง€๋Šฅ ๋ณธ๊ฒฉ ํƒ๊ตฌ : Optimization, Gradient Descent, Overfitting, Generalization, Cross-Validation, SGD

๋ชจ๋“  ๊ฒŒ์‹œ๋ฌผ์€ macOS Monterey 12.0.1 ๋ฒ„์ „ ๊ธฐ์ค€์œผ๋กœ ์ž‘์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค. ๋ถ€์ŠคํŠธ์บ ํ”„ AI Tech 3๊ธฐ๋ฅผ ์œ„ํ•œ Pre-Course ๋ฅผ ํ† ๋Œ€๋กœ ์ž‘์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค. Introduction 1. Generalization Iteration์ด ๋ฐ˜๋ณต๋  ๋•Œ๋งˆ๋‹ค Training Error๋Š” ๋‹น์—ฐํžˆ ์ค„์–ด๋“ค ๊ฒƒ์ด๋‹ค. ํ•˜์ง€๋งŒ ์‹œ๊ฐ„์ด ์ง€๋‚˜๊ฐ€๊ณ  ๋‚˜๋ฉด Test Error์— ๋Œ€ํ•ด ๊ทธ ์„ฑ๋Šฅ์ด ๋–จ์–ด์ง€๊ฒŒ ๋œ๋‹ค. ์ฆ‰, Training Error์™€ Test Error ์‚ฌ์ด์˜ ์ฐจ์ด๊ฐ€ ์ฆ๊ฐ€ํ•œ๋‹ค. ์ด๋Ÿฌํ•œ ํ˜„์ƒ์„ ์˜ค๋ฅธ์ชฝ ์ด๋ฏธ์ง€์™€ ๊ฐ™์ด Overfitting์ด๋ผ ํ•œ๋‹ค. ํ•™์Šต ๋ฐ์ดํ„ฐ์กฐ์ฐจ ๋งž์ถ”์ง€ ๋ชปํ•˜๊ณ  ์žˆ๋Š” ๊ฒƒ์ด Underfitting. 2. Cross-Validation ์ผ๋ฐ˜์ ์œผ๋กœ ํ•™์Šต๊ณผ ํ…Œ์ŠคํŠธ๋ฅผ ์œ„ํ•œ ๋ฐ์ดํ„ฐ๋ฅผ ๋‚˜๋ˆ ์„œ ํ›ˆ๋ จ์‹œํ‚ค๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ๋‹ค...

728x90
๋ฐ˜์‘ํ˜•