728x90
๋ฐ˜์‘ํ˜•

์ฝ”๋“œ๊ตฌํ˜„ 3

[ ํฌ์Šคํ… ์ธ๊ณต์ง€๋Šฅ์—ฐ๊ตฌ์› ์—ฐ๊ตฌ์ธํ„ด ] HiFi-GAN Reproducing ์ฝ”๋“œ ๊ตฌํ˜„

https://hae-koos.tistory.com/79 [ ํฌ์Šคํ… ์ธ๊ณต์ง€๋Šฅ์—ฐ๊ตฌ์› ์—ฐ๊ตฌ์ธํ„ด ] HiFi-GAN ๋…ผ๋ฌธ ๋ฆฌ๋ทฐ / Vocoder ๊ฐœ๋… ์„ค๋ช… ๋ฐ ์ •๋ฆฌ [ ํฌ์Šคํ… ์ธ๊ณต์ง€๋Šฅ์—ฐ๊ตฌ์› ์—ฐ๊ตฌ์ธํ„ด ] HiFi-GAN ๋…ผ๋ฌธ ๋ฆฌ๋ทฐ / Vocoder ๊ฐœ๋… ์„ค๋ช… ๋ฐ ์ •๋ฆฌ Vocoder ๋ฐฐ๊ฒฝ์ง€์‹ : Mel-spectrogram ๋„ฃ์œผ๋ฉด Wave ๋งŒ๋“œ๋Š” ์นœ๊ตฌ → ๊ณต๋ถ€ํ•˜์ž BACKGROUND ํ•ฉ์„ฑ์Œ ์Œ์งˆ์„ ๊ฒฐ์ •ํ•˜๋Š” ์š”์†Œ (Neural Speech Synthesis ๊ด€์ ) ์ฃผ์–ด์ง„ ํ…์ŠคํŠธ๋กœ ๋ฉœ ์ŠคํŽ™ํŠธ๋กœ๊ทธ๋žจ์„ ์–ผ๋งˆ๋‚˜ ์ž˜ ์ƒ์„ฑํ•ด ๋‚ผ ์ˆ˜.. hae-koos.tistory.com https://github.com/jik876/hifi-gan [ Official Repository ] HiFi-GAN: Generative Advers..

[ ํฌ์Šคํ… ์ธ๊ณต์ง€๋Šฅ์—ฐ๊ตฌ์› ์—ฐ๊ตฌ์ธํ„ด ]AUTOVC ์ฝ”๋“œ ๋ฆฌ๋ทฐ ๋ฐ Reproducing

์ฝ”๋“œ ํŒŒํ—ค์น˜๊ธฐ ๐Ÿ”ฅ make_spect.py : Generate spectrogram data from the wav files npy ํ˜•ํƒœ๋กœ melspectrogram์ด ์ƒ์„ฑ๋จ make_metadata.py : Generate speaker embeddings and metadata for training ์œ„์—์„œ ๋งŒ๋“  ./spmel ํด๋”์— train.pkl ์ƒ์„ฑ metadata.pkl ์ƒ์„ฑ main.py : Run the main training script & Converges when the reconstruction loss is around 0.0001 conversion.ipynb : Download pre-trained AUTOVC model and run it autovc.ckpt ๋กœ๋“œํ•˜๊ณ ,..

[ ์˜๋ฃŒ์˜์ƒ ] Grad-CAM (Gradient-Class Activation Map) ๋…ผ๋ฌธ๋ฆฌ๋ทฐ ๋ฐ COVID-19 Patients Chest X-ray ํ†ตํ•œ Pytorch ๊ตฌํ˜„

๋‹ค์–‘ํ•œ ๋ธ”๋กœ๊ทธ์™€ kaggle, github ๊ทธ๋ฆฌ๊ณ  ๋…ผ๋ฌธ์„ ์ฐธ๊ณ ํ•˜์—ฌ ์ž‘์„ฑํ•œ ๊ฒŒ์‹œ๋ฌผ์ž…๋‹ˆ๋‹ค. ์ฐธ๊ณ ๋ฌธํ—Œ์€ ๊ฒŒ์‹œ๋ฌผ ํ•˜๋‹จ์— ๊ธฐ๋กํ•˜์˜€์Šต๋‹ˆ๋‹ค. ์„ค๋ช… ๊ฐ€๋Šฅํ•œ AI ( eXplainable AI : XAI ) ๊ต๋‚ด ํ•™ํšŒ(KUBIG) ์˜๋ฃŒ์˜์ƒ ๋ถ„์„ ํ”„๋กœ์ ํŠธ์˜ ์ผํ™˜์œผ๋กœ ๋ฏธ๋‹ˆ ํ”„๋กœ์ ํŠธ๋ฅผ ๊ฐ์ž ์ง„ํ–‰ํ•˜๊ธฐ๋กœ ํ•˜์˜€๋‹ค. ์•ž์„  ๊ฒŒ์‹œ๋ฌผ์—์„œ ๋‹ค๋ค˜๋˜ Segmentation ๋ชจ๋ธ๋กœ ์œ ๋ช…ํ•œ U-net ๋…ผ๋ฌธ์„ ๋ฆฌ๋ทฐํ•˜๊ณ  ๊ตฌํ˜„ํ•˜๋ ค ํ–ˆ์—ˆ์œผ๋‚˜ ๋‹ค๋ฅธ ํ•™ํšŒ์›๋ถ„๊ณผ ์ฃผ์ œ๊ฐ€ ์™„์ „ํžˆ ๊ฒน์น˜๊ธฐ๋„ ํ–ˆ๊ณ , ๋ฐ์ดํ„ฐ๋ฅผ ๊ฐ€๊ณตํ•˜๊ณ  ๋ชจ๋ธ์„ ๊ตฌ์ถ•ํ•˜์—ฌ ํ•™์Šต์„ ์ง„ํ–‰ํ•ด๋„ ๊ทธ ํ”„๋กœ์ ํŠธ์˜ ๊ฒฐ๊ณผ๋ฅผ '์ธ๊ฐ„์˜ ๊ด€์ '์—์„œ ํ•ด์„ํ•˜๋Š” ๊ฒƒ์ด ๋งค์šฐ ์ค‘์š”ํ•˜๋‹ค. ๋•Œ๋ฌธ์— ์ธ๊ณต์ง€๋Šฅ๊ณผ ๊ด€๋ จ๋œ ์ด์Šˆ๋“ค์— XAI๊ฐ€ ๋น ์ง€์ง€ ์•Š๋Š” ๊ฒƒ์ด ์•„๋‹๊นŒ? ๋˜, ์ด์ „์— ๊ตฌํ˜„์— ์‹คํŒจํ•œ ๊ฒฝํ—˜ ๆœ‰. ๊ทธ๋ž˜์„œ ์ด ์ฃผ์ œ๋ฅผ ๊ณจ๋ž๋‹ค. ๊ตฌ๊ธ€๋ง์„ ์—ด์‹ฌํžˆ..

728x90
๋ฐ˜์‘ํ˜•