CycleGAN 2

Cycle-Consistent Adversarial Networks ๋…ผ๋ฌธ๋ฆฌ๋ทฐ #1

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Abstract Image-to-Image ๋ณ€ํ™˜์€ ์ด๋ฏธ์ง€ ์Œ์˜ ์„ธํŠธ๋ฅผ ์‚ฌ์šฉํ•ด์„œ ์ž…๋ ฅ ์ด๋ฏธ์ง€์™€ ์ถœ๋ ฅ ์ด๋ฏธ์ง€ ์‚ฌ์ด์˜ ๋งคํ•‘์„ ํ•™์Šตํ•˜๋Š” ๊ฒƒ์ด ๋ชฉํ‘œ → ๋Œ€๋ถ€๋ถ„์˜ ์ž‘์—…์˜ ๊ฒฝ์šฐ, ์Œ์œผ๋กœ ๋ชจ๋“  ๋ฐ์ดํ„ฐ๋ฅผ ํ•™์Šต ํ•  ์ˆ˜ ์—†๋‹ค๋Š” ํ•œ๊ณ„์  ์กด์žฌ ์Œ์œผ๋กœ ๋œ ์˜ˆ์‹œ๊ฐ€ ์—†๋Š” ๊ฒฝ์šฐ, X → Y ๋กœ ์ด๋ฏธ์ง€๋ฅผ ๋ณ€ํ™˜ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ํ•™์Šตํ•˜๊ธฐ ์œ„ํ•œ ๋ฐฉ๋ฒ• ์ œ์‹œ → G:X→Y ๋ฅผ ์—ญ๋งคํ•‘ F:Y→X ์™€ ๊ฒฐํ•ฉ. F(G(X))≈X ์ด ์ ์šฉ๋˜๊ธฐ ์œ„ํ•ด a cycle consistency loss ๋„์ž… Introduction ์™ผ์ชฝ์˜ ์‚ฌ์ง„๋“ค์€ Paired data ์ด๋‚˜, ์˜ค๋ฅธ์ชฝ์˜ ์‚ฌ์ง„๋“ค์€ Unpaired data ๊ตฌ์„ฑ์ฒด ์„œ๋กœ..

Cycle GAN ์ •๋ฆฌ #1

https://youtu.be/Fkqf3dS9Cqw Cycle GAN ๋…ผ๋ฌธ ์ €์ž๋‹˜์˜ ๋ฐœํ‘œ๊ฐ•์˜ ์˜์ƒ Cycle GAN ์‚ฌ์ง„์œผ๋กœ ๊ตฌ์„ฑ๋˜์–ด ์žˆ๋Š” 2๊ฐ€์ง€์˜ data set ์„ ์ด์šฉํ•˜์—ฌ ํ•œ ์ด๋ฏธ์ง€๋ฅผ ๋‹ค๋ฅธ ์ด๋ฏธ์ง€์˜ style๋กœ ๋ณ€ํ™˜ How does it work? pix2pix GAN Cycle GAN pix2pix input ๊ณผ out์ด ๋ชจ๋‘ ์‚ฌ์ง„์ด์–ด์•ผ ํ•˜๋Š” supervised learning framework Goal : ํ‘๋ฐฑ์‚ฌ์ง„์€ ์ปฌ๋Ÿฌ์‚ฌ์ง„์œผ๋กœ ๋ฐ”๊ฟ”์ฃผ๋Š” neural network train test ํ‘๋ฐฑ → ? train ๋„ํ˜•→์‚ฌ์ง„ test ๋„ํ˜•→? Loss : output G(x) and ground truth y ์˜ ์ฐจ์ด๋ฅผ ์ตœ์†Œํ™” → ์–ด๋–ค ๊ฒƒ์ด ๊ฐ€์žฅ ์˜ณ์€ ๊ฒƒ์ธ์ง€ (์‚ฌ๋žŒ์€ ์•Œ ์ˆ˜ ์žˆ์œผ๋‚˜) ํŒ๋‹จ ํ•  ์ˆ˜ ์—†์œผ๋ฏ€๋กœ..