Conditional Generative Adversarial Nets

Conditional Generative Adversarial Nets

  • Link : https://arxiv.org/abs/1411.1784

Abstract

์ด ์—ฐ๊ตฌ์—์„œ๋Š” ์กฐ๊ฑด๋ถ€ GAN(CGAN)์„ ์†Œ๊ฐœํ•œ๋‹ค. CGAN์€ generator์™€ discriminator์— ์กฐ๊ฑด๋ถ€ ์ •๋ณด $y$๋ฅผ ์ž…๋ ฅ์œผ๋กœ ์ œ๊ณตํ•˜์—ฌ ๊ตฌ์„ฑ๋œ๋‹ค.

Introduction

๊ธฐ์กด์˜ GAN์€ ์ƒ์„ฑํ•  ๋ฐ์ดํ„ฐ๋ฅผ ํ†ต์ œํ•  ์ˆ˜ ์—†์ง€๋งŒ, ์ด ๋…ผ๋ฌธ์—์„œ๋Š” Conditional GAN์„ ํ†ตํ•ด ์กฐ๊ฑด์— ๋งž๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ์ฆ‰, data generation process๋ฅผ ํ†ต์ œํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์†Œ๊ฐœํ•œ๋‹ค. ์—ฌ๊ธฐ์„œ ๋งํ•˜๋Š” ์กฐ๊ฑด์€ class label์ด๋‚˜, ๋ณต์›ํ•  ๋ฐ์ดํ„ฐ์˜ ์ผ๋ถ€ ๋˜๋Š” ๋‹ค๋ฅธ ํ˜•์‹์˜ ๋ฐ์ดํ„ฐ(different modality)๊ฐ€ ๋  ์ˆ˜ ์žˆ๋‹ค.

3 Conditional Adversarial Nets

3.1 Generative Adversarial Nets

GAN์€ ์ƒ์„ฑ ๋ชจ๋ธ์„ ํ•™์Šตํ•˜๋Š” ์ฐธ์‹ ํ•œ ๋ฐฉ๋ฒ•์ด๋‹ค. GAN์€ ๋‘ ๊ฐœ์˜ ์ ๋Œ€์ (adversarial) ๋ชจ๋ธ์ธ generator $G$์™€ discriminator $D$๋กœ ๊ตฌ์„ฑ๋˜์–ด ์žˆ๋‹ค.

$G$์™€ $D$๋Š” ๋™์‹œ์— ํ•™์Šต์ด ์ง„ํ–‰๋˜๋ฉฐ, $G$๋Š” $log \ (1-D(G(z)))$๋ฅผ ์ตœ์†Œํ™”ํ•˜๋„๋ก, $D$๋Š” $log \ D(X)$๋ฅผ ์ตœ์†Œํ™”ํ•˜๋„๋ก ํ•™์Šต๋œ๋‹ค.

$\underset{G}{min}\ \underset{D}{max}V(D,G) = E_{x\sim p_{data(x)}}[logD(x)]+E_{z\sim p_{z(z)}}[log(1-D(G(z)))]$

GAN์— ๋Œ€ํ•œ ์ž์„ธํ•œ ์„ค๋ช…์€ Generative Adversarial Nets

3.2 Conditional Adversarial Nets

image

GAN์€ generator์™€ discriminator๊ฐ€ ๋ชจ๋‘ ์ถ”๊ฐ€ ์ •๋ณด์ธ $y$์— ๋Œ€ํ•ด conditioned onํ•˜์—ฌ condtional model๋กœ ํ™•์žฅํ•  ์ˆ˜ ์žˆ๋‹ค. $y$๋Š” class labels๋‚˜ ๋‹ค๋ฅธ ํ˜•์‹์˜ ๋ฐ์ดํ„ฐ(other modalities)์™€ ๊ฐ™์€ ๋ณด์กฐ์ ์ธ ์ •๋ณด๊ฐ€ ๋  ์ˆ˜ ์žˆ๊ณ , ์ด๋ฅผ discriminator์™€ generator์— ์ถ”๊ฐ€์˜ input layer๋กœ ๋„ฃ์–ด์คŒ์œผ๋กœ์จ ์กฐ๊ฑด์„ ๋ถ€์—ฌํ•  ์ˆ˜ ์žˆ๋‹ค.

Generator์—์„œ๋Š” ์‚ฌ์ „ ์ž…๋ ฅ ๋…ธ์ด์ฆˆ $p_z(z)$์™€ $y$๊ฐ€ hidden representation์œผ๋กœ ๊ฒฐํ•ฉํ•˜๊ณ , discriminator์—์„œ๋Š” $x$์™€ $y$๊ฐ€ ์ž…๋ ฅ๊ณผ discriminative function์— ๋“ค์–ด๊ฐ„๋‹ค.

$\underset{G}{min}\ \underset{D}{max}V(D,G)=E_{x\sim p_{data}(x)}[log \ D(x y)] + E_{z\sim p_z(z)}[log \ (1-D(G(z y)))]$

Experimental Results

image

๊ทธ๋ฆผ์„ ๋ณด๋ฉด ๊ฐ ํ–‰๋งˆ๋‹ค MNIST digits์— ๋งž๊ฒŒ ์ด๋ฏธ์ง€๊ฐ€ ์ƒ์„ฑ๋˜์—ˆ์Œ์„ ๋ณผ ์ˆ˜ ์žˆ๋‹ค.

Categories:

Updated:

Leave a comment