在tf.keras中正确设置GAN实现中的.trainable变量

Question

我对在GAN实现中tf.keras.model的.trainable语句感到困惑。

给定以下代码片段（来自此存储库）：

class GAN():

    def __init__(self):

        ...

        # Build and compile the discriminator
        self.discriminator = self.build_discriminator()
        self.discriminator.compile(loss='binary_crossentropy',
            optimizer=optimizer,
            metrics=['accuracy'])

        # Build the generator
        self.generator = self.build_generator()

        # The generator takes noise as input and generates imgs
        z = Input(shape=(self.latent_dim,))
        img = self.generator(z)

        # For the combined model we will only train the generator
        self.discriminator.trainable = False

        # The discriminator takes generated images as input and determines validity
        validity = self.discriminator(img)

        # The combined model  (stacked generator and discriminator)
        # Trains the generator to fool the discriminator
        self.combined = Model(z, validity)
        self.combined.compile(loss='binary_crossentropy', optimizer=optimizer)

    def build_generator(self):

        ...

        return Model(noise, img)

    def build_discriminator(self):

        ...

        return Model(img, validity)

    def train(self, epochs, batch_size=128, sample_interval=50):

        # Load the dataset
        (X_train, _), (_, _) = mnist.load_data()

        # Adversarial ground truths
        valid = np.ones((batch_size, 1))
        fake = np.zeros((batch_size, 1))

        for epoch in range(epochs):

            # ---------------------
            #  Train Discriminator
            # ---------------------

            # Select a random batch of images
            idx = np.random.randint(0, X_train.shape[0], batch_size)
            imgs = X_train[idx]

            noise = np.random.normal(0, 1, (batch_size, self.latent_dim))

            # Generate a batch of new images
            gen_imgs = self.generator.predict(noise)

            # Train the discriminator
            d_loss_real = self.discriminator.train_on_batch(imgs, valid)
            d_loss_fake = self.discriminator.train_on_batch(gen_imgs, fake)
            d_loss = 0.5 * np.add(d_loss_real, d_loss_fake)

            # ---------------------
            #  Train Generator
            # ---------------------

            noise = np.random.normal(0, 1, (batch_size, self.latent_dim))

            # Train the generator (to have the discriminator label samples as valid)
            g_loss = self.combined.train_on_batch(noise, valid)

在定义模型self.combined时，鉴别器的权重被设置为self.discriminator.trainable = False，但从未重新打开。

然而，在训练循环中，鉴别器的权重将在以下行中发生变化：

# Train the discriminator
d_loss_real = self.discriminator.train_on_batch(imgs, valid)
d_loss_fake = self.discriminator.train_on_batch(gen_imgs, fake)
d_loss = 0.5 * np.add(d_loss_real, d_loss_fake)

并且将在以下期间保持不变：

# Train the generator (to have the discriminator label samples as valid)
g_loss = self.combined.train_on_batch(noise, valid)

我不会期望这样。

当然，这是训练GAN的正确（迭代）方式，但我不明白为什么在对鉴别器进行训练之前我们不必传递self.discriminator.trainable = True。

如果有人能够解释一下，那就太好了，我猜这是一个关键点需要理解。

- some_name.py

Answer 1

通常，当你对github仓库中的代码有疑问时，检查问题（包括已解决和未解决的）通常是一个好主意。这个问题 解释了为什么标志被设置为False。它说：

由于在编译鉴别器之后设置了self.discriminator.trainable = False，因此它不会影响鉴别器的训练。但是，由于在组合模型编译之前设置了它，因此当组合模型进行训练时，鉴别器层将被冻结。

还谈到了冻结keras层。

- o-90

---

非常感谢，这解决了我的问题...我应该检查一下，抱歉。 - some_name.py