Group Abstract Group Abstract

Message Boards Message Boards

Latent vectors as compressed images using neural network

3 Replies

This is very interesting. As someone who is not intimately familiar with training NNs I have a question however:

You mentioned one of the applications here was training a sufficiently deep NN to compress a photo library. Let's say you have a NN that has already been trained on a library; what if I wanted to add one more photo to the library? Would I have to retrain the NN from scratch and do a large number of training steps, or is the NN with its current parameters a good starting point, and we can retrain the current NN with a small number of training steps?

I'm guessing this type of question is something that is far more general, but it is something I was wondering about.

POSTED BY: David Trimas

This is a general limitation of any neural network. Retraining a neural network with new data will always make it forget existing ones. There are techniques to workaround this with some degree of success. One way is to include the new images with some samples from the existing dataset and retrain the network. But I doubt it will work in case of image reconstruction since new data will confuse the network.

There are also some research that demonstrate deep networks eventually learn to generalize much later past the overfitting stage, when trained for several thousands of rounds. Some reasons cited are that the network finds the global minimum of cost function and the network learns the most efficient representation and transformation functions. (https://arxiv.org/abs/2201.02177)

In theory, it should be possible to design a network that learns to do DCT or Wavelets or something even better internally to compress and reconstruct any generic image on the fly, after it is trained for several rounds, but this not has been studied yet.

enter image description here -- you have earned Featured Contributor Badge enter image description here Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!

POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard