Message Boards Message Boards

How does a neural network that only knows beauty interpret the world?

POSTED BY: Marco Thiel
10 Replies

That is a very (!) interesting thought that I had not considered. As you say, it is clear and documented that different machine learning approaches take decisions that can be very biased when the training is biased.

The good news is the with Mathematica and Wolfram Language, the people have access to these tools, and they can learn the benefits and perils of this technology.

Yes, that is undoubtedly true. But are "people" exploring this sufficiently. Not to long ago I saw this video, which uses what is known as Deep Fake. There is more of an explanation here and another video here. It appears that there is a new arms race developing. One fraction produces fake videos and another one tries to recognise that a video is fake. I guess that the Wolfram Language is very useful to explore and perhaps apply these techniques, but "information" from a fake video will spread really fast on social media. A proof that it was fake cannot fix that.

Is the Wolfram Language the tool to figure these things out? Is it a tool to teach pupils/students these techniques to avoid the problems? Will the Wolfram Language, or Mathematica 18 or something allow people without much technical knowledge to calculate these things ideally with voice commands? (A little bit like Siri now solves sets of nonlinear equations by just asking based on Wolfram|Alpha.) Or will it allow a larger part of society allow to achieve a level of mathematical expertise to develop computational thinking such that we have the technology to figure out what is fact and what is fiction?

I am sorry, but I digress.

Thanks a lot,

Marco

POSTED BY: Marco Thiel

You are probably right, but I am still optimistic. We have ample evidence that it is much easier to mis-use statistical software (medical research and sociology, I'm looking at you) than it is to do careful science. The same can be said for any powerful tool.

The personal computer was invented mostly because there was a small group of enthusiasts who wanted their own computer, rather than having to jump through hoops to sue some company's or college's iron. I know, I was one of them, although I was an early adopter of the technology, rather than an inventor. As a percentage, there were not that many of us, but without this seed, there would not have been the personal computer as we know it. It took a 'killer app' (visicalc) for business to take notice and then computers became more mainstream.

I think that Mathematica could be the "killer app" of the twenty-first century. The percentage of people using it is very small at the moment, but if we get the breaks, the ideas generated by Mathematica users could have a profound effect on society in general.

There are some minor tweaks to the program that would facilitate things. Wolfram|Alpha is close to the interface needed for people without technical knowledge. I think that there is the beginning of the transition from W|A to Wolfram Language already in place.

Mathematical expertise is needed at several levels. However, as I learned by experience, the most difficult step for non-techies it to realize that a problem, properly understood, can be modeled with mathematics.

Despite recent evidence, I still have faith....

Wonderful work, @Marco ! I will have to think about what other net architectures could do this trick. Strangely the art and even the idea reminded me of Annihilation 2018 movie. Images below do not really convey, one should see the film for the photography :-)

enter image description here

enter image description here

POSTED BY: Vitaliy Kaurov

Dear Vitaliy,

unfortunately I don't know that movie. I'll have a look as soon as it is available here in the UK.

I will try different network architectures and also different trainings sets. As many of the blog entries and videos say, it is quite difficult to come up with a network from scratch so this is about modifying existing ones and I guess that folks at Wolfram have much more experience with this than me though...

Thank you,

Marco

POSTED BY: Marco Thiel

fascinating, on a non coding note. I used to paint cityscapes. And I found, merely the act of copying something down, in the imperfect realism of which I was capable still made a beautiful image. Windows that were square, but that I could not make entirely so with my brush. Shadows that in my photo were nondiscernable blobs simply became splashes of color. A neural net that could identify such ambiguities, and make choices on how to represent them would produce some interesting results. Imperfections in my style, in the limits of my skill, forced me to make choices in how I represented certain things.

If I were to suggest a revision to your net, it would possibly include some Gaussian filtering, though I'm not sure how a Neural net would fit in.

POSTED BY: Jeremy Sykes

Dear Jeremy,

yes, I see what you mean with the Gaussian Filtering and have an idea of how to achieve that. Regarding the cityscape that you painted: it would be great to see a sample. I wonder to what extent neural networks could learn to produce aesthetically pleasing representations. Another question is whether a net could be able to decide whether something is pleasing for humans. That, of course has quite some applications. There is an entire industry trying to predict whether film scripts, manuscripts of books or songs will be bestsellers or not.

There was a BBC program where they tried to predict whether a song would be selling well, here's another discussion of that experiment. They sort of failed to achieve what they wanted, but it is interesting anyway.

I'd love to try that on my entire iTunes library, but that does not work, because of copyright issues, I guess.

Best wishes and thank you,

Marco

POSTED BY: Marco Thiel

enter image description here - Congratulations! This post is now a Staff Pick as distinguished by a badge on your profile! Thank you, keep it coming!

POSTED BY: Moderation Team

Dear Marco,

very nice, thanks for sharing! I am always amazed by your ideas and creativity! And as one can see this approach has practical implications, e.g. undisturbing traffic lights, soldiers in perfect camouflage, atomic flower power explosions, etc...

Best regards -- Henrik

POSTED BY: Henrik Schachner

Dear Henrik,

thank you very much for you kind words. I have, however, not done anything than copying what was described in the original article using the creativity that is in the Wolfram Language.

This post was more for me to explore machine learning. I do only apply some few applications of ML and am trying to explore more. I did find the original article quite interesting though. This was also my very first attempt at this. I will try to do the same with other sets of images etc.

Thank you for your comments,

Marco

POSTED BY: Marco Thiel
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract