The Abstraction of DALLEs and their Limitation with Concept-to-Image Translation that Social Media Does Not Encourage

DALLE 2 has been making headlines here and there but have we been seeing it in its failures as well as its success?

As we know very well, social networks encourage the promotion of positive and original content and the demotion of negative and previously seen one.

That said, it is likely that what comes out of DALLE on Twitter or Instagram will have a bias over what comes out of DALLE in general!

i.e. P( DALLE | Twitter) ≠ P (DALLE)

Of course, the DALLE family has unprecedented abstraction power such as these two “surreal avocado” depictions with mini-DALLE trained on 30% of the data. If I were to ask you to think of surreal avocado concepts, would you have imagined these scenarios? Needless to mention your technical abilities at painting these images.

Another scenario would have been the fruit contained in the seed that did not come out with my testing. Anything else?

Surrealism comes with several tastes but one that has marked history the most is that of Salvador Dali who once screamed “I am surrealism” when kicked out of the surrealist movement created by Andre Breton!

So where are the abstraction limits you might ask…

Type in your DALLE prompt “CityName in the year NNNN” Where NNNN>2022 and you will get pictures of the city with occasional writings of NNNN.

I have seen it a couple of times posted and then deleted from twitter.

What else challenges DALLE?

Comments welcome!

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
ALAgrApHY

Traditional & AI Artist, Data Scientist, Filmmaker exploring Creative AI. Started the GAN AI Art Movement in 2016. Former Postdoc @CNRS & PhD @INFORMATICS