Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm


There has been a lot of talk about AI generated images and visual art. One of the projects that I found most impressive was DALL-E 2. This is a new AI system that can create realistic images and art from a description in natural language.

DALL-E 2 is currently invite-only so I entered my email to the waitlist. A few days later, the invite arrived. Instead of focusing on more meaningful work, I fooled around with the system. Here’s what I got…

Natural Language Descriptions

I am primarily a landscape photographer, so I wanted to test when AI will replace me. My first description that I typed in was “snow covered mountains with a rainbow and a flying unicorn”. And DALL-E 2 created this,

DELA DISCOUNT dall-e-2-hands-on-photo-1-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“SNOW COVERED MOUNTAINS WITH A RAINBOW AND A FLYING UNICORN”
DELA DISCOUNT dall-e-2-hands-on-photo-2-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“SNOW COVERED MOUNTAINS WITH A RAINBOW AND A FLYING UNICORN”
DELA DISCOUNT dall-e-2-hands-on-photo-3-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“SNOW COVERED MOUNTAINS WITH A RAINBOW AND A FLYING UNICORN”
DELA DISCOUNT dall-e-2-hands-on-photo-4-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“SNOW COVERED MOUNTAINS WITH A RAINBOW AND A FLYING UNICORN”

Clearly, I can keep my job for now! Next, I tried something more realistic, “beautiful waterfall with a lot of green moss and rocks in the foreground.”

DELA DISCOUNT dall-e-2-hands-on-photo-5-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BEAUTIFUL WATERFALL WITH A LOT OF GREEN MOSS AND ROCKS IN THE FOREGROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-6-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BEAUTIFUL WATERFALL WITH A LOTS OF GREEN MOSS AND ROCKS IN THE FOREGROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-7-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BEAUTIFUL WATERFALL WITH A LOTS OF GREEN MOSS AND ROCKS IN THE FOREGROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-8-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BEAUTIFUL WATERFALL WITH A LOTS OF GREEN MOSS AND ROCKS IN THE FOREGROUND”

If these above are really AI-generated, I am impressed! It looks real. So I continued with “autumn forest in the mist.”

DELA DISCOUNT dall-e-2-hands-on-photo-9-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST”
DELA DISCOUNT dall-e-2-hands-on-photo-10-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST”
DELA DISCOUNT dall-e-2-hands-on-photo-11-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST”
DELA DISCOUNT dall-e-2-hands-on-photo-12-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST”

A bit dull so I added “autumn forest in the mist with mushrooms on the ground.”

DELA DISCOUNT dall-e-2-hands-on-photo-13-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-14-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-15-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND”
DELA DISCOUNT dall-e-2-hands-on-photo-16-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND”

Impressive again! Let’s try something harder, “autumn forest in the mist with mushrooms on the ground and a deer in the back.”

DELA DISCOUNT dall-e-2-hands-on-photo-17-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND AND A DEER IN THE BACK”
DELA DISCOUNT dall-e-2-hands-on-photo-18-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND AND A DEER IN THE BACK”
DELA DISCOUNT dall-e-2-hands-on-photo-19-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND AND A DEER IN THE BACK”
DELA DISCOUNT dall-e-2-hands-on-photo-20-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“AUTUMN FOREST IN THE MIST WITH MUSHROOMS ON THE GROUND AND A DEER IN THE BACK”

Less impressive… I do like how the AI added the birds and how the mushrooms started to levitate.

Uploading My Own Images

DALL-E 2 offers an option to upload your own images and then the system generates variations. This sounds interesting too and might be an even greater test of the AI’s power. The AI has to “read” the image and then create meaningful alternatives. How did it work? Let’s see.

DELA DISCOUNT dall-e-2-hands-on-photo-21-800x534 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
Lake Bled, Slovenia – The original source image.

My image of Lake Bled in autumn seemed like a perfect example to test. The composition, the colors, and the subject are all distinct and should be easy to replicate.

Here are the resulting variations, created by AI:

DELA DISCOUNT dall-e-2-hands-on-photo-22-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-23-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-24-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-25-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

Next, I wanted to test how DALL-E 2 generates people in the image. I uploaded one of my travel portraits and got this message:

DELA DISCOUNT dall-e-no-faces-allowed-800x293 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

Fair enough, it makes sense. So I tried with a more silhouetted person, without a recognizable face. This time it worked.

DELA DISCOUNT dall-e-2-hands-on-photo-26-800x534 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
Views from top of Taljanka, Albanian mountains — The original source image.

Here are the AI-generated variations:

DELA DISCOUNT dall-e-2-hands-on-photo-27-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-28-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-29-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-30-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

The photographer and his camera in hand are both unnaturally skewed and distorted. The mountain layers are all very realistic and obviously changed.

Editing Existing Images

Once you upload your own images, there is an option to edit them simply by using a brush on a part of the image and describing in text what you want to create in this area. Here are a few results…

DELA DISCOUNT dall-e-2-hands-on-photo-31-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BLACK BIRDS FLYING”
DELA DISCOUNT dall-e-2-hands-on-photo-32-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BLACK BIRDS FLYING”
DELA DISCOUNT dall-e-2-hands-on-photo-33-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BLACK BIRDS FLYING”
DELA DISCOUNT dall-e-2-hands-on-photo-34-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“BLACK BIRDS FLYING”
DELA DISCOUNT dall-e-2-hands-on-photo-35-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“LAND ROVER DEFENDER PARKED IN THE GRASS WITH A ROOFTOP TENT”
DELA DISCOUNT dall-e-2-hands-on-photo-36-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“LAND ROVER DEFENDER PARKED IN THE GRASS WITH A ROOFTOP TENT”
DELA DISCOUNT dall-e-2-hands-on-photo-37-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“LAND ROVER DEFENDER PARKED IN THE GRASS WITH A ROOFTOP TENT”
DELA DISCOUNT dall-e-2-hands-on-photo-38-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“LAND ROVER DEFENDER PARKED IN THE GRASS WITH A ROOFTOP TENT”
DELA DISCOUNT dall-e-2-hands-on-photo-39-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“FLOCK OF SHEEP GRAZING IN THE GRASS”
DELA DISCOUNT dall-e-2-hands-on-photo-40-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“FLOCK OF SHEEP GRAZING IN THE GRASS”
DELA DISCOUNT dall-e-2-hands-on-photo-41-800x800 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT
“FLOCK OF SHEEP GRAZING IN THE GRASS”

As you can see, not very impressive. It’s fun, but not realistic by any means. The land rovers are quite okay, but the sheep or the birds are clearly fake. Here below are the original images I used to create the above variations:

DELA DISCOUNT dall-e-2-hands-on-photo-42-800x534 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-43-800x534 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

DELA DISCOUNT dall-e-2-hands-on-photo-44-800x534 Hands-on with DALL-E 2, the AI Image Generator Taking the Web by Storm DELA DISCOUNT

Conclusion

AI has definitely made huge progress in the last few years. We’ve seen music composed by the computers, deep fake videos of famous dead people, and now images being created by simply typing in text descriptions! I am not sure if AI is the right term as these are a set of algorithms that learn and improve with more and more data being fed to it. Anyways, the results I got with playing around were better than expected. There are many completely silly results, but sometimes the algorithm gets it really well.

I can see how useful this can become in the future. And how easy it will be to abuse it. The technology however is still in its infancy. At the moment I see it more or less as a toy to experiment with. Maybe in a few years this will change and we will see a flood of amazing images that have nothing to do with reality. Then I believe, the craft of true photography will only become more valued.


About the author: Luka Esenko is a photographer based in Ljubljana, Slovenia. The opinions expressed in this article are solely those of the author. Esenko teaches photography workshops in and around Slovenia and he is also a co-founder of Photohound. You can find more of his work on his website, Twitter, and Instagram. This article was also published here.





Source link

We will be happy to hear your thoughts

Leave a reply

DELA DISCOUNT
Logo
Enable registration in settings - general
Shopping cart