ChatGPT Integrates DALL-E to Analyze and Interact with Images

Facebooktwitterpinterestlinkedin

In September 2023 OpenAI combined their LLM chatbot ChatGPT with their AI-powered image-generating app DALL-E. Now instead of typing text prompts to generate an image, users can converse with ChatGPT who will then create the best prompt to generate an image.

It works in reverse, too. Now you can upload an image to ChatGPT and it can see and interact with that image. For example, I used Canva to make a simple cartoon image of a panda eating bamboo and added a few other jungle animals. I uploaded the image to ChatGPT and asked it, “Can you write a children’s book based on this image?”

ChatGPT replied:

Of course, Tod! Here’s a medium-length children’s story inspired by the image you provided:

Title: The Bamboo Surprise

In a cheerful corner of the jungle, three best friends lived side by side: Lulu the sloth, Gigi the giraffe, and Pippa the panda.

One day, Lulu, who was hanging upside-down as usual, spotted something shiny and green. “What’s this?” she wondered aloud, pulling at a strand of bamboo.

Gigi, always curious, bent down and took a nibble. “Oh, this is tasty!” she exclaimed. “But wait… Giraffes don’t eat bamboo.”

Pippa, who was already munching on bamboo, giggled and said, “Well, now they do!”

The three friends laughed and decided to have a bamboo feast. They invited all the animals from the jungle. The monkeys, the tigers, even the birds. Everyone came, and to their surprise, they all loved the bamboo!

As the sun set, the jungle was filled with laughter and the sound of bamboo crunching. It was a day the animals would always remember. The day the jungle had a bamboo surprise!

And so, in that cheerful corner of the jungle, three best friends learned that sometimes, trying something new with those you love can lead to the most delightful surprises.


The end…..of writers using their own creativity to write books? Maybe.

In response to the massive influx of ChatGPT-written, self-published books, Amazon recently restricted “writers” to uploading no more than three books per day.