This is how DALL-E , the Open AI image generator, works. A complete guide on how to use DALL-E in Italian also on ChatGPT.
Technological evolution in recent years is significantly changing users’ approach to everyday life. If until a few years ago it was difficult to predict the impact of new technologies, today we see a growing interest and involvement of users in AI ( Intelligence Artificial), perhaps you have already heard of ChatGPT or Imagine With Meta AI , software capable of making the most of written chats to generate content.
Today we will specifically analyze DALL-E , a revolutionary image generator based on an artificial intelligence algorithm. Let’s see what it is and how to best use it.
- What DALL-E is and how it works
- This can be done with DALL-E
- How to generate images with DALL-E
- How to use DALL-E on ChatGPT
When using the term DALL-E we are referring to the algorithm developed by the company OpenAI capable of generating images from a textual description . We can, therefore, consider it a real image generator with artificial intelligence. Over time DALL-E has introduced more and more functions, moving from the simple graphics generation of the first version to the real-time modifications of the latest.
But how does it work? Technically DALL-E is based on GPT-3 (Generative Pre-trained Transformer), i.e. a technology capable of recognizing text thanks to the non-neural correspondence of 175 billion parameters . The image generator developed by OpenAI, announced in 2021, integrated 12 billion parameters, while the second version reached 175 billion.
AI models are mainly based on two phases: training and action .
- With training, artificial intelligence “learns” from the data provided to it with a huge dataset of images and texts.
- With the action , we, the users, ask the AI to extrapolate the information we need from the dataset.
As you might imagine, that process is especially streamlined for AI chats, as there are only the training and action phases. With DALL-E , which represents an image generator, the process is not so immediate. In fact, the developers implement a huge dataset of texts and images , but much more advanced, by applying an embedded CLIP model , i.e. each term corresponds to a specific image and information. In this case there is a correlation between the two functions, training and action, providing better results with over 650 million associated images .
This can be done with DALL-E
A valid alternative to Midjourney , DALL-E 2 instead introduced the real generative model , that is, the one that actually creates the images when you send a proposal to the artificial intelligence . The DALL-E algorithm is divided into two parts, the PIOR model , which aims to create a CLIP image, and the DECODER model which aims to produce images related to CLIP information.
Currently DALL-E can create images from text and edit them, but there will certainly be interesting innovations in the future. When using this tool, we recommend writing a long, detailed description . As we anticipated, the system has a lot of information that is correlated to the images, the better the description will be and the closer the result will be to what you were imagining.
DALL-E 2 can create particularly realistic images and works of art , but many artists are strongly criticizing this feature. OpenAI is committed, with DALL-E 3 , to improving the AI generation by protecting artists and making this algorithm increasingly complementary to their work. Specifically, DALL-E 3 significantly improves its learning ability , i.e. it interprets and understands textual instructions much better.
In order to use this tool you should access the dedicated page and take advantage of the credit system . You can test DALL-E for free in the beta version , and get 50 credits for the first registration and 15 free credits every month .
How to generate images with DALL-E
Having established that DALL-E is an image generator that can create graphics from scratch from simple text, it is interesting to understand how to use it.
Go to the official DALL-E page and log in with your OpenAI account , ChatGPT account is fine too ; otherwise you can sign in with a Google , Microsoft and Apple account . A page will open on which you will have to click Start creating with DALL- E. If you decide to register with a new email, OpenAI will send you a code via SMS to verify that you are not a bot.
Once you launch the main page you will notice an empty string in the central part where you can insert the text . Although the software was developed to work best with the English language, you can also start a chat in Italian .
This is the most important phase to get your AI image, in fact, you will have to write a detailed description of what you want. Try to be precise and once you have completed the description click on Generate on the right. If you have a Plus version of ChatGPT the software will automatically start to generate images, while if you have already used the free credits in the past , you will have to purchase them by clicking on Buy credits , just below the chat string. For more information you can read the DALL-E credit guide.
How to use DALL-E on ChatGPT
Is the idea of buying credits for this image generator just not in your plans? Then you can opt for the plugin on ChatGPT . In fact, you will be able to test DALL-E 2 from the same GPT-4 chat , but how to activate it?
In order to use all the features and associated plug-ins, you should necessarily have a subscription plan to ChatGPT Plus , the paid version which has a monthly cost of 20 dollars . In reality, ChatGPT Enterprise also allows you to do this, but it is a solution suitable primarily for companies.
Then log in to ChatGPT Plus and click on the GPT-4 menu at the top. Check the Plugins item , but if it is not present, press the three dots next to your username, at the bottom left, select Settings and access the Features section , where you must activate Plugins.
Go back to the home page and visit the Plugin Store , from here search for DALL-E and install it. You can then automatically use it in the main ChatGPT chat by writing creative and fun prompts .
