MR Visual TaleForge (Books with Stable Difussion + ChatGPT)
A downloadable tool
This tool generate Illustrated books in PDF format.
To run this tool you need :
- Open AI API : You need an OPEN AI Code to generate text.
You can also write the texts without generating them.
Refer to How to setup OpenAI API
- Stable Diffusion Installed locally: You need to generate the images.
Without it you can add images manually to the folders .
Refer to How to install Stable Diffusion on your Computer
How it works:
You write a short idea of the story and select some option for generating the images and number of pages. Then the app calls OPEN A to generate a text for your story.
You can ask also a story in a language different from English.
The system will after call "Stable Diffusion" installed locally with API and will generate the images.
The system adds some text to each image, create a pdf for each image and merge them in a final file.
Depending on your Graphic card, a generation of a 10 pages illustration can take less than 2 minutes .
If you are not happy with the result you can edit any page, add new pages, update the generation text and run again the image generation.
Here is an example:
I start a new project adding a few words about my project idea.
Some information that I want to have in each picture generated by stable diffusion .
Some negative information to avoid ugly pictures.
When you press confirm the system will show a log of the different steps.
You can check the text generated by the AI.
And also an image with all the images generated.
You can select one by one the pages and update them if you want
The pdf file will something like this :
Resolution in this alpha version is 768x512 for each image and the size of the pdf is Letter in horizontal format. I will improve the quality in future version using rescale in Stable Diffusion .
Future ideas:
- Select font and size
- Move the text around the page
- Adding some other text or little images on the pages
- Change the size of the PDF.
The software it is free, I hope you enjoy it.
To get an OPEN IA API you need to go to : https://openai.com/product
To get Stable Diffusion software go to : https://github.com/AUTOMATIC1111/stable-diffusion-webui
You need to follow some instruction to install it (install GIT, Python, etc.)
Also you need a checkpoint, the app uses the selected checkpoint in stable diffusion , you can download some from https://civitai.com/ (attention to this site there is some content for 18+).
Status | Prototype |
Category | Tool |
Rating | Rated 5.0 out of 5 stars (2 total ratings) |
Author | Misterm |
Tags | ai, book-generator, stable-diffusion |
Download
Development log
- Check out Tutorial for the app.Feb 03, 2024
- Released version 24.02.03Feb 03, 2024
- How to Setup and OpenAI API to use with MR Visual TaleforgeSep 24, 2023
- How to install and Run Stable Diffusion on your ComputerSep 24, 2023
- Introducing MR Visual TaleForge (Alpha 1): Create Illustrated Books with AISep 23, 2023
Comments
Log in with itch.io to leave a comment.
Is it possible to use ollama with it, instead of ChatGPT?
If so, how?
At the moment not.. but If I change the code.. it would be great to use a local implementation to avoid using a paying service. I need to study how to intall ollama, and if it has any api to use.. Which implementation are you using?
Llama 3 8B