Transforming Stories into Comics using Generative AI

The narrator relishes breakfast while seated on the floor, sharing the meal with cats. The Lore Machine, after extensive development that spanned over a year, is now accessible for general users. Users can now upload as much as 100,000 words of text in 30,000-word segments for just $10 per month and generate 80 images. This functionality is suitable for a wide range of content types such as short stories, scripts and podcast transcripts to name a few. Power users also have their specific price points with an enterprise plan of $160 per month which can manage 2.24 million words and yield 1,792 images. The generated images come in various styles ranging from manga and watercolor to 80’s TV series aesthetic.

Zac Ryder of creative agency Modern Arts had access to an early version of the Lore Machine as presented by Thobey Campion, the tool’s founder. Ryder tested this tool by transforming a short film script into a full-fledged 16-page graphic novel in just a night. He expressed his amazement at seeing the storyboard come to life on the screen, especially appreciating the depth of storytelling and emotive expression. Modern Arts presently uses the Lore Machine in developing a manga series based on the text by the creator of the Netflix series Love, Death & Robots.

The narrator engages in casual banter regarding cat food with the man at the corner store. The Lore Machine operates on familiar elements. It employs a large language model, recognizing people, places, and sentiments in the text. Stable Diffusion then generates the respective images. Its user-friendly aspect stands out among the rest: uploading the story and obtaining the storyboard requires no more than a few clicks. As per Ben Palmer, CEO at New Computer Corporation, a user-friendly mega-tool with consistent UI is indeed appealing. He anticipates this as the future of the industry.

Campion, the force behind the Lore Machine, started this project two years back intending to create a blockchain version of Wikipedia. However, he switched to generative models, seeing their potential. He used a free text-to-image model called Midjourney and created a comic-book version of The Rime of the Ancient Mariner by Samuel Taylor Coleridge. The result was well received but the effort put into it was strenuous, as he had to generate images individually, attempting to maintain consistency.

In the final scenario, the narrator interacts with Marta who expresses concern about his new diet and offers to cook for him. Campion recalls the struggle to maintain consistency and style across images as challenging, making him delve into more abstract expressions.