Luma LabsThe Hey The company known for creating Genie generative 3D models has now ventured into AI-powered video technology with its new offering, Dream Machine – and social media users are very excited about it. New AI Video Maker On the scene, it’s in direct competition with OpenAI’s upcoming Sora tool.
What is Luma AI?
Luma AI is a platform where users can create 3D models using text, images, or video inputs. The tool helps professionals such as architecture, product design, content creation, and research and development dream up abstract concepts. The company streamlines the process of exporting work to different platforms.
3D models are also powering meta-activities such as gaming, virtual reality, and e-commerce by simplifying the creation of 3D online spaces.
Developed by LumaLabs in San Francisco, California, Luma AI uses knowledge of the following machine learning, augmented realityand to merge 3D photography with the field of 3D modeling.
Using Neural Radiance Fields (NeRF) technology to transform images and videos captured by smartphones into highly realistic 3D models, NeRF transforms ordinary scenes and objects by adding an element of realism to them.
Co-founder and CEO Amit Jain, who was also previously part of it. Apple Vision Pro And Apple’s computer vision team is currently leading this work.
In various gadgets, dream Machine The company’s new contribution is Vivid, an AI model designed to generate high-quality, realistic videos from text and images. So far, it produces accurate, consistent, and dynamic visualizations. This tool takes a step toward creating a universal visualization engine and is now accessible to everyone.
In one of his statements, he said Blog PageLuma Labs said: “We built Dream Machine on a scalable, efficient, and multimodal Transformer architecture and trained it directly on video.”
He described the tool as an “imagination engine”, because “we find joy and purpose in making things. At Luma we are building general AI systems that will help people make beautiful, powerful, creative things that are inaccessible or simply impossible.”
What are people’s reactions to Dream Machine?
Demand increased so much following the launch of Dream Machine that Luma Labs had to implement a queuing system due to the excessive load on their servers.
Introducing Dream Machine – a next-generation video model for creating high-quality, realistic shots from text instructions and images using AI. It’s available to everyone today! Try it for free here https://t.co/rBVWU50kTc #LumaDreamMachine pic.twitter.com/Ypmacd8E9z
— Luma AI (@LumaLabsAI) June 12, 2024
he is alive 🤯 pic.twitter.com/dnr3nPC1Aw
— fofr (@fofrAI) June 13, 2024
BP-O and Bah-Bah – my kids’ beloved stuffed animals came to life tonight @LumaLabsAI And some hard work from dad. 🐦⬛ I’ll show him tomorrow morning pic.twitter.com/ELm4bNtokW
— Stormcrow (@Stormcrow_JE) June 13, 2024
Initial videos posted on social media by users with prior access to the Dream Machine were so polished that they looked as if only the best results had been selected.
Try it first #luna The AI and the results were amazing, happy to have switched my career from cinema and animation to development a few years ago so I can survive for a few more years pic.twitter.com/Yn6JegVA8P
— Aamir | Ξ𝕏𝕏ΞO (@Amir_EXXEO) June 13, 2024
There’s stiff competition in the text-to-video creation space, with major players like OpenAI’s Sora and Lightricks’ LTX Studio, both of which offer great videos.
Other startups doing something similar include Pika Labs Inc. and Runway Inc., both of which focus on generating video content from text.
How to use Luma AI’s Dream Machine
To make the best use of the tool, users need to type in extremely detailed prompts, which is more than what you would get using a tool like ChatGPT. For example, according to the company, typing “grazing cows slowly walk through an idyllic meadow, the camera tracking along with them in a smooth side-angle motion” can create an extremely realistic five-second video clip showing exactly that scenario.
He said that the Dream Machine would be able to make such a video within just two minutes.
ReadWrite tested this, and it gave some interesting results. We used the prompt: Dreamscape of “a woman climbing a mountain, turning into an eagle and flying away”
While it starts off pretty accurate, it does a weird thing when it creates a clone of itself, showing two separate women – one standing and the other flying.
The second prompt had even less success: “A view of a sports motorbike transforming into an eagle while travelling on Route 66 in the USA”
Instead of the motorcyclist transforming into an eagle, he is seen rapidly running off to the side, causing a minor accident while a bird is seen flying randomly. We found that text prompts needed to be quite specific for best results.
In the final test, we used the hint suggested by Dream Machine: “An old woman wearing a scuba diving suit is laughing underwater, her expressions reflect peace and happiness”
Its own recommendation worked pretty well. While we couldn’t zoom in to see the usual squinty eyes seen in many AI images, it did look pretty realistic.
Is Luma AI’s Dream Machine free?
As mentioned, anyone interested can use it, but you will need to register for an account using your email. Once registered, you are entitled to 30 generations per month on the free plan. More expensive plans offer up to 2,000 generations per month for $499.
Currently, there is a lot of demand for this service, which may limit its accessibility. The Dream Machine website warns, “Generation takes 120 seconds. However, due to high demand, your request will remain in the queue.” Being able to generate 30 videos for free is useful, especially since most people may not need more than that for personal purposes.
Dream Machine’s biggest advantage is its open-source framework, courtesy of Luma AI. In contrast, OpenAI’s Sora, while impressive, is only available to a select test audience, with the company indicating that its top features will be exclusive to paying customers, similar to its ChatGPT model.
On the other hand, the Dream Machine is currently accessible to anyone interested in exploring its capabilities. Looking to the future, Luma AI plans to release various APIs and plugins that will allow integration with creative software tools, including Adobe.
Featured Image: Luma Labs / Canva
what-is-luma-ais-dream-machine-why-fans-are-flocking-to-video-generator
