Luma AI is a tool that lets you create videos from simple text prompts or photos. Just describe what you want, set a few options, and Luma AI generates it for you.
1. Credentials:
- Luma node has no need for credentials, however you have an option to use your unique key or token to access Luma AI’s tools and services.
2. Operation Type:
-
Generation: This tells Luma AI to create a new video based on your instructions.
-
get_generation: This means retrieving or getting a previously created video from Luma AI.
3. Prompt:
- This is where you give specific instructions for what you want Luma AI to create. Think of it as describing the image, object, or scene you want.
4. Aspect Ratio:
- The aspect ratio controls the shape of the output. For example, an aspect ratio of 16:9 gives a wider view, while 1:1 makes a square image. You set this depending on your needs.
5. Loop:
- If you want the generated content to repeat or loop (like an animation or a 3D scene that cycles smoothly), you can set this option.
6. Keyframes:
Keyframes help control changes over time in animations or 3D sequences.
-
Type:
- Image: Use a specific image as a keyframe, meaning Luma AI will use that image at a certain point in the animation.
- Generation: Use a previously generated output as a keyframe to guide changes in the animation.
-
URL: This is the link to the image or generation you want to use as a keyframe.
How to use on Scade
Generating a video from a prompt:
-
Create a Text Input: In the Start node, add a text input field for the prompt and connect it to the prompt field of the Luma node.
-
Final Output: Add a file input field in the end node to save the final output.
-
Start the flow by pressing “Start Flow” button and enjoy the result.
Generating a video from image and extend video length. (Advanced)
-
Create a Text Input: In the Start node, add a text input field for the prompt and connect it to the prompt field of the Luma node.
-
Adding Motion to an Image: To animate an image, create a file input in the Start node.
Upload your image.
In the Luma node, add a keyframe with the type set to image. Press an eye icon to show it on the node.
Add the file input field in the end node and start the flow.
-
Extending Video Length: To extend the video, add another Luma node, chose get_generation as operation type. In the Generation ID field chose input type as expression and drag {success}{id} from the left menu to the right.
Add a keyframe and change type to generation. For ID field choose expression and drag {success}{id} from the left menu to the right.
Add add another Luma node, chose generation as operation type, for a prompt change input type to expression and add {success}{prompt} from Start Node. Add a keyframe and change type to generation. For ID field choose expression and drag {success}{id} from the left menu to the right. Now you will have 9-10 seconds video as a result.
- Final Output: Add a file input field in the end node to save the final output.