Image to video v3

Action ID: image_to_video_v3

Description

Image to video v3

Connection

Name
Description
Required
Category

PixelML Connection

The PixelML connection to call PixelML API.

True

pixelml

Input Parameters

Name
Type
Required
Default
Description

prompt

string

-

Text description guiding the video generation. Max length: 904 characters

image

string

-

URL of the starting image that will be animated into video

negative_prompt

string or null

-

null

Description of elements to avoid in the video. Max length: 904 characters

steps

integer

-

20

Number of generation steps for quality. Range: 1 to 50

guidance_scale

integer

-

3

How closely to follow the prompt. Range: 1 to 10

frame_rate

integer

-

8

Video frames per second. Range: 1 to 30

View JSON Schema
{
  "description": "Image to video node input.",
  "properties": {
    "prompt": {
      "description": "Prompt",
      "maxLength": 904,
      "title": "Prompt",
      "type": "string"
    },
    "image": {
      "description": "Start image of the video.",
      "title": "Start image",
      "type": "string"
    },
    "negative_prompt": {
      "anyOf": [
        {
          "maxLength": 904,
          "type": "string"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "description": "Negative prompt",
      "title": "Negative prompt"
    },
    "steps": {
      "default": 20,
      "description": "Steps",
      "maximum": 50,
      "minimum": 1,
      "title": "Steps",
      "type": "integer"
    },
    "guidance_scale": {
      "default": 3,
      "description": "Guidance scale",
      "maximum": 10,
      "minimum": 1,
      "title": "Guidance scale",
      "type": "integer"
    },
    "frame_rate": {
      "default": 8,
      "description": "Frame rate",
      "maximum": 30,
      "minimum": 1,
      "title": "Frame rate",
      "type": "integer"
    }
  },
  "required": [
    "prompt",
    "image"
  ],
  "title": "ImageToVideoV3NodeInput",
  "type": "object"
}

Output Parameters

Name
Type
Description

video

string

URL to the generated video file

View JSON Schema
{
  "description": "Image to video node output.",
  "properties": {
    "video": {
      "description": "Rendered video",
      "title": "Rendered video",
      "type": "string"
    }
  },
  "required": [
    "video"
  ],
  "title": "ImageToVideoV3NodeOutput",
  "type": "object"
}

How It Works

This node uses AI-powered video generation technology through the PixelML API to transform a static image into a dynamic video. It takes your starting image and prompt describing the desired motion or animation, then generates frames that smoothly animate the image according to your description. The generation process is controlled by parameters like steps for quality, guidance_scale for prompt adherence, and frame_rate for smoothness.

Usage Examples

Example 1: Animate Product Shot

Input:

prompt: "Slowly rotating 360 degrees, smooth professional product showcase"
image: "https://example.com/images/sneaker.jpg"
negative_prompt: "blurry, distorted, low quality"
steps: 30
guidance_scale: 5
frame_rate: 24

Output:

video: "https://storage.pixelml.com/videos/product_rotation_12345.mp4"

Example 2: Create Nature Scene Animation

Input:

prompt: "Clouds moving slowly across the sky, gentle breeze rustling leaves"
image: "https://example.com/images/mountain_landscape.jpg"
negative_prompt: "jerky motion, unnatural movement, artifacts"
steps: 25
guidance_scale: 4
frame_rate: 15

Output:

video: "https://storage.pixelml.com/videos/nature_scene_67890.mp4"

Example 3: Portrait Animation

Input:

prompt: "Person smiling and looking at camera, subtle head movement"
image: "https://example.com/images/portrait.jpg"
negative_prompt: "distorted face, unnatural expressions, glitches"
steps: 40
guidance_scale: 6
frame_rate: 30

Output:

video: "https://storage.pixelml.com/videos/portrait_animation_24680.mp4"

Common Use Cases

  • Product Marketing Videos: Transform static product images into engaging 360-degree rotation videos for e-commerce

  • Social Media Content: Create eye-catching animated posts from still images for Instagram, TikTok, or Facebook

  • Real Estate Tours: Animate property photos to create immersive virtual walkthroughs

  • Digital Art Animation: Bring artwork and illustrations to life with subtle movements and effects

  • Profile Pictures: Create animated avatars or profile pictures from static headshots

  • Presentation Enhancement: Convert slide images into dynamic video segments for more engaging presentations

  • Advertisement Creation: Generate video ads from product photography without expensive video shoots

Error Handling

Error Type
Cause
Solution

Invalid Image URL

Image URL is inaccessible or malformed

Ensure the image URL is publicly accessible and properly formatted

Image Format Not Supported

Image is in an unsupported format

Use common image formats like JPG, PNG, or WebP

Prompt Too Long

Prompt exceeds 904 character limit

Shorten the prompt while maintaining key description elements

Invalid Parameter Range

steps, guidance_scale, or frame_rate outside valid range

Ensure all numeric parameters are within their specified ranges

Generation Failed

AI model encountered an error during processing

Try with different prompt wording or reduce complexity

Connection Timeout

PixelML API connection or generation took too long

Retry the request or check PixelML service status

Insufficient Resources

Generation requires more resources than available

Reduce steps or frame_rate to decrease computational requirements

Notes

  • PixelML Connection Required: This node requires a valid PixelML connection to access the image-to-video generation API.

  • Generation Time: Video generation can take several minutes depending on steps and frame_rate; higher values produce better quality but take longer.

  • Image Quality: Higher resolution input images generally produce better video output; ensure your starting image is clear and well-composed.

  • Prompt Specificity: Detailed prompts describing the desired motion lead to better results (e.g., "slowly rotating clockwise" vs. "rotating").

  • Negative Prompts: Use negative prompts to avoid unwanted artifacts like "blurry", "distorted", "jerky motion", or "low quality".

  • Steps Parameter: Higher steps (30-50) produce smoother, higher-quality videos but increase generation time significantly.

  • Guidance Scale: Lower values (1-3) allow more creative interpretation; higher values (7-10) stick more closely to the prompt.

  • Frame Rate: Standard frame rates are 24fps (cinematic), 30fps (smooth), or 8-15fps (stylized); higher frame rates increase file size.

Last updated

Was this helpful?