Single Image Animation

Revision as of 22:14, 3 February 2021 by David (talk | contribs) (→‎Using Neural Networks)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
\( \newcommand{\P}[]{\unicode{xB6}} \newcommand{\AA}[]{\unicode{x212B}} \newcommand{\empty}[]{\emptyset} \newcommand{\O}[]{\emptyset} \newcommand{\Alpha}[]{Α} \newcommand{\Beta}[]{Β} \newcommand{\Epsilon}[]{Ε} \newcommand{\Iota}[]{Ι} \newcommand{\Kappa}[]{Κ} \newcommand{\Rho}[]{Ρ} \newcommand{\Tau}[]{Τ} \newcommand{\Zeta}[]{Ζ} \newcommand{\Mu}[]{\unicode{x039C}} \newcommand{\Chi}[]{Χ} \newcommand{\Eta}[]{\unicode{x0397}} \newcommand{\Nu}[]{\unicode{x039D}} \newcommand{\Omicron}[]{\unicode{x039F}} \DeclareMathOperator{\sgn}{sgn} \def\oiint{\mathop{\vcenter{\mathchoice{\huge\unicode{x222F}\,}{\unicode{x222F}}{\unicode{x222F}}{\unicode{x222F}}}\,}\nolimits} \def\oiiint{\mathop{\vcenter{\mathchoice{\huge\unicode{x2230}\,}{\unicode{x2230}}{\unicode{x2230}}{\unicode{x2230}}}\,}\nolimits} \)

Research on how to create animations from a single image.
Most existing work here is focused on transfering an animation from a video or collection of videos onto an image.


Fluids

Animating Fluids

Relevent People

Animating Pictures of Fluid using Video Examples

Creating Fluid Animation from a Single Image using Video Database

  • Published in Computer Graphics Forum 2011
  • Authors: Makoto Okabe, Ken Anjyo, Rikio Onai
  • https://onlinelibrary.wiley.com/doi/full/10.1111/j.1467-8659.2011.02062.x
  • https://www.youtube.com/watch?v=S5iqKa7FRy0
  • Basic Idea
    • Create database of one type of fluid (fire, smoke, water)
    • Database is composed of (average image + differences) of video patches and indexed with visual words (SIFT).
    • Given a new image of a fluid, cut it up into pieces.
    • For each piece, find a video from the database. Combine the differences from the database with the image to form an animation. Lots of small details in the paper...
    • User can draw a flow field and apply a mask. The flow field influences which video is selected from the database.

Animating pictures of water scenes using video retrieval

Using Neural Networks

  • Animating Pictures with Eulerian Motion Fields (2020)
    • https://eulerian.cs.washington.edu/
    • Authors: Aleksander Holynski, Brian Curless, Steven M. Seitz, Richard Szeliski
    • Warps deep features using a predicted motion field.
    • Uses a symmetric splatting and blending technique to fill in holes in the feature maps.

Animals

Animating Animal Motion from Still

  • Siggraph Asia 2008
  • Authors: Xuemiao Xu, Liang Wan, Xiaopei Liu, Tien-Tsin Wong, Liansheng Wang, Chi-Sing Leung
  • https://www.cse.cuhk.edu.hk/~ttwong/papers/flock/flock.html
  • Basic Idea
    • Given a photo with multiple of the same animal
    • Crop each animal to get a set of "motion snapshots"
    • Using some structural similarity measures, order the motion snapshots to create a motion cycle
    • Do consistency refinement to morph between snapshots.