Apple's Latest AI Tool Can Animate an Image Based on Your Description

Apple has made another addition to its growing AI repertoire with the creation of a tool that leverages large language models (LLMs) to animate static images based on a user's text prompts.

apple AI research dall e

MacRumors image made with DALL·E

Apple describes the innovation in a new research paper titled "Keyframer: Empowering Animation Design Using Large Language Models."

"While one-shot prompting interfaces are common in commercial text-to-image systems like Dall·E and Midjourney, we argue that animations require a more complex set of user considerations, such as timing and coordination, that are difficult to fully specify in a single prompt—thus, alternative approaches that enable users to iteratively construct and refine generated designs may be needed especially for animations.

"We combined emerging design principles for language-based prompting of design artifacts with code-generation capabilities of LLMs to build a new AI-powered animation tool called Keyframer. With Keyframer, users can create animated illustrations from static 2D images via natural language prompting. Using GPT-4 3, Keyframer generates CSS animation code to animate an input Scalable Vector Graphic (SVG)."

To create an animation, the user uploads an SVG image – of a space rocket, say – then types in a prompt like "generate three designs where the sky fades into different colors and the stars twinkle." Keyframer then generates CSS code for the animation, and the user can then refine it by editing the code directly or by entering additional text prompts.

"Keyframer enabled users to iteratively refine their designs through sequential prompting, rather than having to consider their entire design upfront," explain the authors. "Through this work, we hope to inspire future animation design tools that combine the powerful generative capabilities of LLMs to expedite design prototyping with dynamic editors that enable creators to maintain creative control."

According to the paper, the research was informed by interviews with professional animation designers and engineers. "I think this was much faster than a lot of things I've done," said one of the study participants quoted in the paper. "I think doing something like this before would have just taken hours to do."

ai model animates images 1
The innovation is just the latest in a series of AI breakthroughs by Apple. Last week, Apple researchers released an AI model that harnesses the power of multimodal LLMs to perform pixel-level edits on images.

In late December, Apple also revealed that it had made strides in deploying LLMs on iPhones and other Apple devices with limited memory by inventing an innovative flash memory utilization technique.

Both The Information and analyst Jeff Pu have said that Apple will have some kind of generative AI feature available on the ‌iPhone‌ and iPad later in the year, when iOS 18 is released. The next version of Apple's mobile software is said to include an enhanced version of Siri with ChatGPT-like generative AI functionality, and has the potential to be the "biggest" update in the ‌iPhone‌'s history, according to Bloomberg reporter Mark Gurman.

(Via VentureBeat.)

Popular Stories

AirPods Pro 3 Mock Feature

AirPods Pro 3 Just Months Away – Here's What We Know

Friday April 18, 2025 5:16 am PDT by
Despite being more than two years old, Apple's AirPods Pro 2 still dominate the premium wireless‑earbud space, thanks to a potent mix of top‑tier audio, class‑leading noise cancellation, and Apple's habit of delivering major new features through software updates. With AirPods Pro 3 widely expected to arrive in 2025, prospective buyers now face a familiar dilemma: snap up the proven...
iphone 16 pro models 1

17 Reasons to Wait for the iPhone 17

Thursday April 17, 2025 4:12 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we often get rumored features months ahead of launch. The iPhone 17 series is no different, and we already have a good idea of what to expect from Apple's 2025 smartphone lineup. If you skipped the iPhone...
Beyond iPhone 13 Better Triad

Apple's 20th Anniversary iPhone May Finally Go All Screen

Tuesday April 15, 2025 6:31 am PDT by
Apple is preparing a "bold" new iPhone Pro model for the iPhone's 20th anniversary in 2027, according to Bloomberg's Mark Gurman. As part of what's being described as a "major shake-up," Apple is said to be developing a design that makes more extensive use of glass – and this could point directly to the display itself. Here's the case for Apple releasing a truly all-screen iPhone with no...
maxresdefault

iPhone 17 Pro Launching Later This Year With These 12 New Features

Sunday April 13, 2025 7:52 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Subscribe to the MacRumors YouTube channel for more videos. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and ...
CarPlay Hero

Apple Releases Wireless CarPlay Fix

Wednesday April 16, 2025 11:28 am PDT by
If you have been experiencing issues with wireless CarPlay in your vehicle lately, it was likely due to a software bug that has now been fixed. Apple released iOS 18.4.1 today, and the update's release notes say it "addresses a rare issue that prevents wireless CarPlay connection in certain vehicles." If wireless CarPlay was acting up for you, updating your iPhone to iOS 18.4.1 should...
top stories 2025 04 19

Top Stories: iPhone 17 Pro Rumors, CarPlay Bug Fix, and More

Saturday April 19, 2025 6:00 am PDT by
This week saw rumor updates on the iPhone 17 Pro and next-generation Vision Pro, while a minor iOS 18.4.1 update delivered not just security fixes but also a fix for some CarPlay issues. We also looked ahead at what else is in Apple's pipeline for the rest of 2025 and even the 20th-anniversary iPhone coming in 2027, so read on below for all the details on these stories and more! iPhone 17 ...
iOS 19 Roundup Feature

iOS 19 Will Add These New Features to Your iPhone

Tuesday April 15, 2025 7:37 am PDT by
The first iOS 19 beta is less than two months away, and there are already a handful of new features that are expected with the update. Apple should release the first iOS 19 beta to developers immediately following the WWDC 2025 keynote, which is scheduled for Monday, June 9. Following beta testing, the update should be released to the general public in September. Below, we recap the key...

Top Rated Comments

jayryco Avatar
16 months ago
I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Score: 19 Votes (Like | Disagree)
purplerainpurplerain Avatar
16 months ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Incorrect and badly ignorant. Don’t listen to stupid Wall Street AI bros.

Companies employ people to use the tools. They can’t just have some executive sitting there asking AI. The executives and managers have other things to do.

Companies require their creative departments to use the tools.

The tools like this are very imperfect and unpredictable. They always will be. You cannot replace all traditional workflows with ‘talk to AI’. That can only happen if you want everything to be really sht.

The output of AI tools is combined with other materials that are all made normally. The creative professionals do this.
Score: 16 Votes (Like | Disagree)
swiftapplefan Avatar
16 months ago
That’s actually really cool, can’t wait to see how they’ll implement it in their products.
Score: 10 Votes (Like | Disagree)
victorvictoria Avatar
16 months ago
I have seen the future, and am happy I won't be around to witness it.
Score: 8 Votes (Like | Disagree)
Wanted797 Avatar
16 months ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
AI won’t take our jobs. People who know how to use AI will.
Score: 7 Votes (Like | Disagree)
HeinoM Avatar
16 months ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
I had the exact same thought, only I fear it may happen even sooner than that. Major publications are already laying off writers in droves as they transition to AI generated content. Creative careers of all types are going to be devastated.
Score: 6 Votes (Like | Disagree)