Stability AI introduces transformation of 2D photos into 3D scenes

Stability AI has announced the release of an innovative AI model called Stable Virtual Camera, capable of transforming two-dimensional images into immersive video materials with realistic depth and perspective. This technological achievement marks significant progress in the field of generative artificial intelligence and virtual cinematography.

Stable Virtual Camera represents a substantial development of the virtual camera concept, traditionally used in digital filmmaking and 3D animation. The integration of generative AI into this toolkit opens unprecedented possibilities for control and customization of created content.

The technical capabilities of the new model are impressive:

  • Generation of “new angles” of a scene based on one to 32 source images.
  • Creation of videos with dynamic camera movement trajectories.
  • Support for preset shooting modes: “Spiral”, “Dolly Zoom”, “Move”, and “Pan”.
  • Ability to work with various formats: square (1:1), portrait (9:16), and landscape (16:9).
  • Capability to generate video sequences up to 1000 frames long.

Despite the impressive capabilities, Stability warns about potential limitations of the current research version. The model may show quality degradation when working with images containing people, animals, or “dynamic textures” like water. “Highly ambitious scenes, complex camera trajectories crossing objects or surfaces, and irregularly shaped objects can cause a flickering effect, especially when target angles differ significantly from the source images,” the company notes in its blog.

This technological breakthrough comes during a difficult period for Stability AI. The company, known for its popular image generation model Stable Diffusion, attracted new investments last year from significant figures such as Eric Schmidt and Napster founder Sean Parker, who are seeking to restore the business. Earlier it was reported that Stability co-founder and former CEO Emad Mostaque led the company to financial problems, resulting in employee layoffs, the failure of a partnership with Canva, and growing investor concerns about the company’s prospects.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Stability AI introduces transformation of 2D photos into 3D scenes

Stability AI has announced the release of an innovative AI model called Stable Virtual Camera, capable of transforming two-dimensional images into immersive video materials with realistic depth and perspective. This technological achievement marks significant progress in the field of generative artificial intelligence and virtual cinematography.

NVIDIA opens access to cuOpt AI decision-making system

NVIDIA has announced a strategic decision to make cuOpt, its advanced AI-based optimization engine, an open-source project. This unprecedented move will provide developers with free access to real-time optimization technologies capable of transforming entire industries.

Google releases TxGemma AI models for drug development

Google has announced the development of an innovative set of "open" AI models called TxGemma, designed to revolutionize the drug development process. The announcement was made on Tuesday during a healthcare-focused event in New York.

Adobe introduces 10 AI agents

Adobe has announced a major expansion of its Adobe Experience platform, introducing ten specialized AI agents and an orchestration tool aimed at revolutionizing business-customer interactions. Simultaneously, the company presented Brand Concierge — an innovative solution for website personalization based on previous customer interactions with the brand.

Elon Musk's xAI acquires AI video generator Hotshot

xAI, founded by Elon Musk, has announced the acquisition of Hotshot — a promising startup specializing in the development of artificial intelligence video generation tools comparable to OpenAI's Sora technology.