Sora

Sora is an AI model from OpenAI that creates videos from text using a diffusion process, starting with noise and refining it. It employs a transformer architecture and handles videos as spacetime patches. Sora can extend existing footage, animate images, and blend videos. It has shown an ability to simulate elements of the real world, but has some shortcomings in depicting accurate physics and cause-and-effect relationships. The model is trained on large datasets of captioned videos and uses a "re-captioning" technique to enrich training data. Sora is not yet available to the public.