Inference-based GAN Video Generation

Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement but also meaningful movement in successions of scenes. Model...

Бүрэн тодорхойлолт

-д хадгалсан:
Номзүйн дэлгэрэнгүй
Үндсэн зохиолчид: Yang, Jingbo, Bors, Adrian G.
Формат: Өгүүллэг
Хэвлэсэн: 2025
Нөхцлүүд:
Онлайн хандалт:https://arxiv.org/abs/2512.21776
http://arxiv.org/abs/2512.21776
Шошгууд: Шошго нэмэх
Шошго байхгүй, Энэхүү баримтыг шошголох эхний хүн болох!
_version_ 1879178138477395968
author Yang, Jingbo
Bors, Adrian G.
author_browse Bors, Adrian G.
Yang, Jingbo
author_facet Yang, Jingbo
Bors, Adrian G.
author_sort Yang, Jingbo
building arXiv
collection Acceso abierto
description Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement but also meaningful movement in successions of scenes. Models such as GANs, VAEs, and Diffusion Networks have been used for generating short video sequences, typically up to 16 frames. In this paper, we first propose a new type of video generator by enabling adversarial-based unconditional video generators with a variational encoder, akin to a VAE-GAN hybrid structure. The proposed model, as in other video deep learning-based processing frameworks, incorporates two processing branches, one for content and another for movement. However, existing models struggle with the temporal scaling of the generated videos. Classical approaches often result in degraded video quality when attempting to increase the generated video length, especially for significantly long sequences. To overcome this limitation, our research study extends the initially proposed VAE-GAN video generation model by employing a novel, memory-efficient approach to generate long videos composed of hundreds or thousands of frames ensuring their temporal continuity, consistency and dynamics. Our approach leverages a Markov chain framework with a recall mechanism, where each state represents a short-length VAE-GAN video generator. This setup enables the sequential connection of generated video sub-sequences, maintaining temporal dependencies and resulting in meaningful long video sequences.
first_indexed 2026-10-16T01:11:55Z
format Article
fullrecord <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2512.21776</identifier><datestamp>2026-01-01</datestamp> <dc:title>Inference-based GAN Video Generation</dc:title> <dc:creator>Yang, Jingbo</dc:creator> <dc:creator>Bors, Adrian G.</dc:creator> <dc:subject>Computer Vision and Pattern Recognition</dc:subject> <dc:subject>Artificial Intelligence</dc:subject> <dc:description>Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement but also meaningful movement in successions of scenes. Models such as GANs, VAEs, and Diffusion Networks have been used for generating short video sequences, typically up to 16 frames. In this paper, we first propose a new type of video generator by enabling adversarial-based unconditional video generators with a variational encoder, akin to a VAE-GAN hybrid structure. The proposed model, as in other video deep learning-based processing frameworks, incorporates two processing branches, one for content and another for movement. However, existing models struggle with the temporal scaling of the generated videos. Classical approaches often result in degraded video quality when attempting to increase the generated video length, especially for significantly long sequences. To overcome this limitation, our research study extends the initially proposed VAE-GAN video generation model by employing a novel, memory-efficient approach to generate long videos composed of hundreds or thousands of frames ensuring their temporal continuity, consistency and dynamics. Our approach leverages a Markov chain framework with a recall mechanism, where each state represents a short-length VAE-GAN video generator. This setup enables the sequential connection of generated video sub-sequences, maintaining temporal dependencies and resulting in meaningful long video sequences. </dc:description> <dc:date>2025-12-25</dc:date> <dc:date>2025-12-31</dc:date> <dc:type>text</dc:type> <dc:identifier>https://arxiv.org/abs/2512.21776</dc:identifier> <dc:identifier>http://arxiv.org/abs/2512.21776</dc:identifier> </oai_dc:dc>
id arxiv-2512.21776
institution arXiv
last_indexed 2026-10-16T01:11:55Z
publishDate 2025
publishDateRange 2025
publishDateSort 2025
record_format oai_dc
spelling arxiv-2512.217762026-01-01 Inference-based GAN Video Generation Yang, Jingbo Bors, Adrian G. Computer Vision and Pattern Recognition Artificial Intelligence Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement but also meaningful movement in successions of scenes. Models such as GANs, VAEs, and Diffusion Networks have been used for generating short video sequences, typically up to 16 frames. In this paper, we first propose a new type of video generator by enabling adversarial-based unconditional video generators with a variational encoder, akin to a VAE-GAN hybrid structure. The proposed model, as in other video deep learning-based processing frameworks, incorporates two processing branches, one for content and another for movement. However, existing models struggle with the temporal scaling of the generated videos. Classical approaches often result in degraded video quality when attempting to increase the generated video length, especially for significantly long sequences. To overcome this limitation, our research study extends the initially proposed VAE-GAN video generation model by employing a novel, memory-efficient approach to generate long videos composed of hundreds or thousands of frames ensuring their temporal continuity, consistency and dynamics. Our approach leverages a Markov chain framework with a recall mechanism, where each state represents a short-length VAE-GAN video generator. This setup enables the sequential connection of generated video sub-sequences, maintaining temporal dependencies and resulting in meaningful long video sequences. 2025-12-25 2025-12-31 text https://arxiv.org/abs/2512.21776 http://arxiv.org/abs/2512.21776
spellingShingle Computer Vision and Pattern Recognition
Artificial Intelligence
Yang, Jingbo
Bors, Adrian G.
Inference-based GAN Video Generation
title Inference-based GAN Video Generation
title_full Inference-based GAN Video Generation
title_fullStr Inference-based GAN Video Generation
title_full_unstemmed Inference-based GAN Video Generation
title_short Inference-based GAN Video Generation
title_sort inference based gan video generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2512.21776
http://arxiv.org/abs/2512.21776
work_keys_str_mv AT yangjingbo inferencebasedganvideogeneration
AT borsadriang inferencebasedganvideogeneration