Chirpy3D: Continuous Part Latents for Creative 3D Bird Generation

kamwoh, Jingyang Qiao(SII), Jia Wei Sii, JiankangDeng, Chee Seng Chan, Yi-Zhe Song, Tao Xiang, Xiatian Zhu

Chirpy3D: Continuous Part Latents for Creative 3D Bird Generation: 19 upvotes on Hugging Face Daily Papers, #9 of 13 papers on 2025-01-09. Day-by-day upvote history.

In this paper, we push the boundaries of fine-grained 3D generation into truly creative territory. Current methods either lack intricate details or simply mimic existing objects -- we enable both. By lifting 2D fine-grained understanding into 3D through multi-view diffusion and modeling part latents as continuous distributions, we unlock the ability to generate entirely new, yet plausible parts through interpolation and sampling. A self-supervised feature consistency loss further ensures stable generation of these unseen parts. The result is the first system capable of creating novel 3D objects with species-specific details that transcend existing examples. While we demonstrate our approach on birds, the underlying framework extends beyond things that can chirp! Code will be released at https://github.com/kamwoh/chirpy3d.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.