BEGIN:VCALENDAR VERSION:2.0 PRODID:Linklings LLC BEGIN:VTIMEZONE TZID:Asia/Seoul X-LIC-LOCATION:Asia/Seoul BEGIN:STANDARD TZOFFSETFROM:+0900 TZOFFSETTO:+0900 TZNAME:KST DTSTART:18871231T000000 DTSTART:19881009T020000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT DTSTAMP:20230103T035307Z LOCATION:Auditorium\, Level 5\, West Wing DTSTART;TZID=Asia/Seoul:20221206T100000 DTEND;TZID=Asia/Seoul:20221206T120000 UID:siggraphasia_SIGGRAPH Asia 2022_sess153_papers_302@linklings.com SUMMARY:UniColor: A Unified Framework for Multi-Modal Colorization with Tr ansformer DESCRIPTION:Technical Papers\n\nUniColor: A Unified Framework for Multi-Mo dal Colorization with Transformer\n\nHuang, Zhao, Liao\n\nWe propose the f irst unified framework UniColor to support colorization in multiple modali ties, including both unconditional and conditional ones, such as stroke, e xemplar, text, and even a mix of them. Rather than learning a separate mod el for each type of condition, we introduce a two-stage colorization frame work for incorporating various conditions into a single model. In the firs t stage, multi-modal conditions are converted into a common representation of hint points. Particularly, we propose a novel CLIP-based method to con vert the text to hint points. In the second stage, we propose a Transforme r-based network composed of Chroma-VQGAN and Hybrid-Transformer to generat e diverse and high-quality colorization results conditioned on hint points . Both qualitative and quantitative comparisons demonstrate that our metho d outperforms state-of-the-art methods in every control modality and furth er enables multi-modal colorization that was not feasible before. Moreover , we design an interactive interface showing the effectiveness of our unif ied framework in practical usage, including automatic colorization, hybrid -control colorization, local recolorization, and iterative color editing. Our code and models are available at https://luckyhzt.github.io/unicolor.\ n\nRegistration Category: FULL ACCESS, EXPERIENCE PLUS ACCESS, EXPERIENCE ACCESS, TRADE EXHIBITOR\n\nLanguage: ENGLISH\n\nFormat: IN-PERSON URL:https://sa2022.siggraph.org/en/full-program/?id=papers_302&sess=sess15 3 END:VEVENT END:VCALENDAR