research-article

Comicolorization: semi-automatic manga colorization

Authors:

Chie Furusawa,

Kazuyuki Hiroshiba,

Keisuke Ogaki,

Yuri OdagiriAuthors Info & Claims

SA '17: SIGGRAPH Asia 2017 Technical Briefs

Article No.: 12, Pages 1 - 4

https://doi.org/10.1145/3145749.3149430

Published: 27 November 2017 Publication History

Get Access

Abstract

We developed Comicolorization, a semi-automatic colorization system for manga images. Given a monochrome manga and reference images as inputs, our system generates a plausible color version of the manga. This is the first work to address the colorization of an entire manga title (a set of manga pages). Our method colorizes a whole page (not a single panel) semi-automatically, with the same color for the same character across multiple panels. To colorize the target character by the color from the reference image, we extract a color feature from the reference and feed it to the colorization network to help the colorization. Our approach employs adversarial loss to encourage the effect of the color features. Optionally, our tool allows users to revise the colorization result interactively. By feeding the color features to our deep colorization network, we accomplish colorization of the entire manga using the desired colors for each panel.

Supplementary Material

ZIP File (a12-furusawa.zip)

Supplemental material.

Download
1.52 MB

MP4 File (a12-furusawa.mp4)

Download
94.44 MB

References

[1]

Zezhou Cheng, Qingxiong Yang, and Bin Sheng. 2015. Deep Colorization. In IEEE International Conference on Computer Vision (ICCV).

Digital Library

Google Scholar

[2]

Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu amd David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial networks. In Neural Information Processing Systems (NIPS).

Digital Library

Google Scholar

[3]

Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. 2016. Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. In ACM Transactions on Graphics (TOG), Vol. 35. 110:1--110:11.

Digital Library

Google Scholar

[4]

Daisuke Ishii, Kei Kawamura, and Hiroshi Watanabe. 2009. A Study on Control Parameters of Frame Decomposition Method for Comic Images. In Institute of Electronics, Information and Communication Engineers Tech. Rep. (IEICE), Vol. 109. 187--192.

Google Scholar

[5]

Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In IEEE Computer Vision and Pattern Recognition (CVPR).

Google Scholar

[6]

Yusuke Matsui, Kota Ito, Yuji Aramaki, Toshihiko Yamasaki, and Kiyoharu Aizawa. 2016. Sketch-based Manga Retrieval using Manga109 Dataset. In Multimedia Tools and Applications (MTAP). Springer.

Digital Library

Google Scholar

[7]

Nobuyuki Otsu. 1979. A Threshold Selection Method from Gray-Level Histograms. In IEEE Transactions on Systems, Man, and Cybernetics (TSMC), Vol. 9. 62--66.

Crossref

Google Scholar

[8]

Alec Radford, Luke Metz, and Soumith Chintala. 2017. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. In International Conference on Learning Representations (ICLR).

Google Scholar

[9]

Patsorn Sangkloy, Jingwan Lu, Chen Fang, Fisher Yu, and James Hays. 2017. Scribbler: Controlling Deep Image Synthesis with Sketch and Color. In IEEE Computer Vision and Pattern Recognition (CVPR).

Google Scholar

[10]

Richard Zhang, Phillip Isola, and Alexei A. Efros. 2016. Colorful Image Colorization. In European Conference on Computer Vision (ECCV).

Google Scholar

[11]

Richard Zhang, Jun-Yan Zhu, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, and Alexei A. Efros. 2017. Real-Time User-Guided Image Colorization with Learned Deep Priors. In ACM Transactions on Graphics (TOG), Vol. 9. 119:1--119:11.

Digital Library

Google Scholar

Cited By

View all

Golyadkin MSaraev SMakarov I(2025)Advancing Sequential Manga Colorization for AR Through Data SynthesisIEEE Access10.1109/ACCESS.2025.352688213(7526-7537)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3526882
Lee SPark E(2024)AutoCaCoNet: Automatic Cartoon Colorization Network Using Self-Attention GAN, Segmentation, and Color Correction2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW60836.2024.00050(403-411)Online publication date: 1-Jan-2024
https://doi.org/10.1109/WACVW60836.2024.00050
Xiao WXu CMai JXu XLi YLi CLiu XHe S(2024)Appearance-Preserved Portrait-to-Anime Translation via Proxy-Guided Domain AdaptationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322870730:7(3104-3120)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3228707
Show More Cited By

Index Terms

Comicolorization: semi-automatic manga colorization
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Image processing
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks

Recommendations

Reference-based manga colorization by graph correspondence using quadratic programming
SA '14: SIGGRAPH Asia 2014 Technical Briefs

Manga (Japanese comics) are popular all over the world. However, most existing manga are monochrome. If such monochrome manga can be colorized, readers can enjoy the richer representations. In this paper, we propose a semiautomatic colorization method ...
Manga colorization

This paper proposes a novel colorization technique that propagates color over regions exhibiting pattern-continuity as well as intensity-continuity. The proposed method works effectively on colorizing black-and-white manga which contains intensive ...
Manga colorization
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

This paper proposes a novel colorization technique that propagates color over regions exhibiting pattern-continuity as well as intensity-continuity. The proposed method works effectively on colorizing black-and-white manga which contains intensive ...

Comments

Information & Contributors

Information

Published In

SA '17: SIGGRAPH Asia 2017 Technical Briefs

November 2017

108 pages

ISBN:9781450354066

DOI:10.1145/3145749

Conference Chairs:
Diego Gutierrez
University of Zaragoza, Spain
,
Hui Huang
Shenzhen University, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SA '17

Sponsor:

SIGGRAPH

SA '17: SIGGRAPH Asia 2017

November 27 - 30, 2017

Bangkok, Thailand

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

76
Total Citations
View Citations
643
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)4

Reflects downloads up to 21 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Golyadkin MSaraev SMakarov I(2025)Advancing Sequential Manga Colorization for AR Through Data SynthesisIEEE Access10.1109/ACCESS.2025.352688213(7526-7537)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3526882
Lee SPark E(2024)AutoCaCoNet: Automatic Cartoon Colorization Network Using Self-Attention GAN, Segmentation, and Color Correction2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW60836.2024.00050(403-411)Online publication date: 1-Jan-2024
https://doi.org/10.1109/WACVW60836.2024.00050
Xiao WXu CMai JXu XLi YLi CLiu XHe S(2024)Appearance-Preserved Portrait-to-Anime Translation via Proxy-Guided Domain AdaptationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322870730:7(3104-3120)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3228707
Golyadkin MSaraev SMakarov I(2024)Benchmarking and Data Synthesis for Colorization of Manga Sequential Pages for Augmented Reality2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00174(608-611)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00174
Miyauchi KOrihara RSei YTahara YOhsuga A(2024)Hollowed-Out Icon Colorization with Controllable Diffusion Model2024 7th International Conference on Information and Computer Technologies (ICICT)10.1109/ICICT62343.2024.00038(204-210)Online publication date: 15-Mar-2024
https://doi.org/10.1109/ICICT62343.2024.00038
Lin MShen IChin HChen RChen B(2023)Palette‐Based and Harmony‐Guided Colorization for Vector IconsComputer Graphics Forum10.1111/cgf.1495042:7Online publication date: 30-Oct-2023
https://doi.org/10.1111/cgf.14950
Li ZZhao NWu ZDai YWang JJing YHe S(2023)Reference‐based Screentone Transfer via Pattern Correspondence and RegularizationComputer Graphics Forum10.1111/cgf.1480042:6Online publication date: 17-Apr-2023
https://doi.org/10.1111/cgf.14800
Yan DIto RMoriai RSaito S(2023)Two‐Step Training: Adjustable Sketch Colourization via Reference Image and Text TagComputer Graphics Forum10.1111/cgf.1479142:6Online publication date: 5-Apr-2023
https://doi.org/10.1111/cgf.14791
Shi MZhang JChen SGao LLai YZhang F(2023)Reference-Based Deep Line Art Video ColorizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314600029:6(2965-2979)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3146000
Cao YTian HMok P(2023)Attention-Aware Anime Line Drawing Colorization2023 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME55011.2023.00282(1637-1642)Online publication date: Jul-2023
https://doi.org/10.1109/ICME55011.2023.00282
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Reference-based manga colorization by graph correspondence using quadratic programming

Manga colorization

Manga colorization