Postdoctoral researcher
National Institute of Informatics (NII), Japan

: Shin'ichi Satoh Laboratory, National Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430, Japan

: matsui(at)nii.ac.jp / : Resume / : Google scholar / : Github / : kaggle

I am a postdoctoral researcher at National Institute of Informatics (NII) in Japan, working with Prof. Shin'ichi Satoh. I received my Ph.D. from the University of Tokyo in 2016 under the supervision of Prof. Kiyoharu Aizawa. My research is in the fields of computer vision and multimedia processing, with particular interests in large-scale indexing.

News

Projects


Reconfigurable Inverted Index
Yusuke Matsui, Ryota Hinami, and Shin'ichi Satoh
ACMMM 2018 (oral).
[Paper] [arXiv] [Project] [Code]

A Survey of Product Quantization
Yusuke Matsui, Yusuke Uchida, Hervé Jégou, Shin'ichi Satoh
ITE Transactions on Media Technology and Applications 2018.
[Paper] [Project]

PQk-means: Billion-scale Clustering for Product-quantized Codes
Yusuke Matsui* , Keisuke Ogaki* , Toshihiko Yamasaki, and Kiyoharu Aizawa
*Joint first authors.
ACMMM 2017.
[Paper] [Project] [Code] [News release]


PQTable: Nonexhaustive Fast Search for Product-Quantized Codes Using Hash Tables
Yusuke Matsui , Toshihiko Yamasaki, and Kiyoharu Aizawa
ICCV 2015, TMM 2018.
[Paper] [Project] [Code]

Writing an Image Search Engine from Scratch
Yusuke Matsui
One-hour hands-on seminar at CGVI, 2017.
[Project] [Slide (in Japanese)] [Code] [Demo]

DrawFromDrawings: 2D Drawing Assistance via Stroke Interpolation with a Sketch Database
Yusuke Matsui , Takaaki Shiratori, and Kiyoharu Aizawa
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2017.
[Paper] [Project] [Video (YouTube)]

Sketch-based Manga Retrieval using Manga109 Dataset
Yusuke Matsui , Kota Ito, Yuji Aramaki, Azuma Fujimoto, Toru Ogawa, Toshihiko Yamasaki, and Kiyoharu Aizawa
Multimedia Tools and Applications (MTAP), Springer (in press).
[Paper] [Project] [Springer]

Illustration2Vec: A Semantic Vector Representation of Illustrations
Masaki Saito and Yusuke Matsui
ACM SIGGRAPH Asia, Technical Brief, 2015.
[Paper] [Project] [Pre-trained model] [ACM]

Separation of Manga Line Drawing and Screentones
Kota Ito, Yusuke Matsui , Toshihiko Yamasaki, and Kiyoharu Aizawa
Eurographics, Short paper, 2015.
[Code]

Reference-based Manga Colorization by Graph Correspondence Using Quadratic Programming
Kazuhiro Sato, Yusuke Matsui , Toshihiko Yamasaki, and Kiyoharu Aizawa
ACM SIGGRAPH Asia, Technical Briefs, 2014.
[Paper] [ACM]

Codes

  • manga109api: Simple python API to read annotation data of Manga109
  • Rii: Fast and memory-efficient ANN with a subset-search functionality
  • nanopq: Pure python implementation of product quantization for nearest neighbor search
  • PQk-means: Fast and memory-efficient clustering
  • faiss_tips: Some useful tips for faiss
  • PQTable: Fast search algorithm for product-quantized codes via hash-tables
  • Sis: Simple image search engine

Publications

Journal

  • A Survey of Product Quantization
    Yusuke Matsui, Yusuke Uchida, Hervé Jégou, Shin'ichi Satoh
    ITE Transactions on Media Technology and Applications (ITE), 2018. [pdf]
  • PQTable: Nonexhaustive Fast Search for Product-Quantized Codes Using Hash Tables
    Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    IEEE Transactions on Multimedia (TMM), 2018. [pdf] [project]
  • Sketch-based Manga Retrieval using Manga109 Dataset
    Yusuke Matsui, Kota Ito, Yuji Aramaki, Azuma Fujimoto, Toru Ogawa, Toshihiko Yamasaki, Kiyoharu Aizawa
    Multimedia Tools and Applications (MTAP), 2017. [pdf] [project]
  • DrawFromDrawings: 2D Drawing Assistance via Stroke Interpolation with a Sketch Database
    Yusuke Matsui, Takaaki Shiratori, Kiyoharu Aizawa
    IEEE Transactions on Visualization and Computer Graphics (TVCG), 2017. [pdf] [project]

Conference

  • Revisiting Column-Wise Vector Quantization for Memory-Efficient Matrix Multiplication
    Yusuke Matsui, Shin'ichi Satoh
    IEEE International Conference on Image Processing (ICIP), 2018.
  • Reconfigurable Inverted Index
    Yusuke Matsui, Ryota Hinami, Shin'ichi Satoh
    ACM International Conference on Multimedia (ACMMM), 2018. [project]
  • Deep Image Retrieval Applied on Kotenseki Ancient Japanese Literature
    Chairath Sirirattanapol, Yusuke Matsui, Shin'ichi Satoh, Kuninori Matsuda, Kazuaki Yamamoto
    IEEE International Workshop on Machine Learning and Computing for Visual Semantic Analysis (MLCSA), 2017. [project]
  • Energy based Fast Event Retrieval in Video with Temporal Match Kernel
    Junfu Pu, Yusuke Matsui, Fan Yang, Shin'ichi Satoh
    IEEE International Conference on Image Processing (ICIP), 2017.
  • PQk-means: Billion-scale Clustering for Product-quantized Codes
    Yusuke Matsui, Keisuke Ogaki, Toshihiko Yamasaki, Kiyoharu Aizawa
    ACM International Conference on Multimedia (ACMMM), 2017. [pdf] [project]
  • Region-based Image Retrieval Revisited
    Ryota Hinami, Yusuke Matsui, Shin'ichi Satoh
    ACM International Conference on Multimedia (ACMMM), 2017. [pdf]
  • Manga109 Dataset and Creation of Metadata
    Azuma Fujimoto, Toru Ogawa, Kazuyoshi Yamamoto, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    International Workshop on Comics Analysis, Processing and Understanding (MANPU), 2016.
  • Interactive Region Segmentation for Manga
    Kota Ito, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    International Conference on Pattern Recognition (ICPR), 2016.
  • Sketch Simplification by Classifying Strokes
    Toru Ogawa, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    International Conference on Pattern Recognition (ICPR), 2016.
  • Text Detection in Manga by Combining Connected-omponent-based and Region-based Classifications
    Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    IEEE International Conference on Image Processing (ICIP), 2016.
  • PQTable: Fast Exact Asymmetric Distance Neighbor Search for Product Quantization using Hash Tables
    Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    IEEE International Conference on Computer Vision (ICCV), 2015. [pdf] [project]
  • Separation of Manga Line Drawings and Screentones
    Kota Ito, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    Eurographics, Short Paper, 2015. [project]
  • Interactive Segmentation for Manga using Lossless Thinning and Coarse Labeling
    Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    APSIPA ASC, 2015.
  • Illustration2vec: A Semantic Vector Representation of Illustrations
    Masaki Saito, Yusuke Matsui
    ACM SIGGRAPH Asia, Technical Brief, 2015. [project]
  • Challenge for Manga Processing: Sketch-based Manga Retrieval
    Yusuke Matsui
    ACM International Conference on Multimedia (ACMMM), Doctoral Symposium, 2015. [project]
  • Sketch2Manga: Sketch-based Manga Retrieval
    Yusuke Matsui, Kiyoharu Aizawa, Yushi Jing
    IEEE International Conference on Image Processing (ICIP), 2014. [pdf] [project]
  • Diffusion : Change an Ambience of the Space with a Small Amount of Ink
    Saemi Choi, Yusuke Matsui, Kiyoharu Aizawa
    ACM SIGGRAPH Asia, Poster, 2014.
  • Reference based Manga Colorization by Graph Correspondence Using Quadratic Programming
    Kazuhiro Sato, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    ACM SIGGRAPH Asia, Technical Brief, 2014. [pdf]
  • IllustStyleMap: Visualization of Illustrations based on Similarity of Drawing Style of Authors
    Daiki Matsumoto, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, Takanori Katagiri
    ACM SIGGRAPH, Poster, 2014.
  • Interactive Segmentation for Manga
    Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    ACM SIGGRAPH, Poster, 2014.
  • Interactive Manga Retargeting
    Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    ACM SIGGRAPH, Poster, 2011. [pdf]

Technical report

  • Object Detection for Comics using Manga109 Annotations
    Toru Ogawa, Atsushi Otsubo, Rei Narita, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    CoRR, 2018. [project]
  • Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations
    Yasunori Kudo, Keisuke Ogaki, Yusuke Matsui, Yuri Odagiri
    CoRR, 2018. [project]
  • PQk-means: Billion-scale Clustering for Product-quantized Codes
    Yusuke Matsui, Keisuke Ogaki, Kiyoharu Aizawa, Toshihiko Yamasaki
    CoRR, 2017. [project]
  • PQTable: Non-exhaustive Fast Search for Product-quantized Codes using Hash Tables
    Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa
    CoRR, 2017. [project]
  • Sketch-based Manga Retrieval using Manga109 Dataset
    Yusuke Matsui, Kota Ito, Yuji Aramaki, Toshihiko Yamasaki, Kiyoharu Aizawa
    CoRR, 2015. [project]

Awards

  • Funai Research Award, Funai Foundation for Information Technology, 2018. [link]
  • Student Best Paper Award, IEEE Signal Processing Society Japan, 2016.
  • Quick Report on Doctoral Theses Recommended by SIGs, IPSJ, 2016.
  • Dean's Award, Graduate School of Information Science and Technology, The University of Tokyo, 2016.
  • Best Student Paper Award, IMPS, 2015.
  • Best Interactive Presentation Award, HCG Symposium, 2014.
  • Dean's Award, Graduate School of Interdisciplinary Information Studies, The University of Tokyo, 2013.
  • Harashima Hiroshi Science Award, Association for Promotion of Electrical, Electronic and Information Engineering, 2012.
  • Dean's Award, Faculty of Engineering, The University of Tokyo, 2011.
  • 7th place, Google Landmark Recognition Challenge, 2018. [link]
  • 7th place, Google Landmark Retrieval Challenge, 2018. [link]
  • Outstanding Reviewer Award, ACM ICMR, 2018. [link]
  • ACM Student Research Competition 3rd Place, ACM SIGGRAPH, 2011.

Funding sources

  • ACT-I (Advanced), JST. (2018/4 - 2020/3)
  • Joint Research, Dwango. (2016/12 - 2017/3)
  • ACT-I, JST. (2016/12 - 2018/3)
  • Research Activity Start-up, JSPS. (2016/10 - 2018/3)
  • Research Fellowship for Young Scientists (DC1), JSPS. (2013/4 - 2016/5)

Link