Published Papers - AMANO Toshiyuki

Multispectral Direct-Global Separation of Dynamic Scenes.

Moriaki Torii, Takahiro Okabe, Toshiyuki Amano

IEEE Winter Conference on Applications of Computer Vision, WACV 2019, Waikoloa Village, HI, USA, January 7-11, 2019 ( IEEE )    1923 - 1931   2019.01  [Refereed]

DOI

Computational Phase-Modulated Eyeglasses

Yuta Itoh, Tobias Langlotz, Stefanie Zollmann, Daisuke Iwai, Kiyokawa Kiyoshi, Toshiyuki Amano

IEEE Transactions on Visualization and Computer Graphics ( Institute of Electrical and Electronics Engineers (IEEE) )  27 ( 3 ) TVCG-2019-02-0051 - 1928   2019  [Refereed]

DOI

適応的な見かけの操作による色彩インスタレーション

天野敏之

日本色彩学会学会誌   43 ( 6 )   2019  [Invited]

Appearance Manipulation Using Light-Field Projection

Toshiyuki Amano, Kouki Murakami, Yusuke Miyabayashi

IDW ’18 - The 25th International Display Workshops     PRJ7-3 - PRJ7-3   2018.12  [Invited]

Adaptive Appearance Manipulation

Toshiyuki Amano

IDW ’18 - The 25th International Display Workshops (Demo)     2018.12  [Invited]

Materiality Manipulation by Light-Field Projection from Reflectance Analysis.

Kouki Murakami, Toshiyuki Amano

International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2018, Limassol, Cyprus, November 7-9, 2018 ( Eurographics Association )    99 - 105   2018.11  [Refereed]

DOI

Display and Manipulation of Material Perception using Projection Mapping

天野敏之

日本画像学会誌 ( 一般社団法人 日本画像学会 )  57 ( 2 ) 214‐224(J‐STAGE) - 224   2018.05  [Invited]

　View Summary

<p>The projection technique that realizes projection mapping used in many events has been studied for a long time as a projection display in the field of spatial augmented reality. As this projection display technique, we proposed two techniques;one manipulats the appearance of the real worlds and other displays viewpoint dependent appearance using a light field projection. In this paper, we introduce our successive manipulation technique of translucency and glossiness based on cognitive science with a co-axial projector-camera system. In addition, we introduce the material perception projection technology we have worked on, such as a structural color display using projector arrays and material perception editing using multiple projector-camera systems.</p>

DOI

プロジェクションマッピング技術とその応用 5章 モデリングを必要としない即興的なプロジェクションマッピング

天野敏之

映像情報メディア学会誌   72 ( 3 ) 326‐331   2018.05  [Invited]

Gaze Navigation in The Real World by Changing Visual Appearance of Objects Using Projector-Camera System

Junpei Miyamoto, Hideki Koike, Toshiyuki Amano

24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018) ( ASSOC COMPUTING MACHINERY )    14:1-14:5   2018  [Refereed]

　View Summary

This paper proposes a method for gaze navigation in the real world by projecting an image onto a real object and changing its appearance. In the proposed method, a camera captures an image of objects in the real world. Next all the pixels in the image but those in a specified region are slightly shitted to left and right. Then the obtained image is projected onto the original objects. As a result, the objects not in the specified region looks blurred. We conducted user experiments and showed that the users' gaze were navigated to the specified region.

DOI

Separating the Direct and Global Components of a Single Image.

Art Subpa-Asa, Ying Fu, Yinqiang Zheng, Toshiyuki Amano, Imari Sato

JIP   26   755 - 767   2018  [Refereed]

DOI

Light Projection-Induced Illusion for Controlling Object Color.

Ryo Akiyama, Goshiro Yamamoto, Toshiyuki Amano, Takafumi Taketomi, Alexander Plopski, Christian Sandor, Hirokazu Kato

2018 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018, Tuebingen/Reutlingen, Germany, 18-22 March 2018 ( IEEE Computer Society )    499 - 500   2018  [Refereed]

DOI

Viewpoint-Dependent Appearance-Manipulation with Multiple Projector-Camera Systems.

Toshiyuki Amano, Shun Ushida, Yusuke Miyabayashi

International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017, Adelaide, Australia, November 22 - 24, 2017. ( Eurographics Association )    101 - 107   2017.11  [Refereed]

DOI

知覚量に基づく光投影による色制御実現に向けた色知覚モデルの検討

秋山諒, 山本豪志朗, 天野敏之, 武富貴史, Alexander Plopski, Christian Sandor, 加藤博一

日本バーチャルリアリティ学会複合現実感研究会     MR2017-16   2017.10

Adaptive Appearance Manipulation for the Installation Art

Toshiyuki Amano

JSAP-OSA Joint Symposia 2017     p. 6a-A409-5 - p. 6a-A409-5   2017.09  [Invited]

3-2 Manipulation of Material Perception by the Projection Mapping and Novel Representation of Gold and Silver Leaf art Beauty

Amano Toshiyuki, Rakusho Hiroto

The Journal of The Institute of Image Information and Television Engineers ( 一般社団法人 映像情報メディア学会 )  71 ( 1 ) 30 - 35   2017.01  [Invited]

Separation of Reflective and Fluorescent Components using Projector-Camera System

島名功, 天野敏之

日本バーチャルリアリティ学会論文誌(Web) ( THE VIRTUAL REALITY SOCIETY OF JAPAN )  22 ( 3 ) 421‐429(J‐STAGE) - 429   2017  [Refereed]

　View Summary

<p>Fluorescence can be a beneficial property not only for the scene analysis, but also for a spatial augmented reality (SAR). In the field of SAR, the projector camera system has been well studied and its radiometric model can be described by a color mixing matrix. For the measurement of the color mixing matrix, special equipments other than a projector and a camera are not required. The fluorescent components are not separated by the color mixing matrix, but it already has a capability of handling light emission of fluorescent. In this paper, we propose the RKS model that expresses fluorescent components as well as reflectance components from the approximation of the Donaldson matrix. In addition, we propose a decomposition method of the color mixing matrix. Experimental results show the decomposition of color mixing matrices obtained from color construction papers and non-fluorescent Kent papers with several fluorescent paintings. Then, we demonstrate separation of reflectance and fluorescent components of a scene. We also demonstrate effectiveness of radiometric compensation that considers fluorescent components.</p>

DOI

Monocular Focus Estimation Method for a Freely-Orienting Eye using Purkinje-Sanson Images

Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, Toshiyuki Amano, Maki Sugimoto

2017 IEEE VIRTUAL REALITY (VR) ( IEEE COMPUTER SOC )    213 - 214   2017  [Refereed]

　View Summary

We present a method for focal distance estimation of a freelyorienting eye using Purkinje-Sanson (PS) images, which are reflections of light on the inner structures of the eye. Using an infrared camera with a rigidly-fixed LED, our method creates an estimation model based on 3D gaze and the distance between reflections in the PS images that occur on the corneal surface and anterior surface of the eye lens. The distance between these two reflections changes with focus, so we associate that information to the focal distance on a user. Unlike conventional methods that mainly relies on 2D pupil size which is sensitive to scene lighting and the fourth PS image, our method detects the third PS image which is more representative of accommodation. Our feasibility study on a single user with a focal range from 15-45 cm shows that our method achieves mean and median absolute errors of 3.15 and 1.93 cm for a 10-degree viewing angle. The study shows that our method is also tolerant against environment lighting changes.

DOI

3D Single/Multiple Ground Planes Detection with Camera Angle Estimation

LANG Yankun, WU Haiyuan, AMANO Toshiyuki, CHEN Qian

IIEEJ transactions on image electronics and visual computing ( The Institute of Image Electronics Engineers of Japan )  5 ( 1 ) 42 - 51   2017  [Refereed]

Direct and global component separation from a single image using basis representation

Art Subpa-Asa, Ying Fu, Yinqiang Zheng, Toshiyuki Amano, Imari Sato

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) ( Springer Verlag )  10113   99 - 114   2017  [Refereed]

　View Summary

Previous research showed that the separation of direct and global components could be done with a single image by assuming neighboring scene points have similar direct and global components, but it normally leads to loss of spatial resolution of the results. To tackle such problem, we present a novel approach for separating direct and global components of a scene in full spatial resolution from a single captured image, which employs linear basis representation to approximate direct and global components. Due to the basis dependency of these two components, high frequency light pattern is utilized to modulate the frequency of direct components, which can effectively improve stability of linear model between direct and global components. The effectiveness of our approach is demonstrated on both simulated and real images captured by a standard off-the-shelf camera and a projector mounted in a coaxial system. Our results show better visual quality and less error compared with those obtained by the conventional single-shot approach on both still and moving objects.

DOI

Direct and global component separation from a single image using basis representation

Art Subpa-Asa, Ying Fu, Yinqiang Zheng, Toshiyuki Amano, Imari Sato

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) ( Springer Verlag )  10113   99 - 114   2017  [Refereed]

　View Summary

Previous research showed that the separation of direct and global components could be done with a single image by assuming neighboring scene points have similar direct and global components, but it normally leads to loss of spatial resolution of the results. To tackle such problem, we present a novel approach for separating direct and global components of a scene in full spatial resolution from a single captured image, which employs linear basis representation to approximate direct and global components. Due to the basis dependency of these two components, high frequency light pattern is utilized to modulate the frequency of direct components, which can effectively improve stability of linear model between direct and global components. The effectiveness of our approach is demonstrated on both simulated and real images captured by a standard off-the-shelf camera and a projector mounted in a coaxial system. Our results show better visual quality and less error compared with those obtained by the conventional single-shot approach on both still and moving objects.

DOI