Faculty Profiles - AMANO Toshiyuki

Published Papers - AMANO Toshiyuki

Division display81 - 100 of about 171／ All the affair displays >>

Separation of Reflective and Fluorescent Components using the Color Mixing Matrix

Isao Shimana, Toshiyuki Amano

2017 IEEE VIRTUAL REALITY (VR) ( IEEE COMPUTER SOC ) 235 - 236 2017 [Refereed]

In the field of SAR, the projector-camera system has been well studied; its radiometric model can be easily described by a color mixing matrix. Many SAR applications have proposed and created by using this model. However, this model can be used for reflectance component, but not for fluorescence component. In this paper, we propose RKS Projector-Camera response model for separating of the color mixing matrix's reflectance components and fluorescence components and describe how to decompose them.

Coded facial expression

Toshiyuki Amano

SA 2016 - SIGGRAPH ASIA 2016 Emerging Technologies ( Association for Computing Machinery, Inc ) 11:1-11:2 2016.11 [Refereed]

Gaussian Light Field: Estimation of Viewpoint-Dependent Blurfor Optical See-Through Head-Mounted Displays

Yuta Itoh, Toshiyuki Amano, Daisuke Iwai, Gudrun Klinker

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS ( IEEE COMPUTER SOC ) 22 ( 11 ) 2368 - 2376 2016.11 [Refereed]

We propose a method to calibrate viewpoint-dependent, channel-wise image blur of near-eye displays. especially of Optical See-Through Head-Mounted Displays (OST-HMDs). Imperfections in HMD optics cause channel-wise image shift and blur that degrade the image quality of the display at a user's viewpoint. If we can estimate such characteristics perfectly, we could mitigate the effect by applying correction techniques from the computational photography in computer vision as analogous to cameras. Unfortunately. directly applying existing calibration techniques of cameras to OST-HMDs is not a straightforward task. Unlike ordinary imaging systems. image blur in OST-HMDs is viewpoint-dependent. i.e. the optical characteristic of a display dynamically changes depending on the current viewpoint of the user. This constraint makes the problem challenging since we must measure image blur of an HMD, ideally. over the entire 3D eyebox in which a user can see an image. To overcome this problem. we model the viewpoint-dependent blur as a Gaussian Light Field (GLF) that stores spatial information of the display screen as a (4D) light field with depth information and the blur as point-spread functions in the form of Gaussian kernels, respectively. We first describe both our GLF model and a calibration procedure to learn a GLF for a given OST-HMD. We then apply our calibration method to two HMDs that use different optics: a cubic prism or holographic gratings. The results show that our method achieves significantly better accuracy in Point-Spread Function (PSF) estimations with an accuracy about 2 to 7 dB in Peak SNR.

Appearance Manipulation for Whole Circumference by using Projector Camera Systems

島名功, 天野敏之, 牛田俊

日本バーチャルリアリティ学会論文誌 ( 日本バーチャルリアリティ学会 ) 21 ( 2 ) 363‐371 - 371 2016.06 [Refereed]

<p>In this paper, we investigated the stability of successive omnidirectional appearance manipulation for the multiple projector camera systems without synchronization between systems. This type of system comprises several surrounding projector camera units, where each unit projects illumination independently onto a different aspect of a target object based on feedback from the projector cameras. Thus, the system can facilitate appearance manipulation from any viewpoint in the surrounding area. An advantage of this system is that it does not require information sharing or a geometrical model. However, this approach is problematic because the stability of the total control system cannot be guaranteed even if the feedback system of each projector cameras stable. Therefore, we simulated the feedback from the behavior of projector camera systems to evaluate its stability. Based on hard ware experiments, we confirmed the stability of omnidirectional appearance manipulation by using two projector camera units in an interference condition. The results showed that the object's appearance could be manipulated throughout approximately 296 degrees of the total circumference of the target object. Furthermore, we put into practice whole circumference of the object by using a plate mirror.</p>

Appearance Control in Dynamic Light Environments with a Projector-Camera System

Ryo Akiyama, Goshiro Yamamoto, Toshiyuki Amano, Takafumi Taketomi, Christian Sandor, Hirokazu Kato

2016 IEEE VR 2016 Workshop on Perceptual and Cognitive Issues in AR (PERCAR) 1 - 6 2016.03 [Refereed]

Algorithm to Compensate the Time Delay for the Appearance Control System using Camera and Projector

河野邦起, 牛田俊, 天野敏之

システム制御情報学会論文誌 29 ( 2 ) 93 - 100 2016.02 [Refereed]

The appearance control system is one of the visual feedback control systems that can manipulate the appearance of an object by using a projector-camera system. This system processes the captured image and projects the image on the object overlappingly for manipulating the appearance in real time. However, the afterimage is caused by a part of the image which is not overlapped on the object and remains in capture range of the camera. Therefore, this afterimage makes the appearance control system unstable. In this paper, we propose a new projection algorithm that can compensate the time delay for the appearance control system.We verify the effectiveness of our algorithm which can suppress the influence of the afterimage against the time delay in the visual feedback loop.

Semi-Parametric Color Reproduction Method for Optical See-Through Head-Mounted Displays

Yuta Itoh, Maksym Dzitsiuk, Toshiyuki Amano, Gudrun Klinker

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS ( IEEE COMPUTER SOC ) 21 ( 11 ) 1269 - 1278 2015.11 [Refereed]

The fundamental issues in Augmented Reality (AR) are on how to naturally mediate the reality with virtual content as seen by users. In AR applications with Optical See-Through Head-Mounted Displays (OST-HMD), the issues often raise the problem of rendering color on the OST-HMD consistently to input colors. However, due to various display constraints and eye properties, it is still a challenging task to indistinguishably reproduce the colors on OST-HMDs. An approach to solve this problem is to pre-process the input color so that a user perceives the output color on the display to be the same as the input.
We propose a color calibration method for OST-HMDs. We start from modeling the physical optics in the rendering and perception process between the HMD and the eye. We treat the color distortion as a semi-parametric model which separates the non-linear color distortion and the linear color shift. We demonstrate that calibrated images regain their original appearance on two OST-HMD setups with both synthetic and real datasets. Furthermore, we analyze the limitations of the proposed method and remaining problems of the color reproduction in OST-HMDs. We then discuss how to realize more practical color reproduction methods for future HMD-eye system.

Tutorial 2: Computational Imaging and Projection.

Shinsaku Hiura, Hajime Nagahara, Daisuke Iwai, Toshiyuki Amano

2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015, Fukuoka, Japan, September 29 - Oct. 3, 2015 ( IEEE Computer Society ) xxxi 2015.09 [Refereed]

Structural Color Display on Retro-reflective Objects.

Toshiyuki Amano, Kensuke Minami

International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2015, Kyoto, Japan, October 28-30, 2015. ( Eurographics Association ) 37 - 44 2015 [Refereed]

AN ITERATIVE CONVERGENCE ALGORITHM FOR SINGLE/MULTI GROUND PLANE DETECTION AND ANGLE ESTIMATION WITH RGB-D CAMERA

Yankun Lang, Haiyuan Wu, Toshiyuki Amano, Qian Chen

2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) ( IEEE ) 2895 - 2899 2015 [Refereed]

In this paper, we propose an innovative algorithm for detecting single or multiple ground planes and estimating the orientation of the ground plane with a RGB-D camera. In our algorithm, we use Kernel Density Estimator for selecting the ground plane reliably under a given tilt angle. Camera tilt angle is estimated with probability theory and then used as a feedback to improve the accuracy of detection. Our algorithm is evaluated on several challenging data set and is shown to hold great superiority and effectiveness.

AN ITERATIVE CONVERGENCE ALGORITHM FOR SINGLE/MULTI GROUND PLANE DETECTION AND ANGLE ESTIMATION WITH RGB-D CAMERA

Yankun Lang, Haiyuan Wu, Toshiyuki Amano, Qian Chen

2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) ( IEEE ) 2895 - 2899 2015 [Refereed]

In this paper, we propose an innovative algorithm for detecting single or multiple ground planes and estimating the orientation of the ground plane with a RGB-D camera. In our algorithm, we use Kernel Density Estimator for selecting the ground plane reliably under a given tilt angle. Camera tilt angle is estimated with probability theory and then used as a feedback to improve the accuracy of detection. Our algorithm is evaluated on several challenging data set and is shown to hold great superiority and effectiveness.

質感プロジェクションマッピング

天野敏之

日本バーチャルリアリティ学会誌 19 ( 2 ) 78-81,66(1) - J533 2014.06 [Invited]

プロジェクションディスプレイ技術を応用した質感操作技術は,テーマパークや美術館での演出，プロダクトデザイン補助，さらには宝飾品のライトアップなど，様々な応用が期待できる．しかし,既存のプロジェクションディスプレイ技術による質感操作は，投影対象のモデルが必要であるうえに投影像の位置合わせも必要であり，利用者には多大な手間が要求される．そこで，本論文では認知科学により得られた知見に基づく画像処理アルゴリズムを提案し，Fujiiらが提案している投影中心が一致したプロジェクタ・カメラ系と筆者らが提案している見かけの操作技術へ実装することで透明感と光沢感を光投影によって連続的に操作する方法を提案する．実験では，陶器やプラスチック，シルクへの適用結果を示し，提案手法の有効性を考察する．さらに，本論文ではプロジェクションディスプレイ技術を応用した質感操作の限界について述べる．

Real-time Manipulation of Glossiness and Transparency using a Projector Camera System

天野敏之

映像情報メディア学会誌(Web) ( 一般社団法人映像情報メディア学会 ) 68 ( 12 ) J528-J533 (J-STAGE) - J533 2014.01 [Refereed]

プロジェクションディスプレイ技術を応用した質感操作技術は,テーマパークや美術館での演出，プロダクトデザイン補助，さらには宝飾品のライトアップなど，様々な応用が期待できる．しかし,既存のプロジェクションディスプレイ技術による質感操作は，投影対象のモデルが必要であるうえに投影像の位置合わせも必要であり，利用者には多大な手間が要求される．そこで，本論文では認知科学により得られた知見に基づく画像処理アルゴリズムを提案し，Fujiiらが提案している投影中心が一致したプロジェクタ・カメラ系と筆者らが提案している見かけの操作技術へ実装することで透明感と光沢感を光投影によって連続的に操作する方法を提案する．実験では，陶器やプラスチック，シルクへの適用結果を示し，提案手法の有効性を考察する．さらに，本論文ではプロジェクションディスプレイ技術を応用した質感操作の限界について述べる．

Successive Wide Viewing Angle Appearance Manipulation with Dual Projector Camera Systems.

Toshiyuki Amano, Isao Shimana, Shun Ushida, Kunioki Kono

International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2014, Bremen, Germany, December, 8-10, 2014. ( Eurographics Association ) 49 - 54 2014 [Refereed]

Projection Center Calibration for a Co-located Projector Camera System

Toshiyuki Amano

2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) ( IEEE ) 449 - 454 2014 [Refereed]

A co-located projector camera system where the projector and camera are positioned in the same optical position by a plate beam splitter enables various spatial augmented reality applications for dynamic three dimensional scenes. The extremely precise alignment of the projection centers of the camera and projector is necessary for these applications. However, the conventional calibration procedure for a camera and projector cannot achieve high accuracy because an iterative verification process for the alignment is not included. This paper proposes a novel interactive alignment approach that displays a capture of the projected grid pattern on the calibration screen. Additionally, a misalignment display technique that employs projector camera feedback is proposed for fine adjustment.

A New 3D Representation on the Print Media by Projector Camera System

AMANO Toshiyuki

The IEICE transactions on information and systems (Japanese edition) ( The Institute of Electronics, Information and Communication Engineers ) 96 ( 8 ) 1865 - 1873 2013.08 [Refereed]

本論文は,プロジェクタカメラ系を用いた印刷媒体での新たな立体提示手法を提案する.提案手法は,符号化印刷と見かけの制御の二つのコア技術より構成される.符号化印刷ではHSV色空間にで定義される法線マップ画像により形状を色彩で表現し,3Dコンテンツの立体情報をカラー印刷によって印刷媒体へ埋め込む.また,プロジェクタカメラ系は印刷媒体のキャプチャ画像から印刷媒体に埋め込まれた立体情報を復元する.その後,3Dコンテンツに応じた陰影アニメーションを見かけの制御により印刷媒体上に提示し,ユーザに立体知覚を促す.ユーザスタディによる提案手法の評価では,提案手法による陰影アニメーションは静止した陰影提示よりも1%有意水準において立体提示手法とし有意であることが確認された.

A Short Introduction to Projector Camera System

AMANO Toshiyuki

The Journal of the Institute of Electronics, Information, and Communication Engineers ( 一般社団法人電子情報通信学会 ) 96 ( 6 ) 435 - 440 2013.06 [Invited]

プロジェクタは映像をスクリーンへ表示するための単なるディスプレイ装置ではなく,光学的に現実世界へ働き掛けることを可能にする出力装置と考えることもできる.また,カメラによる実環境のセンシングを加えたプロジェクタカメラシステムでは,一方的に映像を提示するだけではなく,日常生活環境に応じてひずみのない鮮やかな映像を投影したり,物体の見かけを操作することも可能となる.本稿は工学の基礎を習得し,これからプロジェクタカメラシステムの研究に取り組む初学者が読むことを想定し,基礎技術として幾何学レジストレーション,光学補償,光輸送について解説する.

A model-based tracking framework for textureless 3D rigid curved objects

Marina Oikawa, Takafumi Taketomi, Goshiro Yamamoto, Makoto Fujisawa, Toshiyuki Amano, Jun Miyazaki, Hirokazu Kato

SBC Journal on 3D Interactive Systems, Special Issue of the XIV Symposium on Virtual and Augmented Reality 3 ( 2 ) 2 - 15 2013.01 [Refereed]

Projection Based Real-time Material Appearance Manipulation

Toshiyuki Amano

2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) ( IEEE ) 918 - 923 2013 [Refereed]

We introduce a new projection display technique that converts a visual material appearance of target object. Unlike conventional projection display, our approach allowed us successive material appearance manipulation by the projector camera feedback without scene modeling. First, we introduce an appearance control framework with a coaxial projector camera system. Next, we introduce two image based material appearance manipulation methods of translucency and glossiness. Last, we verify the ability of the material appearance manipulation of the proposed display technique through the experiments.

A Fast Simulation Method Using SPH and Wavelet for Sub‐particle‐scale Turbulent Flow

藤澤誠, 三村豪, 天野敏之, 宮崎純, 加藤博一

情報処理学会論文誌ジャーナル(CD-ROM) 53 ( 7 ) 1915 - 1923 2012.07 [Refereed]

This paper presents a fast simulation method for turbulent flow which uses a particle method and wavelet analysis. To simulate fluid flow, the method uses smoothed particle hydrodynamics (SPH), which discretizes the fluid into a collection of particles, and detects regions where turbulent flow will occur by using wavelet analysis without a spatial grid. By taking the curl of wavelet noise, the turbulent flow is then appended as a divergence-free turbulence velocity field. Additionally, by using a particle splitting, which characterize the vortex features of turbulence, a sub-particle-scale representation of turbulent flow is proposed. Implementing almost all processes on a graphics processing unit (GPU), simulations are performed in near real time.

　 PREV - NEXT 　

1
2
3
4
5
6
7
8
9