Prof. Gene Cheung Profile

Prof. Gene Cheung

Associate Professor at National Institute of Informatics

SPIE Involvement:

Author

Area of Expertise:

image & video representation , graph signal processing , immersive visual communication

Websites:

Personal Website

received the B.S. degree in electrical engineering from Cornell University in 1995, and the M.S. and Ph.D. degrees in electrical engineering and computer science from the University of California, Berkeley, in 1998 and 2000, respectively.

He was a senior researcher in Hewlett-Packard Laboratories Japan, Tokyo, from 2000 till 2009. He is now an associate professor in National Institute of Informatics in Tokyo, Japan.

His research interests include image & video representation, immersive visual communication and graph signal processing. He has published over 130 international conference and journal publications. He has served as associate editor for IEEE Transactions on Multimedia from 2007 to 2011 and currently serves as associate editor for DSP Applications Column in IEEE Signal Processing Magazine and APSIPA journal on signal & information processing, and as area editor for EURASIP Signal Processing: Image Communication.
He currently serves as member of the Multimedia Signal Processing Technical Committee (MMSP-TC) in IEEE Signal Processing Society (2012-2014). He has also served as area chair in IEEE International Conference on
Image Processing (ICIP) 2010, 2012-2013, technical program co-chair of International Packet Video Workshop (PV) 2010, track co-chair for Multimedia Signal Processing track in IEEE International Conference on Multimedia and Expo (ICME) 2011, symposium co-chair for CSSMA Symposium in IEEE GLOBECOM 2012, and area chair for ICME 2013. He was invited as plenary speaker for IEEE International Workshop on Multimedia Signal Processing (MMSP) 2013 on the topic ``3D visual communication: media representation, transport and rendering''. He is a co-author of best student paper award in IEEE Workshop on Streaming and Media Communications 2011 (in conjunction with ICME 2011), best paper finalists in ICME 2011 and ICIP 2011, best paper runner-up award in ICME 2012, and best student paper award in ICIP 2013.

Proceedings Article | 21 February 2013 Paper

Depth-layer-based multiview image synthesis and coding for interactive z- and x-dimension view switching

Yu Mao, Gene Cheung, Yusheng Ji

Proceedings Volume 8666, 86660C (2013) https://doi.org/10.1117/12.2004254

KEYWORDS: Cameras, Image segmentation, Image compression, Image transmission, Navigation systems, Switches, 3D image processing, Volume rendering, Image quality, Switching

Read Abstract +

In an interactive multiview image navigation system, a user requests switches to adjacent views as he observes the static 3D scene from different viewpoints. In response, the server transmits encoded data to enable client- side decoding and rendering of the requested viewpoint images. It is clear that there exists correlation between consecutive requested viewpoint images that can be exploited to lower transmission rate. In previous works, this is done using a pixel-based synthesis and coding approach for view-switch along the x-dimension (horizontal camera motion): given texture and depth maps of the previous view, texture pixels are individually shifted horizontally to the newly requested view, each according to its disparity value, via depth-image-based rendering (DIBR). Unknown pixels in the disoccluded region in the new view (pixels not visible in the previous view) are either inpainted, or intra-coded and transmitted by server for reconstruction at decoder. In this paper, to enable efficient view-switch along the z-dimension (camera motion into / out of the scene), we propose an alternative layer-based synthesis and coding approach. Specifically, we first divide each multiview image into depth layers, where adjacent pixels with similar depth values are grouped to the same layer. During a view-switch into the scene, spatial region in a layer is enlarged via super-resolution, where the scale factor is determined by the distance between the layer and the camera. On the other hand, during a view-switch out of the scene, spatial region in a layer is shrunk via low-pass filtering and down-sampling. Due to high quality reconstruction of depth layers in the new view via rescaling, coding and transmission of a depth layer in the new view by server is necessary only in the rare case when the quality of layer-based reconstruction is poor, saving transmission rate. Experiments show that our layer-based approach can reduce bit-rate by up to 35% compared to previous pixel-based approach.

Proceedings Article | 15 February 2012 Paper

Reference frame selection for loss-resilient depth map coding in multiview video conferencing

Bruno Macchiavello, Camilo Dorea, Edson Hung, Gene Cheung, Wai-Tian Tan

Proceedings Volume 8305, 83050C (2012) https://doi.org/10.1117/12.909462

KEYWORDS: Distortion, Volume rendering, Video, Computer programming, Fourier transforms, Video coding, Optimization (mathematics), Cameras, Visualization, Motion models

Read Abstract +

Proceedings Article | 15 February 2012 Paper

Video attention deviation estimation using inter-frame visual saliency map analysis

Yunlong Feng, Gene Cheung, Patrick Le Callet, Yusheng Ji

Proceedings Volume 8305, 83050H (2012) https://doi.org/10.1117/12.907384

KEYWORDS: Video, Visualization, Eye, Eye models, Visual analytics, Visual process modeling, Motion models, Surface plasmons, Motion analysis, Picosecond phenomena

Read Abstract +

Proceedings Article | 31 July 2010 Paper

On media data structures for interactive streaming in immersive applications

Gene Cheung, Antonio Ortega, Ngai-Man Cheung, Bernd Girod

Proceedings Volume 7744, 77440O (2010) https://doi.org/10.1117/12.863532

KEYWORDS: Video, Computer programming, Switching, Video coding, Switches, Data communications, JPEG2000, Spatial resolution, Data storage, Taxonomy

Read Abstract +

Proceedings Article | 28 January 2008 Paper

ECHO: a community video streaming system with interactive visual overlays

Gene Cheung, Wai-tian Tan, Bo Shen, Antonio Ortega

Proceedings Volume 6818, 681809 (2008) https://doi.org/10.1117/12.775126

KEYWORDS: Video, Video coding, Visualization, Receivers, Computer programming, Video processing, Video compression, Internet, Multiplexing, Multimedia

Read Abstract +

Keywords/Phrases

Search In:

Publication Years