Ce Liu
Services
Publications
Code/Data
Ce Liu
IEEE Fellow
AI Research Scientist Director
Meta GenAI
Email
cel
iu
xkxkxk
me
ta.com
Services
Area Chairs for
ICCV 2023
CVPR 2023
ICLR 2023
NeurIPS 2022
ICLR 2022
ICLR 2021
ICML 2021
ICCV 2021
, and
NeurIPS 2021
Associate Editor for
IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI), 2020~2022
Program Co-Chair for
CVPR 2020
Area Chairs for
NeurIPS 2020
NeurIPS 2019
CVPR 2019
NeurIPS 2018
ECCV 2018
CVPR 2017
ICCV 2015
Co-organized Tutorial on
Dense Image Correspondences for Computer Vision
at ICCV 2013 and at CVPR 2014
Workershop Chair
for CVPR 2013
Publications
2023
J. Wang, Z. Yang, X. Hu, L. Li, K. Lin, Z. Gan, Z. Liu, C. Liu and L. Wang.
GIT: A Generative Image-to-text Transformer for Vision and Language
Transactions on Machine Learning Research
(TMLR). Jan, 2023.
pdf
2022
S. Shen, C. Li, X. Hu, Y. Xie, J. Yang, P. Zhang, Z. Gan, L. Wang, L. Yuan, C. Liu, K. Keutzer, T. Darrell, A. Rohrbach and J. Gao.
K-LITE: Learning Transferable Visual Models with External Knowledge
. NeurIPS 2022.
arXiv
Y. Xie, L. Zhou, X. Dai, L. Yuan, N. Bach, C. Liu and M. Zeng.
Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioninge
. NeurIPS 2022.
arXiv
Z. Dou, A. Kamath, Z. Gan, P. Zhang, J. Wang, L. Li, Z. Liu, C. Liu, Y. LeCun, N. Peng, J. Gao and L. Wang.
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
. NeurIPS 2022.
arXiv
J. Wang, D. Chen, Z. Wu, C. Luo, L. Zhou, Y. Zhao, Y. Xie, C. Liu, Y. Jiang, L. Yuan.
OmniVL: One Foundation Model for Image-Language and Video-Language Tasks
. NeurIPS 2022.
arXiv
H. Chang, H. Zhang, L. Jiang, C. Liu and W. T. Freeman.
MaskGIT: Masked Generative Image Transformer
. CVPR 2022.
pdf
C. Herrmann, K. Sargent, L. Jiang, R. Zabith, H. Chang, C. Liu, D. Krishnan, D. Sun.
Pyramid Adversarial Training Improves ViT Performance
. CVPR 2022.
pdf
I. Yoo, H. Chang, X, Luo, O. Stava, C. Liu, P. Milanfar, F. Yang.
Deep 3D-to-2D Watermarking: Embedding Messages in 3D Meshes and Extracting Them from 2D Renderings
. CVPR 2022.
pdf
J. Yang, C. Li, P. Zhang, B. Xiao, C. Liu, L. Yuan and J. Gao.
Unified Contrastive Learning in Image-Text-Label Space
. CVPR 2022.
pdf
2021
L. Yuan et al.
Florence: A New Foundation Model for Computer Vision
Project Florence
, 2021.
arXiv
M. Boss, V. Jampani, R. Braun, C. Liu, J. T. Barron, H. Lensch.
Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition
. NeurIPS 2021.
pdf
G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, C. Liu, D. Ramanan.
ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction
. NeurIPS 2021.
pdf
V. Jampani, H. Chang, K. Sargent, A. Kar, R. Tucker, M. Krainin, D. Kaeser, W.T. Freeman, D. Salesin, B. Curless and C. Liu.
SLIDE: Single Image 3D Photography With Soft Layering and Depth-Aware Inpainting
International Conference on Computer Vision
(ICCV) 2021.
Oral presentation.
pdf
M. Boss, R. Braun, V. Jampani, J. T. Barron, C. Liu, H. Lensch
NeRD: Neural Reflectance Decomposition from Image Collections
International Conference on Computer Vision
(ICCV) 2021.
pdf
Y. Li, P. Jin, F. Yang, C. Liu, M.-H. Yang, P. Milanfar.
COMISR: Compression-Informed Video Super-Resolution
International Conference on Computer Vision
(ICCV) 2021.
Oral presentation.
pdf
D. Sun, D. Vlasic, C. Herrmann, V. Jampani, M. Krainin, H. Chang, R. Zabih, W.T. Freeman and C. Liu.
AutoFlow: Learning a Better Training Set for Optical Flow
Computer Vision and Pattern Recognition
(CVPR) 2021.
Oral presentation.
pdf
G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, H. Chang, D. Ramanan, W.T. Freeman and C. Liu.
LASR: Learning Articulated Shape Reconstruction from a Monocular Video
Computer Vision and Pattern Recognition
(CVPR) 2021.
pdf
H. Tseng, L. Jiang. C. Liu, M.H. Yang, and W. Yang.
Regularizing Generative Adversarial Networks under Limited Data
Computer Vision and Pattern Recognition
(CVPR) 2021.
pdf
R.S. Bowen, H. Chang, C. Herrmann, P. Teterwak, C. Liu and R. Zabih.
OCONet: Image Extrapolation by Object Completion
Computer Vision and Pattern Recognition
(CVPR) 2021.
pdf
2015~2020
P. Khosla, P. Teterwak, C. Wang, A. Sarna, Y. Tian, P. Isola, A. Maschinot, C. Liu, D. Krishnan.
Supervised Contrastive Learning
Advances in Neural Information Processing Systems
(NeurIPS) 2020.
pdf
GitHub
Z. Li, T. Dekel, F. Cole, R. Tucker, N. Snavely, C. Liu and W.T. Freeman.
MannequinChallenge: Learning the Depths of Moving People by Watching Frozen People
IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI) 2020.
pdf
P. Teterwak, A. Sarna, D. Krishnan, A. Maschinot, D. Belanger, C. Liu and W. T. Freeman.
Boundless: Generative Adversarial Networks for Image Extension
IEEE/CVF International Conference on Computer Vision
(ICCV) 2019.
pdf
GitHub
Z. Li, T. Dekel, F. Cole, R. Tucker, N. Snavely, C. Liu and W.T. Freeman.
Learning the depths of moving people by watching frozen people
IEEE/CVF Conference on Computer Vision and Pattern Recognition
(CVPR) 2019.
Oral presentation.
Best paper honorable mention.
pdf
GitHub
C. Herrmann, C. Wang, R.S. Bowen, E. Keyder, M. Krainin, C Liu and R. Zabih.
Robust Image Stitching with Multiple Registrations
European Conference on Computer Vision
(ECCV) 2018.
pdf
GitHub
T. Dekel, C. Gan, D. Krishnan, C. Liu and W.T. Freeman.
Smart, Sparse Contours to Represent and Edit Images
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR) 2018.
pdf
GitHub
T. Dekel, M. Rubinstein, C. Liu and W.T. Freeman.
On the effectiveness of visible watermarks
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR) 2017.
pdf
Google Research Blog
M. Rubinstein, C. Liu and W.T. Freeman.
Joint Inference in Weakly-Annotated Image Datasets via Dense Correspondence
International Journal of Computer Vision
(IJCV) 2016.
pdf
T. Xue, M. Rubinstein, C. Liu and W.T. Freeman.
A Computational Approach for Obstruction-Free Photography
ACM SIGGRAPH
, 2015.
pdf
2010~2014
D. Wei, C. Liu and W.T. Freeman.
A Data-Driven Regularization Model for Stereo and Flow
3DV
2014.
pdf
L. Xu, J. Ren, C. Liu and J. Jia.
Deep Convolutional Neural Network for Image Deconvolution
Neural Information Processing Systems
(NIPS), 2014.
pdf
K. Karsch, C. Liu and S. B. Kang.
DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling
IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI), pp. 2144-2158, Vol. 36, No. 11, 2014
project
] [
pdf
D. Sun, C. Liu and H. Pfister.
Local Layering for Joint Motion Estimation and Occlusion Detection
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR), 2014.
Oral presentation
pdf
H. Mobahi, C. Liu and W.T. Freeman.
A Compositional Model for Low-Dimensional Image Set Representation
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR), 2014
pdf
Video MP4 (57MB)
C. Liu and D. Sun.
On Bayesian Adaptive Video Super Resolution
IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI), pp. 346-360, Vol. 36, Issue 2, 2014
pdf
P. Isola and C. Liu.
Scene Collaging: Analysis and Synthesis of Natural Images With Semantic Layers
International Conference on Computer Vision (ICCV)
2013.
pdf
][
supplementary
L. Sharan, C. Liu, R. Rosenholtz and E. Adelson.
Recognizing Materials Using Perceptually Inspired Features.
International Journal of Computer Vision
(IJCV),
pp. 348-371, Vol. 103, Issue 3, July 2013. [
pdf
X.-J. Wang, L. Zhang, and C. Liu.
Duplicate Discovery on 2 Billion Internet Images
In Proceedings of Big Data Workshop
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 2013.
pdf
M. Rubinstein, A. Joulin, J. Kopf and C. Liu.
Unsupervised Joint Object Discovery and Segmentation in Internet Images.
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 2013
pdf
webpage
J. Kim, C. Liu, F. Sha and K. Grauman.
Deformable Spatial Pyramid Matching for Fast Dense Correspondences
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 2013
pdf
B. Liu, F. Sadeghi, M. Tappen, O. Shamir and C. Liu.
Probabilistic Label Trees for Efficient Large Scale Image Classification.
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 2013
pdf
X.-J. Wang, Z. Xu, L. Zhang, C. Liu and Y. Rui.
Towards Indexing Representative Images on the Web
ACM International Conference on Multimedi
a (ACM MM), 2012
pdf
M. Rubinstein, C. Liu and W.T. Freeman.
Annotation Propagation: Automatic Annotation of Large
Image Databases via Dense Image Correspondence.
European Conference on Computer Vision
(ECCV), 2012.
pdf
] Supplemental materials [coming soon!]
K. Karsch, C. Liu and S.B. Kang.
Depth Extraction from Video Using Non-parametric Sampling.
European Conference on Computer Vision
(ECCV), 2012.
Oral presentation
. [
pdf
] [
code & data
M. Tappen and C. Liu.
A Bayesian Approach to Alignment-based Image Hallucination.
European Conference on Computer Vision
(ECCV), 2012.
pdf
D. Sun and C. Liu.
Non-causal Temporal Prior for Video Deblocking.
European Conference on Computer Vision
(ECCV), 20
12.
pdf
M. Rubinstein, C. Liu and W.T. Freeman.
Towards Longer Long-Range Motion Trajectories.
British Machine Vision Conference
(BMVC), 2012.
pdf
J. Yuen, C. L. Zitnick, C. Liu, and A. Torralba.
A framework for encoding object-level image priors
. Microsoft Research Technical Report, MSR-TR-2011-99, 2011
pdf
O. Tamuz, C. Liu, S. Belongie, O. Shamir and A. Kalai.
Adaptively Learning the Crowd Kernel.
28th International Conference on Machine Learning
(ICML), 2011.
pdf
C. Liu and D. Sun.
A Bayesian Approach to Adaptive Video Super Resolution.
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR) 2011.
Oral presentation
. [
pdf
][
webpage
M. Rubinstein, C. Liu, P. Sand, F. Durand, W.T. Freeman.
Motion Denoising with Application to Time-lapse Photography.
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 2011.
pdf
webpage
C.
Liu, J. Yuen and A. Torralba.
Nonparametric Scene Parsing via Label Transfer
IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI), Vol 33, No. 12, 20
11.
pdf
webpage
code & data
C. Liu, J. Yuen and A. Torralba.
SIFT flow: dense correspondence across different
scenes and its applications.
IEEE Transactions on
Pattern Analysis and Machine Intelligence
(TPAMI), Vol 33, No.5, 2011.
pdf
webpage
C.
Liu and William T. Freeman.
A High-Quality Video Denoising Algorithm based on
Reliable Motion Estimation
European Conference on Computer Vision
(ECCV) 20
10.
Oral presentation.
pdf
webpage
C.
Liu, L. Sharan, E. H. Adelson and R. Rosenholtz.
Exploring features in a Bayesian framework for
material recognition.
IEEE Conference on Computer Vision
and Pattern Recognition
(CVPR) 20
10.
pdf
webpage
2001~2010
J. Yuen, B. Russell,
C. Liu and A. Torralba.
LabelMe video:
Building a Video Database with Human Annotations.
IEEE International Conference on
Computer Vision
(ICCV), Oct 2009. [
pdf
C.
Liu.
Beyond pixels: exploring new
representations and applications for motion
analysis.
Doctoral Thesis. Massachusetts
Institute of Technology. May 2009. [
pdf
C. Liu, J. Yuen, and A.
Torralba.
Nonparametric scene parsing: label
transfer via dense scene alignment
IEEE Conference on Computer Vision and Pattern
Recognition
(CVPR)
2009.
Oral
presentation.
Best Student Paper Award
pdf
] [
ppt
webpage
code & data
C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman.
SIFT flow: dense correspondence across different scenes
European Conference on Computer Vision
(ECCV) 2008.
Oral presentation
. [
webpage
] [
pdf
].
C. Liu, W. T. Freeman, E. H. Adelson and Y. Weiss.
Human-assisted motion annotation
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR) 2008.
Oral presentation
. [
pdf
] [
webpage
].
C. Liu, R. Szeliski, S. B. Kang, C. L. Zitnick and W. T. Freeman.
Automatic estimation and removal of noise from a single image
IEEE Transactions
on Pattern Analysis and Machine Intelligence
(TPAMI), Vol 30, No. 2, pp. 299-314, Feb., 2008.
pdf
MSR
TR link
B. Russell, A. Torralba, C. Liu, R. Fergus and W. T.
Freeman.
Object recognition by scene alignment.
Advances in Neural Information Processing Systems
(NIPS), 2007. [
pdf
webpage
C. Liu, H. Y. Shum and W. T. Freeman.
Face hallucination: theory and
practice
International Journal of
Computer Vision
IJCV
),
Vol. 75, No. 1, pp. 115-134, October, 2007. [
pdf
webpage
M. F. Tappen, C. Liu,
E. H. Adelson and W. T. Freeman.
Learning
Gaussian conditional random fields for low-level
vision
IEEE Conference on
Computer Vision and Pattern Recognition
(CVPR)
pp. 1-8, 2007
pdf
C. Liu, W. T. Freeman and E. H. Adelson.
Analysis of Contour Motions
Advances in Neural Information Processing Systems
(NIPS), 2006.
Oral presentation.
Outstanding Student Paper Award
. [
pdf
ppt
webpage
C. Liu, W. T. Freeman, R. Szeliski and S. B. Kang.
Noise estimation from a single image
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR), pp. 901-908, 2006.
Oral presentation
. [
pdf
] [
ppt
webpage
C. Liu, A. Torralba,
W.T . Freeman, F. Durand and E. H. Adelson.
Motion magnification
ACM
SIGGRAPH
2005, pp. 519-526, 2005. [
pdf
ppt
webpage
L. Yuan, F. Wen, C. Liu and H. Y. Shum.
Synthesizing dynamic texture with closed-loop linear dynamic system
European Conference on Computer Vision
(ECCV), 2004.
Oral presentation
. [
pdf
C. Y. Wu, C. Liu, H. Y.
Shum, Y. Q. Xu and Z. Y. Zhang.
Automatic
eyeglasses removal from face images
IEEE
Transactions on Pattern Analysis and Machine
Intelligence
(TPAMI), Vol. 26, No. 3, pp.
322-336, March 2004. [
pdf
C. Liu and H. Y. Shum.
Kullback-Leibler boosting
IEEE Conference
on Computer Vision and Pattern Recognition
(CVPR)
pp. 587-594, 2003. [
pdf
ppt
S. C. Yan, C. Liu, S.
Z. Li, H.J. Zhang, H. Shum, Q. S. Cheng.
Face
alignment using texture constrained active shape
models
Image and Vision Computing
, Vol.
21, Issue 1, Pages 69-75, January, 2003. [
pdf
Z. Q. Liu, C. Liu,
H.Y . Shum and Y. Z. Yu.
Pattern-based texture metamorphosis
Pacific Conference on Computer Graphics and
Applications
, pp. 184-193, 2002. [
pdf
ppt
webpage
C. Liu, H. Y. Shum and
S.C. Zhang.
Hierarchical shape model for
automatic face localization
European
Conference on Computer Vision
(ECCV)
pp. 687-703, 2002. [
pdf
C. Y. Wu, C. Liu, H. Y.
Shum, Y. Q. Xu and Z. Y. Zhang.
Automatic
eyeglasses removal from face images
Asian
Conference on Computer Vision (
ACCV
, pp.
193-198, 2002. [
pdf
C. Liu, H. Y. Shum and
C. S. Zhang.
Two-step
approach to hallucinating faces: global parametric
model and local nonparametric model
IEEE Conference on Computer Vision and Pattern
Recognition
(CVPR)
Vol. 1, pp. 192-198, 2001.
Oral presentation
. [
pdf
ppt
webpage
L. Liang, C. Liu, Y. Q.
Xu, B. N. Guo and H. Y. Shum.
Real-time texture synthesis by
patch-based sampling
ACM Transactions
on Graphics
(TOG)
Vol. 20, No. 3, pp. 127-150, July 2001. [
pdf
webpage
C.
Liu
S.C.
Zhu and H. Y. Shum.
Learning
inhomogeneous Gibbs model of faces by minimax
entropy
IEEE International Conference
on Computer Vision
(ICCV)
pp. 281-287, 2001. [
pdf
webpage
Code and Data
Deep Convolutional Neural Network for Image Deconvolution
Deformable spatial pyramid matching (DSPM) code
Objective discovery and co-segmentation (database & evaulation code)
Depth transfer data and Matlab/C++ code
Label transfer data and Matlab/C++ code
Optical flow Matlab/C++ code (updated!)
SIFT flow Matlab/C++ code
Image super resolution Matlab code
Human-assisted motion
annotation: database & C++ code