Pose from Silhouettes is a method for 3D pose estimation from silhouettes, addressing the classical computer vision problem of estimating object pose from orthographic silhouette projections. We introduce GlOptiPoS: a globally optimal approach for silhouette-based pose estimation, applicable to arbitrary 3D shapes without correspondences, with applications in medical imaging, robotics, and augmented reality.
We address the problem of 3D pose estimation from silhouettes, termed as the Pose from Silhouette (PfS) problem, within geometric computer vision and 3D reconstruction. Unlike learning-based approaches, we propose a globally optimal method for estimating pose from orthographic silhouettes using analytical properties of silhouette geometry.
We solve the problem of determining the pose of known shapes in $\mathbb{R}^3$ from their unoccluded silhouettes. The pose is determined up to global optimality using a simple yet under-explored property of the area-of-silhouette: its continuity w.r.t trajectories in the rotation space.
The proposed method utilises pre-computed silhouette-signatures, modelled as a response surface of the area-of-silhouettes. Querying this silhouette-signature response surface for pose estimation leads to a strong branching of the rotation search space, making resolution-guided candidate search feasible.
Additionally, we utilise the aspect ratio of 2D ellipses fitted to projected silhouettes as an auxiliary global shape signature to accelerate the pose search. This combined strategy forms the first method to efficiently estimate globally optimal pose from just the silhouettes, without being guided by correspondences, for any shape, irrespective of its convexity and genus.
We validate our method on synthetic and real examples, demonstrating significantly improved accuracy against comparable approaches.
Pose from silhouette, silhouettes, pose estimation, 3D pose estimation, shape from silhouette, orthographic projection, geometric computer vision, 3D reconstruction, global optimization, CVPR 2026
@inproceedings{sengupta2026pfs,
title={Globally Optimal Pose from Orthographic Silhouettes},
author={Sengupta, Agniva and Kuş, Dilara and Li, Jianning and Zachow, Stefan},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year={2026}
}