Research Group on Visual Computation

Affine Puzzle

Icon of project

Description

The affine puzzle problem can be formulated as follows: Given a binary image of an object (the template) and another binary image (the observation) containing the fragments of the template, we want to establish the geometric correspondence between these images which reconstructs the complete template object from its parts. The overall distortion is a global nonlinear transformation with the following constraint:

  • the object parts are distinct (i.e. either disconnected or separated by segmentation),
  • all fragments of the template are available, but
  • each of them is subject to a different affine deformation.

The basic idea of the proposed solution is to construct and solve a polynomial system of equations which provides the unknown parameters of the alignment. We have quantitatively evaluated the proposed algorithm on a large synthetic dataset containing 2D and 3D images. The results show that the method performs well and robust against segmentation errors. The method has been validated on 2D real images as well as on volumetric medical images applied to surgical planning.

 

Solution of the Tangram puzzle. TOP: observed tiles, MIDDLE: template silhouettes, BOTTOM: Realigned tiles.

 

Bone fracture reduction. The CPU time of our Matlab implementation was 15 sec. for these 1 megavoxel CT volumes.
Template (mirrored intact bone)
Fractured bone (observation)
Realigned bone fracture

 

Publications to cite:
  1. Csaba Domokos, Zoltan Kato, Affine puzzle: Realigning deformed object fragments without correspondences, In Proceedings of European Conference on Computer Vision (Kostas Daniilidis, Petros Maragos, Nikos Paragios, eds.), Springer, vol. 6312, Crete, Greece, pp. 777-790, 2010. [bibtex]

Hichem Abdellali has been awarded the Doctor of Philosophy (PhD.) degree...

2022-04-30


Hichem Abdellali has been awarded the KÉPAF Kuba Attila prize...

2021-06-24