We present REMPE (Registration through Eye Modelling and Pose Estimation), a novel solution to the problem of retinal image registration. We solve it via simultaneously estimating the relative pose of the cameras that acquired the images as well as the shape and the pose of the eye. The method utilizes an ellipsoidal model for the eye, and the pose of the cameras is estimated utilizing RANSAC, followed by a variant of Particle Swarm Optimization (PSO). Extensive experiments demonstrate accurate and robust retinal image registration.

The full description of the registration method is explained in the following thesis:

Retinal Image Registration through 3D Eye Modelling and Pose Estimation
C. Hernandez-Matas
PhD thesis, University of Crete (Greece), 2017

If utilizing this executable, please cite:

An Experimental Evaluation of the Accuracy of Keypoints-based Retinal Image Registration
C. Hernandez-Matas, X. Zabulis, A.A. Argyros
39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 377-381, Jeju Island, July 11-15, 2017

Download REMPE-1.1.0 (15 MB)

File Contents

The compressed file contains:

Configuration and execution:

The program runs out of the box. Just decompress the file to a folder, double click on the executable and it will start registering the sample image pair provided, saving the results in the FIRE folder. A step-by-step guide is shown in the sanity test guide.

ATTENTION: If the program gives an error related to VCOMP120.DLL on startup, install the vcredist_x64.exe file provided. This is a Visual Studio redistributable containing the required libraries.

Detailed instructions can be found in the configuration instructions.

CPU / GPU acceleration:

The program has CUDA GPU acceleration. It will automatically detect the properties of the installed graphic card (if any), and if compatible, it will run the program using GPU acceleration. Otherwise, CPU acceleration will be used. The program requires CUDA Compute Capability 3.0 or higher. A list with the Compute Capability of nVidia devices can be found in this link: CUDA GPUs.

If using a CUDA compatible card, please ensure that the drivers are updated to the latest version.

Registration dataset

The Fundus Image Registration Dataset (FIRE), an ideal dataset to run experiments with this executable has been made publicly available at http://www.ics.forth.gr/cvrl/fire/

Sample results

The following mosaic images have been created utilizing the output provided by the program:

Contact

For any issue regarding this page or the executable, please contact: Carlos Hernandez-Matas http://carlos.hernandez.im

Related publications

  1. Retinal Image Registration through 3D Eye Modelling and Pose Estimation
    C. Hernandez-Matas
    PhD thesis, University of Crete (Greece), 2017
  2. An Experimental Evaluation of the Accuracy of Keypoints-based Retinal Image Registration
    C. Hernandez-Matas, X. Zabulis, A.A. Argyros
    39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 377-381, Jeju Island, July 11-15, 2017.
  3. FIRE: Fundus Image Registration Dataset
    C. Hernandez-Matas, X. Zabulis, A. Triantafyllou, P. Anyfanti, S. Douma, A.A. Argyros
    Journal for Modeling in Ophthalmology, vol. 1, no. 4, pp. 16-28, Jul. 2017.
    URL: http://www.modeling-ophthalmology.com/index.php/JMO/article/view/42
  4. Retinal Image Registration Through Simultaneous Camera Pose and Eye Shape Estimation
    C. Hernandez-Matas, X. Zabulis, A.A. Argyros
    38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3247-3251, Orlando, August 16-20, 2016
    DOI: 10.1109/EMBC.2016.7591421
  5. Retinal Image Registration under the Assumption of a Spherical Eye
    C. Hernandez-Matas, X. Zabulis, A. Triantafyllou, P. Anyfanti, A.A. Argyros
    Computerized Medical Imaging and Graphics, Volume 55, January 2017, Pages 95-105
    DOI: 10.1016/j.compmedimag.2016.06.006
  6. Retinal Image Registration Based on Keypoint Correspondences, Spherical Eye Modeling and Camera Pose Estimation
    C. Hernandez-Matas, X. Zabulis, A.A. Argyros
    37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5650-5654, Milan, August 25-29, 2015
    DOI: 10.1109/EMBC.2015.7319674

Acknowledgements

This research was made possible by a Marie Curie grant from the European Commission in the framework of the REVAMMAD ITN (Initial Training Research Network), Project 316990. It was also supported by the FORTH-ICS internal RTD Programme "Ambient Intelligence and Smart Environments".