Images have become increasingly important in modern medical science for diagnosis, as well as for follow-ups and treatment planning. The diversity and quantity have equally grown requiring new tools that explain the images and can help in cases of unsolved clinical questions. The MedGIFT research group in Geneva and Sierre has worked in this field for almost nine years. With ImageCLEF a platform for visual and textual information retrieval has been created. The talk will present some of the ongoing work and active projects as well as a few results from the ImageCLEF benchmarking campaign. The topics will include multidimensional information retrieval, the combination of clinical data with visual information and the evaluation of systems.