Student Assistant for the VisPer Project

Job description

The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a cooperation of the Fraunhofer Society with TU Darmstadt, the Darmstadt University of Applied Sciences, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer. Be part of change: - Implementation and application of computer vision approaches, including: - object detection (e.g., using YOLO, RT-DETRv2, etc.) - image classification using common architectures (e.g., Transformers: ViT, Swin, DeiT, CNNs: ResNet, EfficientNet, GNNs: GraphConv, GAT) - image description, visual question answering, and multimodal search using Vision-Language Models (VLMs) image segmentation (e.g., using SAM-3, DINO-3, etc.) - interactive and explainable classification systems (RISE, GradCAM, EigenCAM, Integrated Gradients, ViT Shapley, etc.) - Implementation and execution of experiments in the field of Machine Learning (ML): - cleaning, preparing, splitting, visualizing data, if necessary crawling and scraping data. - Applying (...