Automating Image Descriptions with AI in Plone
2024-11-28 , Jean Ferri Auditorium
Language: English

Discover how AI can enhance web accessibility by automatically generating image descriptions and alt text in Plone. Learn about the project, its challenges, and future possibilities


In today's digital world, accessibility is essential to ensure all users, including those with disabilities, can access web content. My Google Summer of Code 2024 project with the Plone Foundation aimed to address this by leveraging AI to automatically generate alt text and descriptions for images uploaded through Plone's image block and bulk upload features.

This talk will explore the project's motivation to improve ADA compliance and enhance the experience for users relying on screen readers. I'll discuss the development of an AI tool using the Gemini API to generate image metadata, making content more accessible.

We will cover the technical challenges encountered, including handling various image formats, optimizing API calls, and ensuring the AI model outputs accurate descriptions.

A Computer Engineering student at Cairo University with a passion for AI and software development. He is currently a Backend-AI intern @ Instabug and successfully completed a GSoC Project.