top of page

SEEDS: Scalable Educational Experiences with Digital Scaffolding

Project Overview

SEEDS is an accessible, voice-based learning platform co-designed with teachers and students in schools for the blind. It helps teachers run lessons and connect with students remotely, while giving children engaging content like stories, quizzes, and games. All through feature phones, Android apps, and a simple web portal.

Research published at ACM COMPASS - Read the paper

Mockup phone-Mockupsforfree.jpg
image.png
Logo of International Institute of Information Technology, Bangalore

Role

Research Fellow at Microsoft Research India

I led the UX and UI design, from prototyping to deployment. I also co-led ethnographic research and user studies with my colleague, working closely with teachers, students, and NGO partners.

Duration

Aug 2022 - Present


SEEDS began as a hackathon idea and has grown into a deployed project, now piloted in schools for the blind across India.

Tools Used

MS Forms, Figma


Used to capture insights, create prototypes, and refine designs with real feedback from the community.

Problem

  • India has the world’s largest population of children with visual impairments (CVIs), but only a fraction attend school.

  • Blind schools face chronic shortages of trained teachers and accessible learning materials.

  • The COVID-19 pandemic further isolated students, cutting off peer interaction and teacher support, with no digital alternative in place.

India's image
Decorative image

Motivation: The Pandemic

  • When schools shut down during the pandemic, students with visual impairments lost nearly all access to education. Unlike their sighted peers, there were no digital alternatives for lessons, connection, or play. Teachers, many of whom are visually impaired, also struggled to reach their students.

  • SEEDS was born from this urgent need to create a simple and accessible way for children and teachers to stay connected and continue learning in any circumstance.

User Personas

Teacher illustration

ANUPRIYA -  Teacher with Visual Impairment (TVI)

Government school teacher in Bangalore, low-paying job, new to using TalkBack on Android.

  • Teaches math along with other subjects, the only TVI proficient in Braille at her school

  • Faces staff shortages and cannot take days off

  • Struggles with remote teaching since no accessible platform exists for TVIs to teach CVIs

Goals:​ 
Ensure her students are not deprived of education 

Frustrations:​ 

  • Must handle multiple subjects with little support

  • Limited accessible resources

  • Still learning to use TalkBack

Design Implication:​ SEEDS needed to be simple, teacher-first, and fully accessible with TalkBack.

Shalini -  Student with Visual Impairment

Grade 5 student in Bangalore, hostelite, from a financially un-equipped family.

  • Visually impaired since birth

  • Attends a school with teacher shortages

  • Spends afternoons alone since friends go home after school

Goals:​ 

  • Learn, ask questions, communicate, and grow

  • Become more independent

Frustrations:​ 

  • Few teachers and limited learning opportunities after school hours

  • No fun or engaging accessible content to fill her time

Design Implication:​ SEEDS needed to make learning playful, accessible outside school, and easy to use on basic phones.

Student illustration

Design Goals

Based on these challenges and user needs, we defined a few guiding goals for SEEDS:

  • Teacher-first: Enable teachers to teach effectively despite constraints

  • Child-friendly: Help children with visual impairments as young as 6 learn with confidence

  • Flexible: Support learning in schools, hostels, and homes, during or after school hours

  • Inclusive: Work with or without teachers, in groups or individually, even with volunteers

  • Device-agnostic: Deliver accessible learning on Android phones, basic feature phones, and smart speakers

The Solution

SEEDS brings these goals to life through three major touchpoints.

Design Process

It was a participatory and iterative process. Research and design happened side by side in schools for the blind, where we worked closely with teachers, students, and NGO partners.

How we worked together:

  • Co-design sessions: Teachers and students helped us shape the IVR flows, lesson structures, and app features.

  • In-situ testing: Prototypes were tried in classrooms and hostels, capturing real use cases.

  • Rapid refinements: Feedback directly informed changes, such as adding call-drop alerts, moving the end call button for accessibility, and simplifying IVR navigation for TalkBack users.

Formative Study

Designing SEEDS was an iterative design process as it involved multiple

Study Details

  • My colleague and I visited two schools for the blind in Bangalore, India weekly for 8 months.

  • We interacted with about 20 children aged 9-13.

  • Our objective in this phase was to validate the individual touchpoints of the system and to identify limitations and
    barriers     to usage by the intended end users

India's map, zoomed in on Karnataka and has 5 location pins to depict 5 schools

Learnings

1. IVR system

  1. Ensure content titles are clear and understandable in the local language to enhance comprehension.

  2. Design the IVR system (from the backend) to handle multiple key presses gracefully to prevent unexpected states and confusion

  3. Regularly update IVR content to match diverse interests and educational needs.

  4. Simplify the navigation process to avoid the need for students to restart calls when they want to return to a previous menu.

  5. Design earphones to stay in place and prevent accidental disconnections.

growing plant depicting improved versions

2. Android Teacher Application

​Two major UX updates:
 

  1. When students dropped from calls due to connectivity or accidental key presses, teachers, including sighted ones, often missed these drop-offs while speaking with the phone to their ear. To mitigate this, we implemented announcements for when a student dropped, aiding both sighted and VI teachers to quickly redial the dropped student.

  2. To address teachers accidentally pressing the "Home" button and losing the call screen, we repositioned the end call button higher within the application.

A designer and developer sitting together and enhancing the application

What are "Educational Experiences"?

Educational experience goes beyond just textbooks or storybooks.

It involves interactive activities like teacher-led readings, student read-alouds, independent reading, discussions about content, and sharing views on themes. These activities turn content into valuable learning experiences. The more varied these experiences, the more effective the education.

4 illustrations depicting games like maze, jigsaw puzzle and conversational games

Current iterations of SEEDS touchpoints and how they fit together to expand access to a diverse set of educational experiences to CVIs

Touchpoint  1: IVR via Feature Phones

IVR - Interactive Voice Response

A technology that allows computers to interact with humans through voice commands and keypresses, often used in call centers to route calls and provide automated services.

Via IVR we aim to provide:

  1. 24/7 independent access to content for students

  2. Varied experiences

Illustration of a student sitting with her feature phone with earphones connected

IVR User Experience

Visual representation of IVR key presses. Key 1 is labeled to rewind the content, Key 2 to pause and play content, Key 3 to forward the content, Key 4 to mute all, Key 6 to unmute all, * to decrease playback rate, and # to increase playback rate.

Secondary features:
8 => repeat current menu
9 => to go to the previous menu (in an experience)
0 => help when in experience (guide to audio control commands)

Flowchart illustrating an Interactive Voice Response (IVR) system process for selecting content. The flow begins with a user initiating a call to an IVR number, followed by an automatic callback and answered call. The process is divided into three main steps: Language Selection: The IVR menu presents language options, and the user selects a preferred language. Theme Selection: The user chooses from theme options, such as 'Sense and Sense Organs' or 'Family and Relationships.' The flow includes options to adjust speech rate (# to increase, * to decrease) and menu navigation commands (1-4 for menu options, 5 for next, 7 for previous, 8 to repeat, and 9 to go back). Experience Selection: The user selects an experience type (e.g., stories, poems, quizzes) and executes the experience. The interaction ends after the experience execution, with DTMF input used for navigation.

Why Feature Phones?

Feature phones are better than smartphones for our target community.

  1. Tactile - smaller learning curve for CVIs

  2. Includes screen reader - accessible

  3. Cost-effective - suits our demographic

  4. Robust 

  5. Longer battery life

Illustration depicting feature phone is better than smartphone

Touchpoint  2: Android Application for Teachers

Android Application

An app used to conduct educational group calls between teachers and students. These calls are initiated by the teacher by using the app and received by the students on feature phones. We used Android because it is more widely used among teacher population in India.

Via teacher app we aim to provide:

  1. Teachers a mean to communicate with their students remotely

  2. A simple interface to view all the content available

Teacher illustration

Experience flow

Began by outlining the information architecture through iterations on the experience flows. The flow presented here is the fourth and current iteration of the application. Earlier iterations were rapid prototypes with an iterative design approach. This iteration represents the latest version of the flow.

Flowchart illustrating a mobile application user journey for managing and joining group calls. The process begins with downloading the app, starting it, and completing phone verification by entering a name, number, and a four-digit code. From the homepage, users can access options to create groups, add content, and manage calls. Key steps include adding group details, selecting students, assigning a leader, and setting call permissions. Users can select content, apply filters, and configure call settings. During the call, options include muting or unmuting all, adding or removing students, and ending the call. The chart uses color coding to distinguish main page elements, backend processes, and user decisions.

Wireframes

Created paper wireframes with relevant information present in it. With SEEDS we had to take the application to the high fidelity version for testing the talk back efficiency and ease of use for TVIs who are also novice technology users.

Paper wireframes of SEEDS application

Style Guide

​

Adhered to the WCAG guidelines to ensure the visual identity and colors used are accessible, achieving AAA compliance. The overall design follows the POUR principles, ensuring a high level of accessibility.

User interface design layout for a mobile application, featuring color scheme details, typography specifications, and iconography. Colors shown include a dark green (#28574F), mustard yellow (#F4B84F), light grey (#EFF5F5), and white (#F9F9F9). Text sizes are specified with headings at 18px, subheadings at 15px, and body text at 12px. Iconography includes home, list, group, and call icons in idle and in-use states, colored in dark green and mustard yellow. A sample screen displays a 'Create Group' feature with a list of groups for various subjects like Story Reading, Poetry, Math Revision, Chess, and Science Revision. On the right, a black-and-white photograph of a child is shown alongside a screenshot of a color contrast checker confirming that the design meets AAA color contrast requirements for accessibility.

Interface Design

Allow teachers to reach their students via call through an android application. Teacher can manage the class efficiently with minimal clicks and can also appoint a leader to manage the class if she gets temporarily absent.

Flow of basic use case of the application. It is depicted by high fidelity screens connected by arrows. User interface flow for a group call feature in a mobile application, showing steps from creating a group to managing a live call. The sequence begins with a 'Create Group' screen displaying various group categories like Story Reading, Poetry, and Math Revision. The flow then progresses to selecting students for a call, starting the call, and handling call settings such as muting/unmuting, retrying, and adding additional students. Each screen details specific actions, such as the teacher receiving a call, student status indicators (e.g., ringing, joined), and managing audio controls. Additional features like the 'Raise Hand' function highlight specific students and bring them to the top of the list for teacher attention. The interface uses icons and navigation arrows to guide the user through each stage.

Leaders and their powers

The teacher can also select a student leader. The leader has additional control over certain aspects of the call using specific number key presses.





These controls are implemented to allow the leader to moderate the class in case the teacher becomes temporarily unavailable.

Key presses for leaders. Key 1 is to unmute all, key 2 is to pause and play the content, key 4 is to rewind the content, key 3 to forward the content, key 0 to mute all
3 high fidelity screens depicting the flow of appointing a leader

Touchpoint  3: Content Management Website

CRUD website

Enables users to add, view, modify, and delete content as needed.

Via content management website we aim to provide:

  1. Enable teachers to manages content on IVR system and teacher app

  2. Understand independent IVR usage by students

Illustration of a teacher

Website Design

  • Each piece of content is labeled by its language and type for clear categorization.

  • The display of language and corresponding content aids visually impaired users when using a screen reader.

  • The website also specifies the exact location, such as the Teacher App (TA) and IVR, where each content item is available.

A screenshot of the website that has been developed based on the design

Usage Scenarios

Diverse use cases of interactions across space and time by TVIs and CVIs derived from the learnings of the formative study.

Scenario 1: Fully In-person

Both the teacher and the students are in the same physical space.

The platform allows the teacher to access and deliver a variety of experiences by using the Teacher App on their Android phone. The phone is connected to an external speaker, either wired or via Bluetooth, enabling all students to hear the content.

The students interact with the teacher as they would in a traditional classroom setting.

Illutration depicting fully in person use case. Teacher conducting the class with a speaker in the center and students sitting around it

Scenario 2: Remote Teacher

The students are gathered in a classroom while the teacher is in a remote location. The teacher uses the Teacher App to connect to a feature phone held by a designated student (‘class monitor’) in the classroom.

This feature phone is connected to an external speaker, allowing all students to listen to the audio.

The class monitor mediates the conversation between the students and the remote teacher, facilitating a guided learning experience.

Illutration depicting remote teacher use case.

Scenario 3: Autonomous Student Mode

An individual student independently accesses and engages with the curated
experiences from their home or school residence.

There is no involvement of a teacher or an Android App, and the student directly interacts with the digital experiences through the IVR system.

Illutration depicting autonomous student modeuse case

Scenario 4: Fully Remote

The teacher and students are in different locations. The teacher uses the Teacher App to initiate a conference call, delivering educational experiences to students on feature phones for interactive learning.

An illustration of teacher sitting in her house using the SEEDS application to connect with her students remotely
An illustration of students sitting in a remote setting with each child using one feature phone

Summer Pilot

To address the research questions and to evaluate SEEDS we conducted a mixed-method study over a structured 7-week summer program

Study Details

  • Involved 29 CVIs from 5 schools in Karnataka, India.

  • Program carried out by 5 teachers (3 sighted and 2 visually impaired) affiliated with Vision Empower Trust.

  • Conducted semi-structured interviews with the five teachers following the program's conclusion.

  • 130 sessions spanning a duration of 97 hours

India's map, zoomed in on Karnataka and has 5 location pins to depict 5 schools

Findings

1. Collaborative Teaching Environment

  1. Teachers considered the summer program successful based on student engagement and enthusiasm.

  2. They faced challenges such as frequent call drops, background noise, and technical issues with the SEEDS app.

  3. Teachers adapted to remote teaching using calls and the SEEDS app, finding creative ways to manage and engage students.

  4. They shared insights on optimal classroom sizes, the use of feature phones, and the importance of preparation for future iterations of the program.

Illustration of 5 teachers sitting together and discussing

2. Student Engagement

  1. Eagerness in answering questions and engaging in discussions.

  2. Students proactively asked to share their input

  3. Informing the teacher when a peer had disconnected.

  4. Students requesting homework. 

  5. The students also sought assistance from parents and neighbors to complete it.

Illustration of 4 students enjoying the SEEDS experience

3. Challenges

  1. Internet connectivity issue

  2. Students disconnecting mid-call

  3. Gauging student comprehension over call

Future Directions

  1. Include Braille into the platform

  2. Personalised IVR

  3. Audio based feature phone games

  4. Children generated content

  5. GenAI based content creation

Current status of the project

We have onboarded 2 schools in Tripura and 9 in Karnataka 


We have tested SEEDS with 20 students and planning another study with 42 students and 13 facilitators this (April - May 2024) summer!

We have received positive response from the students and facilitators and our research paper on the same has been accepted to COMPASS 2024!

My Learnings

  1. Deepened my understanding of accessible design, focusing on the POUR principles and their implementation in design.

  2. Developed interpersonal skills by overcoming language barriers with CVIs and building a bond, becoming their 'Akka' (elder sister) in the process. :)

  3. Navigated the design-to-development process for the first time, learning the intricacies of transferring and communicating between design and development teams.

an illustration depicting growth as a human and designer
bottom of page