SEEDS: Scalable Educational Experiences with Digital Scaffolding
Project Overview
A holistic solution that empowers both teachers and students at the schools for the blind by providing them with an ecosystem to engage, consume and enjoy rich experiences such as stories, quizzes, and games.
*Research paper accepted at COMPASS - to be published
Role
MS RESEARCH | Research Fellow
Ethnographic Research, UX-UI Design, User Study
Duration
Aug 2022 - Present
This project is work in progress
Tools Used
MS Forms, Figma
Problem
India has the largest population of children with vision impairments (CVIs) in the world.
Only a small number of them attend schools.
The schools generally have the following characteristics:
-
Shortage of teachers resulting in children from multiple grades often being grouped into one class
-
Teachers teach multiple subjects, and many are blind
-
Insufficient resources including lab resources
-
Dearth of trained special educators
Motivation: The Pandemic
Our team worked on improving STEM and CT education for visually impaired students during the pandemic.
-
Closure of residential schools led to student isolation without peer or teacher interaction. - Urban schools adopted online classes, providing some continuity, but blind schools faced complete isolation.
-
Socio-economic challenges and delayed reopening of special schools exacerbated the situation.
-
Teachers and families were eager to overcome hurdles and get connected using technology.
-
Teachers with basic Android skills learned to install apps and join conference calls remotely.
-
Interactive sessions were conducted using smartphones or basic phones, with support from families.
-
The pandemic underscored the vital role of technology in maintaining student engagement and emphasized the necessity of online connectivity for providing education to marginalized students.
Note: I was not a part of MSRI when this was identified.
User Personas
It was evident that there would be two primary users of the platform.
ANUPRIYA - Teacher with Visual Impairment (TVI)
Government school | Low paying job | Novice technology user | Bangalore, Karnataka
-
She teaches math to the students and is also responsible for few other subjects. She is the only TVI proficient in braille at the school.
-
She uses an android phone but is still getting used to the usage of it with talkback.
-
Remote teaching for her is very challenging as there is no accessible digital platform where TVI can teach CVI.
Goals:
Make sure her students are not deprived of education
Frustrations:
Cannot take days off | Not enough staff | Needs to teach multiple subjects | Not proficient with the talkback | Lack of educational resources in schools
Shalini - Child with Visual Impairment
Grade 5 | Government school | Hostelite | Financially unequipped family | Bangalore, Karnataka
-
Visually impaired by birth
-
Her school has a shortage of teachers.
-
She often gets bored after school hours as most of her friends are day scholars. Due to this, she ends up spending time alone without keeping herself busy.
Goals:
To learn | Ask questions, communicate, grow | Become independent
Frustrations:
Not enough teachers in school | No educational or fun content to engage with after school hours
Aim:
-
Equip teachers in schools for the blind to connect with students remotely during emergencies, such as pandemics and summer breaks.
-
Mitigate barriers that prevent CVIs from attending school by engaging them at home through digital means.
-
Address the severe shortage of trained teachers by enabling them to engage with students remotely.
-
Overcome the limited resources available to teachers by providing access to curated digital content for student engagement.
Design Goals:
-
Place the teacher at the center, empowering them to be more effective despite constraints.
-
Ensure usability for CVIs starting from ages 6 or 7.
-
Support diverse learning scenarios, both in school and outside, including in student homes and after-hours in residential schools.
-
Accommodate multiple usage scenarios, such as with regular school teachers, without any teachers, with volunteer teachers from non-profits, with groups of students, or with individual students.
-
Support a wide range of devices, including Android phones, basic 2G feature phones, smart feature phones, and smart speakers.
3 Major Touchpoints
Formative Study
Designing SEEDS was an iterative design process as it involved multiple
Study Details
-
My colleague and I visited two schools for the blind in Bangalore, India weekly for 8 months.
-
We interacted with about 20 children aged 9-13.
-
Our objective in this phase was to validate the individual touchpoints of the system and to identify limitations and
barriers to usage by the intended end users
Learnings
1. IVR system
-
Ensure content titles are clear and understandable in the local language to enhance comprehension.
-
Design the IVR system (from the backend) to handle multiple key presses gracefully to prevent unexpected states and confusion
-
Regularly update IVR content to match diverse interests and educational needs.
-
Simplify the navigation process to avoid the need for students to restart calls when they want to return to a previous menu.
-
Design earphones to stay in place and prevent accidental disconnections.
2. Android Teacher Application
Two major UX updates:
-
When students dropped from calls due to connectivity or accidental key presses, teachers, including sighted ones, often missed these drop-offs while speaking with the phone to their ear. To mitigate this, we implemented announcements for when a student dropped, aiding both sighted and VI teachers to quickly redial the dropped student.
-
To address teachers accidentally pressing the "Home" button and losing the call screen, we repositioned the end call button higher within the application.
What are "Educational Experiences"?
Educational experience goes beyond just textbooks or storybooks.
It involves interactive activities like teacher-led readings, student read-alouds, independent reading, discussions about content, and sharing views on themes. These activities turn content into valuable learning experiences. The more varied these experiences, the more effective the education.
Current iterations of SEEDS touchpoints and how they fit together to expand access to a diverse set of educational experiences to CVIs
Touchpoint 1: IVR via Feature Phones
IVR - Interactive Voice Response
A technology that allows computers to interact with humans through voice commands and keypresses, often used in call centers to route calls and provide automated services.
Via IVR we aim to provide:
-
24/7 independent access to content for students
-
Varied experiences
IVR User Experience
Secondary features:
8 => repeat current menu
9 => to go to the previous menu (in an experience)
0 => help when in experience (guide to audio control commands)
Why Feature Phones?
Feature phones are better than smartphones for our target community.
-
Tactile - smaller learning curve for CVIs
-
Includes screen reader - accessible
-
Cost-effective - suits our demographic
-
Robust
-
Longer battery life
Touchpoint 2: Android Application for Teachers
Android Application
An app used to conduct educational group calls between teachers and students. These calls are initiated by the teacher by using the app and received by the students on feature phones. We used Android because it is more widely used among teacher population in India.
Via teacher app we aim to provide:
-
Teachers a mean to communicate with their students remotely
-
A simple interface to view all the content available
Experience flow
I began by outlining the information architecture through iterations on the experience flows. The flow presented here is the fourth and current iteration of the application. Earlier iterations were rapid prototypes with an iterative design approach. This iteration represents the latest version of the flow.
Wireframes
I created paper wireframes with relevant information present in it. With SEEDS we had to take the application to the high fidelity version for testing the talk back efficiency and ease of use for TVIs who are also novice technology users.
Style Guide
I adhered to the WCAG guidelines to ensure the visual identity and colors used are accessible, achieving AAA compliance. The overall design follows the POUR principles, ensuring a high level of accessibility.
Interface Design
Allow teachers to reach their students via call through an android application. Teacher can manage the class efficiently with minimal clicks and can also appoint a leader to manage the class if she gets temporarily absent.
Leaders and their powers
The teacher can also select a student leader. The leader has additional control over certain aspects of the call using specific number key presses.
These controls are implemented to allow the leader to moderate the class in case the teacher becomes temporarily unavailable.
Touchpoint 3: Content Management Website
CRUD website
Enables users to add, view, modify, and delete content as needed.
Via content management website we aim to provide:
-
Enable teachers to manages content on IVR system and teacher app
-
Understand independent IVR usage by students
Website Design
The home page lets teachers to view all the content that is available on SEEDS. For each content there is an option to edit view and delete.
This page lets teacher fill in all the details related to their content and upload it on SEEDS.
This page lets teacher fill in all the details related to their content and upload it on SEEDS.
The home page lets teachers to view all the content that is available on SEEDS. For each content there is an option to edit view and delete.
-
Each piece of content is labeled by its language and type for clear categorization.
-
The display of language and corresponding content aids visually impaired users when using a screen reader.
-
The website also specifies the exact location, such as the Teacher App (TA) and IVR, where each content item is available.
Usage Scenarios
Diverse use cases of interactions across space and time by TVIs and CVIs derived from the learnings of the formative study.
Scenario 1: Fully In-person
Both the teacher and the students are in the same physical space.
The platform allows the teacher to access and deliver a variety of experiences by using the Teacher App on their Android phone. The phone is connected to an external speaker, either wired or via Bluetooth, enabling all students to hear the content.
The students interact with the teacher as they would in a traditional classroom setting.
Scenario 2: Remote Teacher
The students are gathered in a classroom while the teacher is in a remote location. The teacher uses the Teacher App to connect to a feature phone held by a designated student (‘class monitor’) in the classroom.
This feature phone is connected to an external speaker, allowing all students to listen to the audio.
The class monitor mediates the conversation between the students and the remote teacher, facilitating a guided learning experience.
Scenario 3: Autonomous Student Mode
An individual student independently accesses and engages with the curated
experiences from their home or school residence.
There is no involvement of a teacher or an Android App, and the student directly interacts with the digital experiences through the IVR system.
Scenario 4: Fully Remote
The teacher and students are in different locations. The teacher uses the Teacher App to initiate a conference call, delivering educational experiences to students on feature phones for interactive learning.
Summer Pilot
To address the research questions and to evaluate SEEDS we conducted a mixed-method study over a structured 7-week summer program
Study Details
-
Involved 29 CVIs from 5 schools in Karnataka, India.
-
Program carried out by 5 teachers (3 sighted and 2 visually impaired) affiliated with Vision Empower Trust.
-
Conducted semi-structured interviews with the five teachers following the program's conclusion.
-
130 sessions spanning a duration of 97 hours
Findings
1. Collaborative Teaching Environment
-
Teachers considered the summer program successful based on student engagement and enthusiasm.
-
They faced challenges such as frequent call drops, background noise, and technical issues with the SEEDS app.
-
Teachers adapted to remote teaching using calls and the SEEDS app, finding creative ways to manage and engage students.
-
They shared insights on optimal classroom sizes, the use of feature phones, and the importance of preparation for future iterations of the program.
2. Student Engagement
-
Eagerness in answering questions and engaging in discussions.
-
Students proactively asked to share their input
-
Informing the teacher when a peer had disconnected.
-
Students requesting homework.
-
The students also sought assistance from parents and neighbors to complete it.
3. Challenges
-
Internet connectivity issue
-
Students disconnecting mid-call
-
Gauging student comprehension over call
Future Directions
-
Include Braille into the platform
-
Personalised IVR
-
Audio based feature phone games
-
Children generated content
-
GenAI based content creation
Current status of the project
We have onboarded 2 schools in Tripura and 9 in Karnataka
We have tested SEEDS with 20 students and planning another study with 42 students and 13 facilitators this (April - May 2024) summer!
We have received positive response from the students and facilitators and our research paper on the same has been accepted to COMPASS 2024!
My Learnings
-
Deepened my understanding of accessible design, focusing on the POUR principles and their implementation in design.
-
Developed interpersonal skills by overcoming language barriers with CVIs and building a bond, becoming their 'Akka' (elder sister) in the process. :)
-
Navigated the design-to-development process for the first time, learning the intricacies of transferring and communicating between design and development teams.