HUAWEI LAUNCHES STORYSIGN A UNIQUE AI-POWERED APP FOR THE DEAF AND HARD OF HEARING CHILDREN
Huawei uses thepower of AI to help deaf children and their parents learn and enjoy readingtogether
Sydney – Australia
Huawei Aurtralia has today announced the launch of StorySign, an AI-powered app that helps enriching story time for deaf and hard of hearing children and their parents. This follows the global announcement earlier this month. There are approximately 32 millions deaf children globally and around 250-400 deaf children are born in Australia each year*. Many struggled to learn to read, often due to lack of options that help bridge sign language learning and reading. StorySign uses the power of Huawei’s AI (Artifical Intelligence) to create an authenthic reading experience, helping to open the world of books to deaf children and their families.
Pioneered by Huawei and available in Australia from February 2018. StorySign will feature the popular children’s book, Where’s Spot at launch. With the help of StorySign’s friendly avatar Star and using the power of Huawei AI, the app translates the featre book into perfect sign language page by page delivering a seamless, happy and rewarding experience.
“At Huawei, we believe in the power of AI and that technology can make a positive difference in the world,’ comments Lisa Connors, Huawei Australia Corporate Responsibility Manager. “we created StorySign to help make it possible for families with deaf children to enjoy the truly magical moments of story time. Created with experts and charaties from the Deaf community. StorySign was developed to ensure its use as a genuinely useful tool for families with deaf and hard of hearing children.”
Huawei Australia has entered a six-month partnership with local charity organisation, Deaf Australia, to encourage support and donation for those affected. Through this partnership, Huawei will offer the StorySign app to the Australian Deaf Commuinty and aim to raise awareness of deaf literacy more broadly.
“Deaf children don’t learn to read in the same way as hearing children. Many struggle to learn how to read because they can’t match words with sounds. The deaf communityis in need of accessible content to address children’s literacy development needs and digital tools like StorySign is addressing this neccesity. For this reason, we are priviledged to be working with Huawei on the StorySign project and how, through the use of AI and innovative technology, it could enrich the lives of Australian deaf children and their families in a meaningful ways.’ comments Kyle Miers, Chief Executive of Deaf Australia.
“We are very hopeful that it will make a significant impact in the deaf community, helping more deaf children learn how to read at the same level as hearing children. We also hope the launch of StorySign will support a wider conversation about ensuring equality in every aspect of their lives for deaf people.” says Mark Wheatley, Executive Director of European Union of Deaf.
Sign has no written form as there is no direct English word-for-word translation, which poses a huge challenge to deaf children when learning to read. Huawei’s StorySign app, in conjunction with smartphone and physical book, delivers a magical story time experience for both parent and child.
Created with experts and charities from the deaf community across Europe and Australia, StorySign uses Huawei AI powerful Image Recognition and Optical Character Recognition (OCR) to provide greater accuracy even when the child or parent positions the phone at an angle from the book. The AI further optimises the speed at which pages from othe book loads in the app meaning that children won’t be left waiting too long to find out what happens next in the story.
StorySign launches in Australia with a film by Academy Award winner director Chris Overton and starring seven year-old actress Maisie Sly, both of whom worked on Oscar- winning short film The Silent Child. The StorySign film sees a young girl struggling to read with her father on Christmas Eve. Later that night, when she sneaks downstairs to peek at her present, she is stunned to see Santa who hands her a book for a gift. Upon realising that the little girl is deaf, Santa begin to sign the book and in that moment, she is the happiest little girl in the world, as he helps her enjoy the magic of story time.
Partners involved in the app development include Deaf Australia, European Union of the Deaf and its local charities across Western Europe, publishing partner Penguin and the acclaimed animation specialists of Wallace & Grommit fame, Aardman.
“When creating Star, the character for StorySign, we first had to immerse outselves in the world of sign lamguage,’ comments Neil Pymer, Interactive Creative Director, Aardman. “The complexity we found is overwhelming, so we needed to make sure that we created a character that not only resonated with the audience but also fulfilled it main job of teaching children to read. For example, we learned that facial expression play a critical role in sign language, so we created a character to embody that expressivity. At the same time, Star was designed to seem like an older sibling, somebody who will guide you through the book. Seeing the reactions of children when realising that Star signs the words in the book is something very special indeed.”
StorySign can be downloaded for free from Google Play and the Huawei AppGallery in 10 markets across Western Europe. It will be made available in Australia from February 2019 with compatibility with Auslan.
To watch film and learn how you can help, visit www.storysign.com. Donations can be made through via StorySign campaign hub on the Huawei website. All monies raised will support deaf children literacy projects across Europe and in Australia. including more books for StorySigm.