[community] Gloves that Translate ASL to Speech

Fri Jun 3 18:00:00 UTC 2016

Hi Roland,

I'm currently doing some development, and explorations into VR/AR
technologies and I'm curious about the tracking platform you mentioned! Do
you have any links or additional information on the project?

talk soon,
-Edgar

On Thu, Jun 2, 2016 at 9:05 AM, Foster, Julia <jfoster at ocadu.ca> wrote:

> Forwarding Roland's response, which just went to me I think.  They have a
> lab that can work on this type of technology ... see below.
>
> -----Original Message-----
> From: Roland Van Oostveen [mailto:ROLAND.VANOOSTVEEN at uoit.ca]
> Sent: June-01-16 7:38 PM
> To: Foster, Julia <jfoster at ocadu.ca>
> Subject: Re: [community] Gloves that Translate ASL to Speech
>
> Hi All,
>
> We have the capacity and affordances available to do video capture(s) (we
> can do 4 synchronized streams at this point) along with facial expression
> recognition and eye tracking at the EILab at UOIT, if someone is interested
> in pursuing these ideas.
>
> Keep them coming.
>
> Cheers,
>
> Roland van Oostveen
> Director, Educational Informatics Laboratory (http://eilab.ca) University
> of Ontario Institute of Technology
>
> > On Jun 1, 2016, at 15:51, Foster, Julia <jfoster at ocadu.ca> wrote:
> >
> > Thanks for adding that technology Gio. Regarding the point on the gloves
> not being necessary because of it, I feel that the invention of one
> technology that addresses a communication barrier or other access need
> doesn't mean that another technology that does a similar function isn't
> merited. For example, maybe someone doesn't want to be captured on camera
> for modesty or camera-shy or technology distrust reasons. I might be
> grasping at straws with that one, but there are always contexts that merit
> alternatives.
> >
> > Plus, competition hopefully pushes innovation / quality forward. Perhaps
> the video capture paired with gloves could be even more accurate as the
> gloves might catch subtle movements related to depth (i.e. forward and away
> from a user) that aren't captured by video. And perhaps re: Taliesan's and
> Tara's comments about facial expressions, adding a function that captures
> feeling / grammar from facial expressions could further add to the accuracy
> of the message being communicated. Arguably something that interprets
> facial expressions would be useful for many individuals for various
> reasons.  Like me, if I'm tired and am not picking up on as many social
> cues. Or someone who can't see facial details for one reason or another. Or
> someone talking by phone or skype with a lousy video connection. Etc.
> >
> > Have a good night,
> > Julia
> >
> > -----Original Message-----
> > From: community [mailto:community-bounces at lists.idrc.ocadu.ca] On
> > Behalf Of Taliesin Love Smith
> > Sent: June-01-16 5:46 PM
> > To: Mitchell, Jess <jmitchell at ocadu.ca>
> > Cc: Inclusive Design Community <community at lists.idrc.ocadu.ca>
> > Subject: Re: [community] Gloves that Translate ASL to Speech
> >
> > Yes, I agree, great points that all bring to mind the three principles
> of Inclusive Design!
> >
> > 1. Recognize diversity and uniqueness
> > 2. Inclusive tools and process
> > 3. Broader beneficial impact
> >
> > Lovin' the list.
> > Taliesin
> >
> > On Wed, Jun 1, 2016 at 6:39 PM, Mitchell, Jess <jmitchell at ocadu.ca>
> wrote:
> >
> >> This is incredible. Thanks for sharing these links.
> >> And a great convo about the original link!
> >>
> >> Jess
> >>
> >>
> >> ~~~~~~~~~~~~~~~~~~~~~~
> >> Jess Mitchell
> >> GMT - 4:00
> >> +1.416.977.6000 x.3965
> >> Senior Manager, R&D + Design
> >> OCAD University, Toronto
> >> Inclusive Design Research Centre
> >> jmitchell at ocadu.ca
> >> skype: jesshmitchell
> >> http://idrc.ocad.ca/
> >> http://inclusivedesign.ca/
> >> http://fluidproject.org
> >> ~~~~~~~~~~~~~~~~~~~~~~
> >>
> >>> On Jun 1, 2016, at 4:18 PM, Tirloni, Giovanni <gtirloni at ocadu.ca>
> wrote:
> >>>
> >>> The gloves don't seem necessary with the advances in image
> >>> processing
> >> and deep learning.
> >>>
> >>> For example, this prototype from Microsoft Research uses the Kinect
> >>> to
> >> capture/understand the images and translate between different sign
> >> languages:
> >>>
> >>>
> >> http://research.microsoft.com/en-us/collaboration/stories/kinect-sign
> >> -
> >> language-translator.aspx
> >>>
> >>> Video:
> >>> http://research.microsoft.com/apps/video/default.aspx?id=204170
> >>>
> >>>
> >>>> -----Original Message-----
> >>>> From: community [mailto:community-bounces at lists.idrc.ocadu.ca] On
> >> Behalf Of
> >>>> Foster, Julia
> >>>> Sent: Wednesday, June 1, 2016 4:55 PM
> >>>> To: 'Inclusive Design Community' <community at lists.idrc.ocadu.ca>
> >>>> Subject: Re: [community] Gloves that Translate ASL to Speech
> >>>>
> >>>> I'm speaking as someone who does not use ASL and does not know much
> >> more than
> >>>> some basics, but like every technology, I think it's very
> >> person-dependent. I agree we
> >>>> can't generalize and say this technology is amazing for the whole
> >>>> deaf
> >> community
> >>>> and would be welcomed and appropriate in all contexts. But I also
> >>>> think
> >> it's a pretty
> >>>> cool technology that has potential to be useful if someone wanted
> >>>> to
> >> have the ability
> >>>> to convert sign to speech.
> >>>>
> >>>> I could see that the grammar via facial expressions may differ
> >>>> between
> >> the deaf and
> >>>> deaf-blind community though I do not know one way or the other if
> >>>> this
> >> is true. But it
> >>>> also could differ significantly within the each group as well. I
> >>>> don't
> >> know enough
> >>>> about ASL to understand how grammar is conveyed through the face,
> >>>> but
> >> arguably,
> >>>> most individuals convey a significant amount of the message through
> >> their facial
> >>>> expressions as well whether they use their voice or an augmentative
> >> communication
> >>>> device (though users who speak with their own vocal cords often
> >>>> have
> >> some control
> >>>> over intonation, volume, and other voice characteristics).
> >>>>
> >>>> As a thought -- perhaps this technology could also be viewed as for
> >>>> the
> >> listener, not
> >>>> the signer. Perhaps this type of technology could be purchased by
> >> banks, large chain
> >>>> stores, libraries, etc. to act in place of a translator for their
> >>>> staff
> >> when clients who use
> >>>> sign language are on site -- if they are comfortable wearing a pair
> >>>> of
> >> gloves. (Obvious
> >>>> logistical problems include hand size). It kind of seems like a
> >>>> Babel
> >> fish for sign
> >>>> language for anyone who has read Hitchiker's Guide to the Galaxy.
> >>>>
> >>>> Have a good day,
> >>>> Julia
> >>>>
> >>>>
> >>>> Julia Foster, MScOT, OT Reg. (Ont.) Coordinator, Vision Technology
> >>>> Service & SNOW Inclusive Design Research Centre
> >>>> 205 Richmond ST. W., 2nd Floor, Toronto, ON M5V 1V3
> >>>>
> >>>> Telephone: 416 977 6000 x3966
> >>>> Fax: 416 977 9844
> >>>> Email: jfoster at ocadu.ca
> >>>>
> >>>> Vision Technology Service
> >>>> Employment Accommodation Service
> >>>> SNOW - Education, Access and You!
> >>>> Follow SNOW on Twitter & Facebook!
> >>>>
> >>>> OCAD University
> >>>>
> >>>> Confidentiality Notice:  This e-mail message is intended only for
> >>>> the
> >> named
> >>>> recipient(s) above and may contain information that is
> >> privileged,confidential and/or
> >>>> exempt from disclosure under law.  If you are not the intended
> >> recipient(s), any
> >>>> disclosure, copying or distribution of this information or action
> >>>> taken
> >> in reliance on
> >>>> this information is strictly prohibited by the Municipal Freedom of
> >> Information and
> >>>> Protection of Privacy Act and/or Personal Health Information
> >>>> Protection
> >> Act.   If you
> >>>> have received this message in error, or are not the named
> >>>> recipient(s),
> >> please notify
> >>>> the sender immediately by reply e-mail and delete this message.
> >>>> Thank
> >> you for your
> >>>> co-operation.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> -----Original Message-----
> >>>> From: community [mailto:community-bounces at lists.idrc.ocadu.ca] On
> >> Behalf Of
> >>>> D'Intino, Pina
> >>>> Sent: June-01-16 3:13 PM
> >>>> To: Tara Robertson <trobertson at langara.ca>; 'Taliesin Smith' <
> >> talilief at gmail.com>;
> >>>> 'Inclusive Design Community' <community at lists.idrc.ocadu.ca>
> >>>> Subject: Re: [community] Gloves that Translate ASL to Speech
> >>>>
> >>>> I wonder thought if the same thoughts would apply to someone  who
> >>>> is
> >> deaf/blind?
> >>>>
> >>>> -----Original Message-----
> >>>> From: community [mailto:community-bounces at lists.idrc.ocadu.ca] On
> >> Behalf Of Tara
> >>>> Robertson
> >>>> Sent: Wednesday, June 01, 2016 2:57 PM
> >>>> To: 'Taliesin Smith'; 'Inclusive Design Community'
> >>>> Subject: Re: [community] Gloves that Translate ASL to Speach
> >>>>
> >>>> Here's an article that critiques this technology. In particular, I
> >>>> love
> >> this
> >>>> quote: "Deaf people are viewed as a liability in terms of
> >> communication, when in
> >>>> reality, the opposite is true. We are the experts at communication.
> >>>> From living in a society that constantly demands observation and
> >> improvisation of us,
> >>>> we have learned how to communicate in countless ways."
> >>>>
> >> http://www.theestablishment.co/2016/05/11/deaf-people-dont-need-new-c
> >> o
> >> mmunic
> >>>> ation-tools-everyone-else-does/
> >>>>
> >>>> One of the Queer ASL instructors also pointed out that so much
> >>>> grammar
> >> happens in
> >>>> the face, so this technology is both inappropriate and flawed.
> >>>>
> >>>> Tara
> >>>>
> >>>> -----Original Message-----
> >>>> From: community [mailto:community-bounces at lists.idrc.ocadu.ca] On
> >> Behalf Of
> >>>> Taliesin Smith
> >>>> Sent: June-01-16 11:35 AM
> >>>> To: Inclusive Design Community
> >>>> Subject: [community] Gloves that Translate ASL to Speach
> >>>>
> >>>> Two undergraduate students team up to invent SignAloud. A set of
> >>>> gloves
> >> that
> >>>> converts ASL signs to speech.
> >>>>
> >>>> They have won the Lemelson-MIT Student Prize:
> >>>>
> >>>> Story at the following link:
> >>>> http://www.washington.edu/news/2016/04/12/uw-undergraduate-team-win
> >>>> s-
> >>>> 10000-l
> >>>> emelson-mit-student-prize-for-gloves-that-translate-sign-language/
> >>>>
> >>>> Taliesin
> >>>> ________________________________________
> >>>> Inclusive Design Community (community at lists.idrc.ocadu.ca) To
> >>>> manage
> >> your
> >>>> subscription, please visit:
> >>>> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>>>
> >>>> ________________________________________
> >>>> Inclusive Design Community (community at lists.idrc.ocadu.ca) To
> >>>> manage
> >> your
> >>>> subscription, please visit:
> >> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>>>
> >>>> To unsubscribe from receiving further commercial electronic
> >>>> messages
> >> from The Bank
> >>>> of Nova Scotia in Canada, please click here:
> >>>> https://unsubscribe.scotiabank.com?entid=BNS&buid=SBNK
> >>>>
> >>>> To unsubscribe from receiving further commercial electronic
> >>>> messages
> >> from certain
> >>>> other senders set out in the attached list, please click here:
> >>>> https://www.unsubscribe.gwm.scotiabank.com?page=gwm
> >>>>
> >>>> This email may contain confidential information the use of which by
> >>>> an
> >> unintended
> >>>> recipient is unauthorized. This email may also contain important
> >> disclosure
> >>>> information for the records of the intended recipient(s).  For
> >>>> details
> >> please click here:
> >>>> http://www.scotiabank.com/email_disclaimer/email_english.html
> >>>>
> >>>> Pour vous désabonner et cesser de recevoir des messages
> >>>> électroniques
> >> commerciaux
> >>>> de La Banque de Nouvelle-Écosse, veuillez cliquer ici :
> >>>> https://desabonnement.banquescotia.com?entid=BNS&buid=SBNK
> >>>>
> >>>> Pour vous désabonner et cesser de recevoir des messages
> >>>> électroniques
> >> commerciaux
> >>>> de certains autres expéditeurs figurant dans la liste ci-jointe,
> >> veuillez cliquer ici :
> >>>> https://www.unsubscribe.gwm.scotiabank.com?page=gwm&lang=fr
> >>>>
> >>>> Cette transmission peut contenir de l'information confidentielle et
> >>>> son
> >> utilisation par
> >>>> toute personne autre que la personne à laquelle cette transmission
> >>>> est
> >> destinée est
> >>>> interdite. Le présent courriel peut aussi contenir des
> >>>> renseignements
> >> importants pour
> >>>> les dossiers du ou des destinataires prévus.  Pour plus de détails,
> >> veuillez vous diriger
> >>>> vers:
> >>>> http://www.scotiabank.com/email_disclaimer/email_francais.html
> >>>>
> >>>> Para dejar de recibir mensajes electrónicos comerciales de The Bank
> >>>> of
> >> Nova Scotia en
> >>>> Canadá, haga clic aquí:
> >>>> https://cancelarsuscripcion.scotiabank.com?entid=BNS&buid=SBNK
> >>>>
> >>>> Para dejar de recibir mensajes electrónicos comerciales de otras
> >> entidades incluidas
> >>>> en la lista adjunta, haga clic aquí:
> >>>> https://www.unsubscribe.gwm.scotiabank.com?page=gwm&lang=es
> >>>>
> >>>> Este correo electrónico puede contener información confidencial
> >>>> cuyo
> >> uso por parte de
> >>>> personas distintas de los destinatarios del mismo está prohibido.
> >>>> El
> >> mensaje puede
> >>>> tener también datos importantes para los archivos   del(de los)
> >> destinatario(s) a
> >>>> quien(es) está dirigido.  Para más detalles, por favor dirigirse a:
> >>>> http://www.scotiabank.com/email_disclaimer/email_espanol.html
> >>>> ________________________________________
> >>>> Inclusive Design Community (community at lists.idrc.ocadu.ca) To
> >>>> manage
> >> your
> >>>> subscription, please visit:
> >> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>>> ________________________________________
> >>>> Inclusive Design Community (community at lists.idrc.ocadu.ca) To
> >>>> manage your subscription, please visit:
> >>>> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>> ________________________________________
> >>> Inclusive Design Community (community at lists.idrc.ocadu.ca) To manage
> >>> your subscription, please visit:
> >> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>
> >> ________________________________________
> >> Inclusive Design Community (community at lists.idrc.ocadu.ca) To manage
> >> your subscription, please visit:
> >> http://lists.idrc.ocadu.ca/mailman/listinfo/community
> >>
> > ________________________________________
> > Inclusive Design Community (community at lists.idrc.ocadu.ca) To manage
> > your subscription, please visit:
> > http://lists.idrc.ocadu.ca/mailman/listinfo/community
> > ________________________________________
> > Inclusive Design Community (community at lists.idrc.ocadu.ca) To manage
> > your subscription, please visit:
> > http://lists.idrc.ocadu.ca/mailman/listinfo/community
>
> Roland van Oostveen, Ph.D.
> Director, Educational Informatics Laboratory (EILab.ca)
> Email: roland.vanoostveen at uoit.ca
> Web: http://eilab.ca
>
>
> ________________________________________
> Inclusive Design Community (community at lists.idrc.ocadu.ca)
> To manage your subscription, please visit:
> http://lists.idrc.ocadu.ca/mailman/listinfo/community
>