Presentation 5
0034
 

Symposium
Presentation
0033


1
ABSTRACT

2
VIDEO

3
SLIDES

4
PAPER

5
AUTHORS

SignWriting in Software

“A proposal for the recognition
of handwritten SignWriting
for the SWORD project”


by
Fabrizio Borgia
and
Maria De Marsico



1 ABSTRACT

A proposal for the recognition of
handwritten SignWriting for the SWORD project

by
Fabrizio Borgia
Dep. of Computer Science
“Sapienza” University of Rome
Via Salaria 113 ‑ 00198 ROME ‑ ITALY
fabrizio.borgia@uniroma1.it

and
Maria De Marsico

Dep. of Computer Science
“Sapienza” University of Rome
Via Salaria 113 ‑ 00198 ROME ‑ ITALY
demarsico@di.uniroma1.it

Despite their increasing capabilities, SW [1] digital editors (SW-DEs) are far from granting the user a sign-composition interface capable of challenging the simplicity of the pen-based handwriting approach.

At present, any SW-DE developed so far relies heavily on “Windows, Icons, Menus, Pointer” (WIMP) interfaces. Working with deaf people for many years, we observed that SW users are far more accurate, fast and comfortable when using the paper-pencil approach, than when dealing with the (more or less) complex interaction style of a SW-DE.

Observing the state of the art in SW-DEs, we laid the foundation for SWORD (SignWriting Oriented Resources for the Deaf), a project towards the full integration of deaf people in the digital society. SWift [2] [3], a new SW-DE, was produced within SWORD, but it still carries most intrinsic shortcomings of its peers, including the strict dependency on WIMP interfaces.

Within SWORD, we also conceived a new generation of SW-DEs, able to partially overcome the concept of the WIMP interface and to move along the line of the so-called “natural interfaces” [4]. The new tools are meant to relieve the user from burdens related to clicking, dragging, browsing on the User Interface (UI) during the SW production process, and to provide an interaction style which is as similar as possible to the handwriting approach.

Of course, since WIMP is currently the most common interface style, it cannot be totally left behind, because the interaction with most application is still firmly grounded on it. Nevertheless, our aim is to limit its use, or to dismiss it whenever possible, during the SW production process, which is the core part of any SW-DE. To achieve this goal, we are designing and implementing a SignWriting Optical Glyph Recognition (SW-OGR) engine (Fig. 1). Its aim is to perform the electronic conversion (recognition) of user-produced images containing handwritten (or printed) SW glyphs into machine-encoded (via ISWA) SW texts [5]. Such texts can be stored using the same formats of the documents produced by SWift, and therefore allow the same statistical and linguistic analyses. In particular, introducing a SW-OGR engine within an existing SW editor, such as SWift, will allow the user to handwrite symbols on the composition area, rather than searching them among thousands other symbols. Each handwritten symbol will be processed and replaced with its standard ISWA version by SW-OGR.


Fig. 1: Screenshot taken from SW-OGR during the development phase (ongoing). The image shows a handwritten text (courtesy of ISTC-CNR) and the result
of the detection routine for the head symbols

The main difference between OCR and OGR is in the nature of SW: SW is composed by an extremely high number of symbols (about 38,000, compared with 26 letters of the Latin alphabet) in a multilinear/two-dimensional arrangement, without rigid rules for such composition and with a complex segmentation, particularly when handwritten. Due to the large amount of patterns to recognize, and consequently to the overwhelming training required, it is not feasible to exploit traditional pattern-matching or machine-learning approaches. Therefore we are adopting an approach based on geometric and spatial features of the glyphs.


[1] Sutton, V. (n.d.). SignWriting for Sign Languages. Retrieved from http://www.signwriting.org/ on November 13, 2013.

[2] Bianchini, C.S., Borgia, F., Bottoni, P., De Marsico, M. (2012). SWift - A SignWriting improved fast transcriber. In Proceedings of AVI2012 (Capri, 21-25 May 2012).

[3] Bianchini, C.S., Borgia, F., De Marsico, M. (2012). SWift - A SignWriting editor to bridge between deaf world and e-learning. In Proceedings of ICALT2012 (Rome, 7-10 July 2012).

[4] van Dam, A. (1997). Post-WIMP User Interfaces. Commun. ACM 40(2), 63–67.

[5] Borgia, F. (Exp. 2014). Informatisation de forme graphique des Langues des Signes: application à l’écriture de SignWriting. PhD thesis, Universitè Toulouse III - Paul Sabatier, Toulouse, France.

...download PDF...

...download MSWord doc...


Related Links

SWift - A SignWriting Editor to
Bridge between Deaf World and E-learning

The SWift SignWriting Editor
Use the Program in Firefox Web Browser Only

 

2 VIDEO
 
3 SLIDES
 

4 PAPERS

download pdf

PDF of SLIDES:

“SW-OGR Handwriting
Recognition”


by
Borgia
& De Marsico

 
5 AUTHORS
Fabrizio Borgia Fabrizio Borgia

Dep. of Computer Science
“Sapienza” University of Rome
Via Salaria 113 ‑ 00198 ROME ‑ ITALY

Download Biography
 
Maria De Marsico Maria De Marsico

Dep. of Computer Science
“Sapienza” University of Rome
Via Salaria 113 ‑ 00198 ROME ‑ ITALY

Download Biography
 



 


For more information, contact:

Valerie Sutton

SWS-2014 Chair

Steve Slevinski
SWS-2014 Chair

Adam Frost
SWS-2014 Chair

Nancy Romero
SWS-2014 Chair

SignWriting Symposium Submissions
symposium@signwriting.org

SignWriting Symposium 2014 Web Page
http://www.signwriting.org/symposium/2014

SignWriting Symposium 2014 on Facebook
https://www.facebook.com/signwritingmeetup


 




Presentation 5
0034

 

 

Search Google


Google
Web www.SignWriting.org
www.SignBank.org www.MovementWriting.org

 

Webmaster: Valerie Sutton
Sutton@SignWriting.org

Argentina
Bolivia
Great Britain
Canada
Czech Republic
Ethiopia
Flanders
Germany
Italy
Ireland
Japan
Malaysia
Malawi
Malta
Mexico
Nicaragua
Norway
Paraguay
Philippines
Poland
Portugal
Slovenia
Spain
Switzerland
Taiwan
Tunisia
Uruguay
Venezuela
SignWriting Symposium
Videos
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
SignWriting Symposium 2015
SignWriting
Symposium
Home
SignWriting on YouTube
SignWriting
Symposium
on YouTube
Search by Authors
Search by
Authors

Search by Categories
Search by
Categories


Search by Presentation List
Search by
List of
Presentations

View 64
Presentation
Web Pages

including
papers, slides,
bios & videos
.
See below:
2014
2014
Presentations
2014
Presentation 1

SWORD Project
Research
Italy & France
Bianchini & Borgia
2014
Presentation 2
Wöhrmann's
SpeechWriting
Education, Germany
Stefan Wöhrmann
2014
Presentation 3
SW Handwriting
Write SW by Hand
Education, USA
Adam Frost
2014
Presentation 4
SWift Digital
Editor, Software,
Italy & France
Borgia, Bianchini
& Marsico
2014
Presentation 5
Deaf Child Literacy
Research, Brazil
Marianne Stumpf
2014
Presentation 6
Deaf Literacy
with SignWriting
Education, Paraguay
Mirta Barreto
2014
Presentation 7
New Testament
in Written ASL
Literature, USA
Nancy Romero
2014
Presentation 8
Writing 48 Articles
in ASL Wikipedia
Literature, USA
Nancy Romero
2014
Presentation 9
A Decade of
Teaching ASL
using SignWriting
Education, USA
Natasha Westland
2014
Presentation 10
Ordering Signs
in Dictionaries
Education, USA
Charles Butler Neto
2014
Presentation 11
SignPuddle
Standard
Software, USA
Steve Slevinski
2014
Presentation 12
DELEGS-Editor
in Classroom
Education,
Germany
Stefan Wöhrmann
2014
Presentation 13
SignWriter Studio
Software, Honduras
Jonathan Duncan
2014
Presentation 14
Alternative
ISWA 2010 Fonts
Software, Honduras
Jonathan Duncan
2014
Presentation 15
SignWriting in Deaf
Education, Tunisia
Balti, Bahri & Laajili
2014
Presentation 16
Deaf Communication
Education, Brazil
Faulstich, Júnior
& Patrícia Santos
2014
Presentation 17
SignWriting Teachers
Education, Brazil
Barreto, Souza,
Nascimento & Coelho
2014
Presentation 18
Deaf Perspectives
Education, Brazil
Barreto, Souza,
Nascimento & Coelho

2014
Presentation 19
TrueType in Graphite
Software, USA
Steve Slevinski

2014
Presentation 20
Sign Animating
Education, Canada
André Lemyre
2014
Presentation 21
SignWriting App
Software, USA
Jake Chasan
2014
Presentation 22
Children's Books
Literature, Portugal
Rafa Cota Silva
2014
Presentation 23
TuniSigner Avatar
Software, Tunisia
Bouzid & Jemni
2014
Presentation 24
Deaf Ed in Brazil
Education, Brazil
Stumpf & Barreto
2014
Presentation 25
Reading SignWriting
Education, Brazil
Débora Wanderley
2014
Presentation 26
SW Online Course
Education, Brazil
Barreto, Pereira
& Barbosa
2014
Presentation 27
Film Online Course
Education, Brazil
Barreto & Goulart
2014
Presentation 28
Language Analysis
Research USA
Erika Hoffmann
2014
Presentation 29
SW in Deaf Schools
Education, USA
Denny Voreck
2014
Presentation 30
SignWriting App
Education, USA
Elena Eroshkin
2014
Presentation 31
Digital SW Texts
Software, USA
Steve Slevinski
2014
Presentation 32
SW & Phonology
Research, Brazil
Costa & Barreto
2014
Presentation 33
SW-OGR
Software, Italy
Borgia & Marsico
2014
Presentation 34
SignWriting in
Catholic Liturgy
Education, Slovenia
Edi Strouhal
2014
Presentation 35
Escrita de Sinais
Education, Brazil
Barreto & Barreto

2014
Presentation 36

SW Terminolgy
Research, Brazil
Lima & Barreto

2014
Presentation 37
SW Translation
Research, Brazil
Barreto & Oliveira
2014
Presentation 38
SignWriting in
Music Scores
Literature, USA
Ron Shalom
2014
Presentation 39
Writing Maltese
Sign Language
Research, Malta
Maria Galea
2014
Presentation 40
40 Years Writing
Sign Languages:
1974-2014
Research, USA
Valerie Sutton
2015
2015
Presentations
2015
Presentation 41
Javascript Keyboard
Software, Canada
Yair Rand
2015
Presentation 42
Teacher's Attitudes
SW in Education
Saudi Arabia
AbuShaira, Mahfooz
2015
Presentation 43
SignWriting Stack
Software, USA
Steve Slevinski
2015
Presentation 44
DELEGS-Editor
Education, Germany
Stefan Wöhrmann
2015
Presentation 45
SignWriting
Electronic
Flashcards
Education, Canada
André Lemyre
2015
Presentation 46
Reading SignWriting
Research, Brazil
Marcos Klüber Kogut
2015
Presentation 47
SignWriting in Classroom
Education, Portugal
Rafa Cota Silva
2015
Presentation 48
SignWriting
Journal System
Software, Brazil 
Brito, Shintaku,
Ramos & Nascimento
2015
Presentation 49
SignMaker 2015
Software, USA
Steve Slevinski
2015
Presentation 50
Nicaraguan
Sign Language
Grammar
Education,Nicaragua
James Shepard-Kegl
2015
Presentation 51
SignWriting Font
Research, Germany
Lentföhr, Nitschke
& Rutrecht
2015
Presentation 52
MemoSign Game
Software, Tunisia
Bouzid, Khenissi
2016
2016
Presentations
2016
Presentation 53
Home For
Deaf Children
Education, Peru
Kristina Tworek
2016
Presentation 54
SignTyp Database
Research, USA
Rachel Channon
2016
Presentation 55
FSW Formal
SignWriting
Software, USA
Steve Slevinski
2016
Presentation 56
SignWriting in
Tunisian Deaf
Education, Tunisia
Laajili & Balti
2016
Presentation 57
Parallel Corpora
Software, Brazil
Alex M. Becker
2016
Presentation 58
Deaf Writing Skills
Education, Portugal
Jorge Manuel Pinto
2016
Presentation 59
Bilingual Deaf
Education, Brazil
Almeida & Júnior
2016
Presentation 60
Bilingual Deaf
Education, Brazil
Daniele Bózoli
2016
Presentation 61
SignWriting
in Unicode
Software, USA
Steve Slevinski
2016
Presentation 62
SignPuddle 3.0
Software, USA
Steve Slevinski
2016
Presentation 63
Peru Sign Dict
Research, Peru
Miguel Mondoñedo
2016
Presentation 64
Sign Wikipedias
Literature, USA
Valerie Sutton
ASL Presentation by
Adam Frost, Jason
Nesmith, Holly Sharer
& the CODA Brothers
Plus special video on
Tunisian Sign Wikipedia
by Mohamed Ali Balti
SignWriting Symposium 2015
SignWriting
Symposium
Home
SignWriting on YouTube
SignWriting
Symposium
on YouTube
Search by Authors
Search by
Authors
Search by Categories
Search by
Categories
Search by Presentation List
Search by
List of
Presentations
2014
Live Streaming
40 Presentations

2014 Live Streaming
2015
Live Streaming
12 Presentations

2015 Live Streaming
2016
Live Streaming
12 Presentations

2016 Live Streaming