Published on 04.01.18 in Vol 5, No 1 (2018): Jan-Mar
Second Version of Google Glass as a Wearable Socio-Affective Aid: Positive School Desirability, High Usability, and Theoretical Framework in a Sample of Children with Autism
Background: Computerized smartglasses are being developed as an assistive technology for daily activities in children and adults with autism spectrum disorder (ASD). While smartglasses may be able to help with educational and behavioral needs, their usability and acceptability in children with ASD is largely unknown. There have been reports of negative social perceptions surrounding smartglasses use in mainstream populations, a concern given that assistive technologies may already carry their own stigma. Children with ASD may also have a range of additional behavioral, developmental, and social challenges when asked to use this emerging technology in school and home settings.
Objective: The usability and acceptability of Glass Enterprise Edition (Glass), the successor to Google Glass smartglasses, were explored in children with ASD and their caregivers.
Methods: Eight children with ASD and their caregivers were recruited to attend a demonstration session with Glass smartglasses the week they were publicly released. The children had a wide range of ability, including limited speech to speaking, and represented a full range of school ages (6 to 17 years). Children and caregivers were interviewed about their experience of using the smartglasses and whether they would use them at school and home.
Results: All 8 children succeeded in using Glass and did not feel stressed (8/8, 100%) or experience any overwhelming sensory or emotional issues during the session (8/8, 100%). All 8 children (8/8, 100%) endorsed that they would be willing to wear and use the device in both home and school settings. Caregivers felt the experience was fun for the children (8/8, 100%), and most caregivers felt the experience was better than they had expected (6/8, 75%).
Conclusions: A wide age and ability range of children with ASD used Glass immediately after it was released and found it to be usable and acceptable. Despite concerns about potential stigma or social acceptability, all of the children were prepared to use the technology in both home and school settings. Encouragingly, most caregivers noted a very positive response. There were no behavioral, developmental, or social- or stigma-related concerns during or after the session. Smartglasses may be a useful future technology for children with ASD and are readily accepted for use by children with ASD and their caregivers.
JMIR Hum Factors 2018;5(1):e1
- digital health;
- augmented reality;
- virtual reality;
- special education
Autism spectrum disorder (ASD) is a childhood-onset developmental disorder, with an estimated 3.5 million people being diagnosable with ASD in the United States alone . Innovative assistive technologies may help to address the unmet educational and therapeutic resource demands of the ASD community [ ]. While there are many different types of assistive technology, the portability, capability, and ubiquity of smartphone and tablet devices has led to considerable growth in assistive apps for these devices [ , ]. More recent technological advances have resulted in lightweight smartglasses: face-worn computers with a visual display and in-built sensors [ - ] that can also deliver assistive apps [ , ].
Smartglasses can deliver a large range of experiences, including augmented and virtual reality . They are also sensor-rich and can collect a wide range of quantitative user data [ , , ]. These data can be monitored and analyzed on a real-time basis, allowing for the smartglasses to dynamically change the user experience to optimize learning—effectively placing the user and the smartglasses in a closed feedback loop [ , , ]. Given the proximity of smartglasses to the sensory organs contained in the human head, this type of computing may enable a higher level of human-computer interaction than other devices [ ]. Smartglasses are already being developed as a social and behavioral communication aid for people with ASD [ , , ].
There are a number of important differentiating factors to consider when smartglasses are compared to handheld devices. Handheld devices such as tablets and smartphones require one or both hands to hold the device and encourage a heads-down posture (A, left) [ ]. Evidence suggests that smartphone use may decrease user awareness of their social and physical environment. This is a particular concern in people with ASD, given that they already often face challenges engaging with the social world around them [ ]. In contrast, head-worn computers pose an advantage in allowing and potentially encouraging children to remain heads-up while using them. This heads-up posture when using smartglasses can allow for better user engagement with people and the social world ( A, right).
Modern Assistive-Reality Smartglasses
The emergence of a new crop of smartglasses is encouraging, especially because the initial public reaction to the widely recognized original Google Glass resulted in some negative social reactions. Modern smartglasses vary in terms of physical dimensions, functionality, and intended user group. For the purposes of this report, we decided to investigate the acceptability and usability of the most recently released lightweight smartglasses, Glass Enterprise Edition (Glass). Glass was released by X (a subsidiary of Alphabet Inc, formerly known as Google X) in July 2017. Glass is an assistive-reality technology, and it is the successor to Google Glass, one of the most recognizable smartglasses in the world . Glass, like its predecessor, is a head-mounted, wearable computer that has demonstrated utility in a variety of situations where operating a computer hands-free and while heads-up is of particular advantage. Glass has been creatively developed as a technology that can deliver social and cognitive skills coaching to children and adults with ASD [ ]. To our knowledge, we have reported on the first studies of ASD-related software on the original Google Glass (Explorer Edition) [ , , , ], and here we present the first appearance of Glass (Enterprise Edition) in the literature.
It would seem that the Enterprise Edition (which has updates to the form factor, usability, central processor, display, audio system, and other features) would represent a substantial advantage for assistive technology apps and algorithms for ASD. However, it remains unknown whether people with ASD would actually desire to wear the new device. Assistive apps for people with ASD on the original Google Glass have been shown to be tolerable , safe [ ], and to reduce hyperactivity in an ASD sample [ , ]. However, small changes in devices can greatly affect the desire of potential users to wear them.
Given that the initial entry of Google Glass and other smartglasses raised privacy concerns and some negative public reaction, the announcement of a major new release of head-worn computing  signaled a potentially major advance for assistive technology targeting populations who traditionally face significant social challenges [ ]. Google Glass was ahead of its time and may have been held back by perceptions around desirability and social acceptability of wearing this new category of device in public [ , ]. It is therefore reassuring to developers that head-worn computer platforms have received public backing from one of the largest companies in the world [ ], in this case the inventor of the product [ ].
Understanding the Needs of People With Autism Spectrum Disorder
As with any assistive technology, it is important to investigate and understand the attitudes of children and young adults with ASD, especially because children with special needs are often forced to use devices and systems they do not actually like or want to be associated with [, ]. This is ultimately less effective because aversion leads to lower adherence. Poor adherence and problems with maintaining lasting engagement are some of the largest issues facing educational devices and apps as well as well-being and lifestyle tools [ , ].
Many people with ASD use assistive technology to help them with communication skills, social and emotional skills, and adaptive/daily activities and living skills . Assistive technologies elicit a range of responses from individuals and their peers, and they can be considered cool [ ], weird, desirable, or a source of stigma [ , ]. Users of assistive technologies can often express a preference for the type of assistive technology that they want to use [ , ], even at a young age [ ]. Additionally, the social acceptability of an assistive technology may be one of the most important elements in determining if that technology gets used by people with developmental disabilities [ , ]. These individuals have often had to use technologies that have been selected for them and their families while having little input to the potential negative image, stigma, or embarrassment of using such technologies [ ]. Understanding and implementing user preference of assistive technologies empowers self-determination in these individuals [ ]. The preferences and views of the family and caregivers of these individuals are also important as they impact the acceptance and effective use of such technologies in the household [ , ]. These issues are pertinent to smartglasses in light of past reports of negative public perception (eg, around privacy concerns [ ]).
There have only been a handful of reports on the use of smartglasses in people with ASD [, , ], and the attitudes toward and acceptability of such devices to people with ASD remains unclear. The use of smartglasses in people with ASD also requires discussion of their potential impact on social communication from a cognitive neuroscience standpoint and their prospective influence on child development from ecological, psychosocial, and cognitive child development theories.
Potential Impact of Smartglasses on Social Communication
The human face, a complex and dynamic system, is our most powerful means of social communication . To successfully transmit social information to another person, the sender must have the mental and physical means of generating a facial and bodily representation of the social information that she or he wishes to send, while the receiver must be in a position to see and decode the facial and bodily representations into social information. The social communication deficits seen in ASD may impede the ability to send and receive social information. People with ASD are reported to have deficits in facial perception [ , ], emotion recognition [ ], eye gaze [ ], and production of facial expressions [ ]. It is important to consider the possibility that social communication may be further impacted by the physical presence of smartglasses on a sender’s face. Smartglasses may impede social communication if, for example, the sender demonstrates a hesitancy in producing natural head movements or expressing large magnitude facial emotional expressions due to concern that the smartglasses may fall off the face or be damaged. Smartglasses may also impair social interaction if the user feels the assistive device is socially undesirable [ ] or a source of stigma [ ]. In these situations, users may not use the device or may alter their facial and bodily actions to minimize attention to themselves. Furthermore, the physical form factor of smartglasses may obscure a portion of the wearer’s face that is visible to others, especially the central information-rich parts of the face such as the eye regions [ ].
The relative effect of this obscuring of the facial region may be dependent on the size of the individual’s face relative to the smartglasses, which may correlate with the age of the individual given that biologic age determines an individual’s head size . It may also depend on the ability of the receiver to successfully compensate for partly missing facial data and to make inferences about a sender (a common application of this in ASD research is the “Reading the Eyes in the Mind” test [ ]). Since people with and without ASD find it more difficult to read the facial emotional expressions of people with ASD [ ], it is conceivable that further obscuring the amount of visible facial information could make the interaction even more arduous. This point may be particularly relevant to interactions between people with ASD and their unaffected family members. ASD is a highly hereditable condition with a complex genetic basis [ ], and many unaffected relatives of children with ASD have been found to have subclinical autistic traits [ ]. The parents of children with ASD may demonstrate subtle deficits in social communication and face processing [ , ].
Given these reports and considerations, the physical presence of smartglasses may affect social communication, and it may be sensible to attempt to minimize such facial obscuration to enhance social communication between people with ASD and their family members.
The presence of face-worn smartglasses may also influence social relationships, of the adults or children who wear them, as they alter a user’s facial appearance. Unlike many other assistive technologies, they are not easy to hide. Wearing smartglasses may not only alter how the user perceives the world but may alter how the world perceives the user. Facial appearance plays a key role in determining how people interact with one another , including whom they help, hire, or want to date [ ]. Human faces may also be judged based on their symmetry, a marker of attractiveness and an indicator of optimal developmental outcome despite environmental stressors [ ]. Greater facial symmetry has been linked to increased perceived trustworthiness and a decreased risk of being bullied [ ]. Facial symmetry may be perceived as demonstrating genetic quality and therefore suitability of an individual as a mate [ ], while facial asymmetry may be a predictor of long-term psychological, emotional, and physiological distress [ ]. Users of smartglasses that are asymmetrical, such as those that are monocular, could be perceived as being less attractive and trustworthy due to the aforementioned principle of evolutionary psychology. By extension, “asymmetric” smartglasses users may also be at greater risk of bullying [ ]. On the other hand, smartglasses that are asymmetrical may obscure less of the wearer’s face from the view of others. As discussed earlier, maximizing how much of the face is visible may help facilitate social communication. Even nontechnological face-worn glasses are associated with impaired interpersonal relationships: for example, wearing prescription glasses or having a history of using eye patches has been associated with a 35% increase in the likelihood of receiving physical or verbal bullying [ ].
Smartglasses in the Context of Child Development
The perceptual impact of smartglasses and their ability to augment a child’s cognitive and emotional functioning may have a central and influential role in childhood development if we consider Bronfenbrenner and Ceci’s bioecological model  and Bronfenbrenner’s earlier ecological systems theory [ ]. According to the bioecological model, children are active participants in their environments and they have unique bidirectional interactions with each of their contextually separate environments, including home and school. This model places increased emphasis on the cognitive, emotional, and physical attributes of the child in his or her development and in how the child and environments interact with one another. As outlined in Bronfenbrenner’s ecological systems theory [ ], the school environment, like the home environment, is one of the most intimate and influential environments affecting childhood development, as it lies in the child’s microsystem. When we consider that smartglasses may enhance the cognitive and emotional functioning of children within their microsystem, we can see that they may have a highly influential role in child development. Even within the microsystem, the contextual differences between the most intimate of environments may affect a child’s view toward using assistive technology. Research has shown that children have different attitudes and levels of enthusiasm toward using assistive technology depending on whether they are asked to use it at home or at school [ ].
Furthermore, use of smartglasses by future school-age children and adolescents should prompt a discussion of Erikson’s 4th and 5th psychosocial stages . Erikson identified a range of psychosocial developmental stages from birth through death. School-age children experience Erikson’s 4th psychosocial stage, described as a psychosocial crisis of industry versus inferiority. A child in this stage is often expected to learn and demonstrate new skills, productively complete tasks, and meet the expectations of parents and teachers. During this stage, a child becomes aware of his or her abilities and the abilities of his or her peers. A child who cannot master these expected skills risks a sense of inferiority and failure. The potential impact of smartglasses on this developmental stage is not known. They may aid children in successfully mastering this psychosocial stage by allowing them to be productive and giving them a sense of achievement. There is also a risk that children may feel inferior if they feel that without the smartglasses they are incompetent or if they feel ridiculed for wearing such devices. Each child may face a unique situation based on his or her own personal attributes and the support received from key people such as teachers, parents, and peers. This highlights the importance of ensuring that these key people are familiar with smartglasses technology and understand its capabilities and functionality.
Following this stage is Erikson’s 5th psychosocial stage that occurs in adolescence, described as a psychosocial crisis between identity versus role confusion . Adolescence is a time of tremendous biological and psychological change [ ], and during this stage individuals seek to define their role in the world, seeking to address the existential question, who am I and what can I be? Individuals will try to find like-minded social groups, focus on relationships with peers, and pursue a sense of belonging. Many questions remain unanswered about how smartglasses may impact people with ASD during this stage, especially given the many social challenges people with ASD encounter during this transition from childhood to adulthood [ ]. How will ASD and these technologies define the individual? Will these technologies help individuals to find their purpose or hinder them? The impact of such technology may depend on smartglasses’ physical attributes, their impact on social relationships, or individual person characteristics (as discussed above within the scope of the bioecological model [ ]).
Learning happens continuously in childhood, and the use of smartglasses technology may provide a digital means of enabling learning to occur, as in Vygotsky’s zone of proximal development (ZPD) . Vygotsky originally described his ZPD as being “the distance between the actual development level as determined by independent problem solving and the level of potential development as determined through problem solving under adult guidance or in collaboration with more capable peers” [ ]. These smartglasses designed as assistive technologies may allow children to undertake and learn tasks that they would have found impossible or very difficult to do independently. A child with ASD normally has a number of challenges in being in the ZPD, such as becoming overwhelmed with new experiences, struggling with transitions in environment or activities, and coping with sensory stimuli [ ]. Sensor-rich smartglasses may be of particular utility here in that they can be used, with the right software, to monitor the behavioral and physiologic functioning of a child. For instance, they can be transformed by software to be able to detect when children are under- or overstimulated and to accordingly adapt the learning experience in real time to keep a child engaged and in the ZPD [ ].
Victimization, Socialization, and the School Environment
School-age children with ASD are at risk of being stigmatized  and being victims of bullying [ ] for multiple reasons. They have different developmental trajectories that may put them at greater risk of victimization than their neurotypically developing peers, especially when they have challenges in social skills and communication [ ]. They may struggle to recognize social cues and develop relationships with their peers, impeding their ability to be better integrated by the community [ - ]. Bullying may be particularly problematic at school, where academic and social factors may be a source of considerable stress, anxiety, and mental health concerns in children [ - ]. A school represents not only an academic establishment but a complicated and highly social environment. Children in schools often balance interpersonal relationships with peers and staff, complex social hierarchies, and school rules that can dictate the most basic elements of children’s day (whom to play with, where to sit, and when to talk to others [ - , ]). Some reports have suggested that children with ASD have inherently low motivation or desire to join social groups, but recent evidence indicates this is not the case and many have a strong desire for acceptance [ - ]. Therefore, it is important to consider the acceptability and design of any assistive device in the population, given the risk of stigma and social isolation [ ]. This is especially true for a device that is worn on the face.
We gave 8 children with ASD an opportunity to try the Glass smartglasses in a controlled, recorded environment and to explore its features, usability, and visual characteristics. We observed and recorded the interaction of the children with the device. We also conducted a postsession semistructured interview with the children and their caregivers, who accompanied the child and observed the whole session. Our sample represented a broad age range and severity spectrum of ASD.
Institutional Review Board Statement
The use of the Brain Power Autism System running on multiple head-worn computing devices by children and adults with autism was approved by Asentral Inc Institutional Review Board, an affiliate of the Commonwealth of Massachusetts Department of Public Health. The study was performed in accordance with relevant guidelines and regulations.
Eight children with clinically diagnosed ASD and their caregivers were entered into this study. The participants represented a wide range of school-aged children, ages 6.7 to 17.2 years (mean 11.7 [SD 3.3] years), including 7 males and 1 female. Participants were recruited from a user research database created from Web-based research interest forms. Written consent for study participation was obtained from the legal guardians, and children from age 7 to 17 years provided written assent. In this report, every participant was accompanied by a parent or guardian caregiver to the session, and participants and caregivers could exit the session at any time and for any reason. It was explained that the main aim of the study was to understand the acceptability and usability of modern smartglasses technology in children with ASD.
Caregivers rated the participant level of overall ASD functioning according to a subjective 7-point scale (1=lowest-functioning/severe to 7=highest-functioning/mild). Caregivers also rated speaking ability on a similar scale (1=nonspeaking to 7=fully conversational). Participants represented a large range of overall ASD functioning (range 4 to 7 out of 7; mean 5.6 [SD 1.1]) and speaking ability (range 4 to 7 out of 7; mean 5.5 [SD 1.3]).
Data Collection Procedure
Participants and their caregivers were orientated to the testing room where they had an opportunity to learn about the Glass smartglasses and to physically wear and use them. They were provided with any assistance they required to properly place the smartglasses on their heads and align it with their eyes, although little assistance was needed. They were able to use any of the apps on the smartglasses. Testing sessions were recorded via video and photographs. All participants and/or caregivers gave written consent for their images and video to be used in current and future research analyses.
Following the testing, participants and caregivers went into a separate room where they were questioned about their experience as part of a semistructured interview. The participants were asked to compare their experience of Glass with previously tested assistive devices and gamified apps related to ASD. As previously noted, the participants were recruited from a research database for technology-related studies in ASD, and all had seen and tried the original Google Glass. Participants were asked if they became stressed when using the device and if the session was an overwhelming sensory or emotional experience for them. The questions were adapted or simplified based on the child’s speaking ability and were repeated if needed. Study staff interacted with the child and caregiver and spent time ensuring the questions were understood, considered, and accurately answered.
Participants were then asked whether they would consider wearing and using the device for 1 hour each day in their school and separately asked the same question about using the device at home. The caregiver was also interviewed in order to rate whether they felt the experience was fun for the participant and whether they felt the experience with the smartglasses went better than they had expected.
Individuals who had a known history of epilepsy or seizure disorder were not asked to take part in this study. Individuals who had any uncontrolled or severe medical or mental health condition that would make participation in the study predictably hazardous were also not invited to participate.
All 8 children, who represented the full range of school ages (6 to 17 years), successfully wore, interacted with, and explored one or more Glass smartglasses (). The smartglasses were loaded with a suite of assisted-reality apps for social-emotional learning and self-coaching related to brain-based challenges and needs, as discussed elsewhere [ ]. Participants explored the devices at their leisure, putting them on and taking them off and exploring the style, size, weight, shape, and features such as foldability, and spoke out loud in some cases (children with greater speaking ability) about their observations and questions. All children successfully transitioned to the interview room, where they responded to questions by the experimenter, accompanied and assisted by their caregivers as needed. There were no negative effects reported or observed.
All participants noted that they did not feel stressed (8/8, 100%,) or have an overwhelming sensory or emotional experience when using the smartglasses (8/8, 100%). The participants all reported that they would be agreeable to using the smartglasses in both home (8/8, 100%) and school settings (8/8, 100%). Caregivers reported no concerns with the children using the smartglasses, and all caregivers reported that their child appeared to have fun using the device (8/8, 100%). The majority of caregivers felt the interaction of the child with the smartglasses went better than they had expected (6/8, 75%; ). Of the remaining 2, 1 parent said that the experience had proceeded “as expected” and another answered the question conversationally but without a direct response, so the response was not tabulated as a yes but as an undetermined.
|Neutral or undetermined response |
|Would you wear the smartglasses for 1 hour each day at school?||8 (100)||0 (0)||0 (0)|
|Would you wear the smartglasses for 1 hour a day at home?||8 (100)||0 (0)||0 (0)|
|Did you feel stressed while wearing the smartglasses?||0 (0)||8 (100)||0 (0)|
|Did you feel overwhelmed (emotionally/sensory)?||0 (0)||8 (100)||0 (0)|
Smartglasses are an emerging technology that could hold much promise as an assistive technology for children and young adults with ASD. It is important to seek the opinions of children with ASD and their caregivers when considering the use of a new assistive device. This is especially true of smartglasses given their high level of visibility, prior reports of negative social perceptions, and the potential interplay of such devices with social communication and child development. Children with ASD and their caregivers may be particularly discerning about factors that could impact the use and social acceptance of such technologies in educational settings such as schools and in the home environment.
The results demonstrate that Glass was acceptable and desirable by all participants, who spanned the full range of school ages (6 to 17 years). It was encouraging to find that all 8 school-aged children with ASD felt that using these smartglasses was not a stressful experience and denied being overwhelmed in a sensory or emotional way. Additionally, it was also promising to see that all of the children expressed a willingness to use these devices in both school and home settings. Caregivers noted that children had fun using the device, and most caregivers felt their expectations of how the children would interact with the smartglasses were surpassed.
These results are important for a number of reasons. Children with ASD are frequently not involved in providing design or usability feedback to interventions and technologies developed for them. Involving children when choosing an assistive device is crucial to ensure that the device is socially appropriate for the environment, which will likely lead to greater compliance in wearing the device. It also appears that these children are accepting of new technologies, even on relatively uncommon and highly visible platforms such as head-mounted computers. The children who participated in this study were more open to using Glass in a public environment than many adults have been . With this in mind, it will be equally as important to ensure caregivers and peers in the child’s microsystem are accepting of the assistive technology [ ], as their opinions will likely sway a child’s enthusiasm toward the device. Many children in this study mentioned favoring Glass because of its unobtrusive, sleek design; having a device that is less noticeable and designed to be “cool” may help with its social acceptance and may not carry the stigma of assistive technology with it. The desirability of Glass in this case was predicated on a prediction of social acceptability (colloquially, the “cool factor”) in a social situation. Many factors may be included in a participant’s prediction of the cool factor of a device. Such factors may include unobtrusiveness, lightness, futuristic look, comfort, ease of storing, ease of transport, durability, ruggedness, styling, ability to give others experiences they could not otherwise have (conferring to the child an ability to control a social situation in a positive way), ability to initiate a conversation with decreased anxiety over selecting the topic of the conversation (ice-breaker), and more.
The unanimous willingness of participants to wear the smartglasses in school is also important. The school setting is a place of high risk relative to social integration and stigma that could result from an undesirable or socially inappropriate device or behavior. This is one reason we chose the question of acceptability of the device at school as a high-bar test for how desirable and acceptable this new device may be. However, a limitation of this work is that we asked for the opinion of the target users, and such an opinion is necessarily based on a prediction. It may be hard to predict how a device or behavior will actually be received in the complex and changing social hierarchy of a school environment. Additionally, children with ASD may have extra challenges in predicting the emotional reactions and behaviors of their classmates, especially if they are in an integrated school environment with neurotypical or typically developing children their same chronological age. For all these reasons, further research is needed to test the acceptability within school environments.
These results suggest that a smartglasses platform may be an acceptable base for assistive software apps that could promote self-sufficiency. For instance, they may have a desirable new platform for gamified, social-emotional self-coaching apps based in neuroscience and artificial intelligence that have been deployed on other head-worn computer platforms . The results are promising at a broader level for those who wish to use or develop apps that harness the unique features of this family of devices, such as their ability to allow the user to be heads-up, hands-free, and able to perceive and engage with the world around while receiving additional assistance. The results suggest that the newest entrant into the still-emerging family of devices may be well received, at least by some discerning populations. Further research is clearly needed to address these and more limitations or open questions of this work. This report represents part of a larger, ongoing research initiative.
This paper represents the first published work, to our knowledge, using Glass (Enterprise Edition). It also represents the first published use of Glass as an assistive or assessment device for people with different abilities or intellectual disabilities or challenges. This work extends our previous research on the use of the original Google Glass as an aid to people with ASD .
The authors thank Google, Inc. for a generous grant and also the Glass team at X (formerly Google X) for technical guidance on Glass software development. This work was supported by the Office of the Assistant Secretary of Defense for Health Affairs through the Autism Research Program under Award No. W81XWH 17-1-0449. Early work to transform smartglasses into biomedical sensors was supported in part by the United States Army Medical Research and Materiel Command under Contract No. W81XWH-14-C-0007 (awarded to TIAX, LLC). Opinions, interpretations, conclusions, and recommendations are those of the authors and are not necessarily endorsed by the Department of Defense. The authors would also like to acknowledge Krystal Huey for her help with study coordination.
Conflicts of Interest
This report was supported by Brain Power, a neurotechnology company developing a range of artificially intelligent wearable technologies. Brain Power has engineering and technical partnerships with major technology companies and also receives funding support from federal and congressional sources.
NS is the inventor of the Brain Power Autism System. NS, JS, NK, and AV designed and undertook the intervention. The writing of this technology report was led by AV, and all authors contributed.
- Buescher AVS, Cidav Z, Knapp M, Mandell DS. Costs of autism spectrum disorders in the United Kingdom and the United States. JAMA Pediatr 2014 Aug;168(8):721-728. [CrossRef] [Medline]
- Odom SL, Thompson JL, Hedges S, Boyd BA, Dykstra JR, Duda MA, et al. Technology-aided interventions and instruction for adolescents with autism spectrum disorder. J Autism Dev Disord 2015 Dec;45(12):3805-3819. [CrossRef] [Medline]
- McNaughton D, Light J. The iPad and Mobile Technology Revolution: Benefits and Challenges for Individuals Who Require Augmentative and Alternative Communication. Philadelphia: Taylor & Francis; 2013.
- Doughty K. SPAs (smart phone applications): a new form of assistive technology. J Assistive Technol 2011 Jun 17;5(2):88-94. [CrossRef]
- Rauschnabel PA, Brem A, Ivens BS. Who will buy smart glasses? Empirical results of two pre-market-entry studies on the role of personality in individual awareness and intended adoption of Google Glass wearables. Comput Hum Behav 2015 Aug;49:635-647. [CrossRef]
- Rauschnabel P, Brem A, Ro Y. Augmented reality smart glasses: definition, conceptual insights, and managerial importance [unpublished working paper]. 2015. URL: https://www.researchgate.net/publication/279942768_Augmented_Reality_Smart_Glasses_Definition_Conceptual_Insights_and_Managerial_Importance [accessed 2017-12-27] [WebCite Cache]
- Klein GO, Singh K, von Heideken J. Smart glasses—a new tool in medicine. Stud Health Technol Inform 2015;216:901. [Medline]
- Liu R, Salisbury JP, Vahabzadeh A, Sahin NT. Feasibility of an autism-focused augmented reality smartglasses system for social communication and behavioral coaching. Front Pediatr 2017;5:145 [FREE Full text] [CrossRef] [Medline]
- Salisbury J, Keshav N, Sossong A, Sahin N. Standing balance assessment using a head-mounted wearable device. bioRxiv 2017. [CrossRef]
- Barfield W. Fundamentals of Wearable Computers and Augmented Reality. Boca Raton: CRC Press; 2015.
- Hernandez J, Picard R. SenseGlass: using google glass to sense daily emotions. 2014 Presented at: Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology; 2014; Honolulu. [CrossRef]
- Loh D, Lee TJ, Zihajehzadeh S, Hoskinson R, Park EJ. Fitness activity classification by using multiclass support vector machines on head-worn sensors. Conf Proc IEEE Eng Med Biol Soc 2015 Aug:502-505. [CrossRef] [Medline]
- Bulling A, Kunze K. Eyewear computers for human-computer interaction. interactions 2016 Apr 26;23(3):70-73. [CrossRef]
- Mishra J, Anguera JA, Gazzaley A. Video games for neuro-cognitive optimization. Neuron 2016 Dec 20;90(2):214-218 [FREE Full text] [CrossRef] [Medline]
- Sahin N, Keshav N, Salisbury J, Vahabzadeh A. An augmented reality social communication aid for children and adults with autism: user and caregiver report of safety and lack of negative effects. bioRxiv 2017. [CrossRef]
- Vahabzadeh A, Keshav N, Salisbury J, Sahin N. Preliminary report on the impact of smartglasses-based behavioral and social communication aid on hyperactivity in children and adults with autism. bioRxiv 2017. [CrossRef]
- Müller E, Schuler A, Yates GB. Social challenges and supports from the perspective of individuals with Asperger syndrome and other autism spectrum disabilities. Autism 2008 Mar;12(2):173-190. [CrossRef] [Medline]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Arlington: American Psychiatric Association Publishers; 2013.
- Kothari J. A new chapter for Glass. URL: https://blog.x.company/a-new-chapter-for-glass-c7875d40bf24?gi=773a91e858b9 [accessed 2017-12-19] [WebCite Cache]
- Keshav NU, Salisbury JP, Vahabzadeh A, Sahin NT. Social communication coaching smartglasses: well tolerated in a diverse sample of children and adults With autism. JMIR Mhealth Uhealth 2017 Sep 21;5(9):e140 [FREE Full text] [CrossRef] [Medline]
- Profita H, Albaghli R, Findlater L, Jaeger P, Kane S. The AT effect: how disability affects the perceived social acceptability of head-mounted display use. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems 2016. [CrossRef]
- Weiz D, Anand G. The influence of subjective norm on the usage of smartglasses. In: Drivers of Wearable Device Usage. Philadelphia: Springer; 2016:1-11.
- Pedersen I, Trueman D. Sergey Brin is Batman: Google's project glass and the instigation of computer adoption in popular culture. CHI Extended Abstracts 2013. [CrossRef]
- Hocking C. Function or feelings: factors in abandonment of assistive devices. Technol Disabil 1999;11:3-11.
- Parette H, Wojcik B, Hourcade J, Peterson-Karlan G. Assistive technology for students with mild disabilities: what's cool and what's not. Educ Training Develop Disabil 2005:320-331.
- Schaefer SE, Ching CC, Breen H, German JB. Wearing, thinking, and moving: testing the feasibility of fitness tracking with urban youth. Am J Health Educ 2016 Jan 08;47(1):8-16. [CrossRef]
- Zeng EY, Heffner JL, Copeland WK, Mull KE, Bricker JB. Get with the program: adherence to a smartphone app for smoking cessation. Addict Behav 2016 Dec;63:120-124. [CrossRef] [Medline]
- Lang R, Ramdoss S, Raulston T, Carnet A, Sigafoos J, Didden R. Assistive technology for people with autism spectrum disorders. In: Assistive Technologies for People with Diverse Abilities. Philadelphia: Springer; 2014:157-190.
- Morris J. Bullying: what Native American parents need to know.: Native American Parent Technical Assistance Center; 2016. URL: http://naptac.org/wp-content/uploads/2017/01/bullying.pdf [accessed 2017-12-19] [WebCite Cache]
- Parette P, Scherer M. Assistive technology use and stigma. Educ Training Develop Disabil 2004:217-226.
- van der Meer L, Sigafoos J, O'Reilly MF, Lancioni GE. Assessing preferences for AAC options in communication interventions for individuals with developmental disabilities: a review of the literature. Res Dev Disabil 2011;32(5):1422-1431. [CrossRef] [Medline]
- Huang I, Sugden D, Beveridge S. Children's perceptions of their use of assistive devices in home and school settings. Disabil Rehabil Assist Technol 2009 Mar;4(2):95-105. [CrossRef] [Medline]
- van der Meer L, Didden R, Sutherland D, O’Reilly MF, Lancioni GE, Sigafoos J. Comparing three augmentative and alternative communication modes for children with developmental disabilities. J Dev Phys Disabil 2012 May 8;24(5):451-468. [CrossRef]
- Shinohara K, Wobbrock J. In the shadow of misperception: assistive technology use and social interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2011. [CrossRef]
- Jurgens A, Anderson A, Moore DW. Parent-implemented picture exchange communication system (PECS) training: an analysis of YouTube videos. Dev Neurorehabil 2012;15(5):351-360. [CrossRef] [Medline]
- Jack R, Schyns P. The human face as a dynamic tool for social communication. Current Biology 2015;25(14):R621-R634.
- Pavlova MA, Guerreschi M, Tagliavento L, Gitti F, Sokolov AN, Fallgatter AJ, et al. Social cognition in autism: face tuning. Sci Rep 2017 May 26;7(1):2734 [FREE Full text] [CrossRef] [Medline]
- Tang J, Falkmer M, Horlin C, Tan T, Vaz S, Falkmer T. Face recognition and visual search strategies in autism spectrum disorders: amending and extending a recent review by Weigelt et al. PLoS One 2015;10(8):e0134439 [FREE Full text] [CrossRef] [Medline]
- Uljarevic M, Hamilton A. Recognition of emotions in autism: a formal meta-analysis. J Autism Dev Disord 2013 Jul;43(7):1517-1526. [CrossRef] [Medline]
- Moriuchi JM, Klin A, Jones W. Mechanisms of diminished attention to eyes in autism. Am J Psychiatry 2017 Jan 01;174(1):26-35. [CrossRef] [Medline]
- Brewer R, Biotti F, Catmur C, Press C, Happé F, Cook R, et al. Can neurotypical individuals read autistic facial expressions? Atypical production of emotional facial expressions in autism spectrum disorders. Autism Res 2016 Feb;9(2):262-271 [FREE Full text] [CrossRef] [Medline]
- Parette P. Transition and assistive technology planning with families across cultures. Career Development for Exceptional Individuals 2016 Sep 14;22(2):213-231. [CrossRef]
- Leopold DA, Rhodes G. A comparative view of face perception. J Comp Psychol 2010 Aug;124(3):233-251 [FREE Full text] [CrossRef] [Medline]
- Farkas LG, Posnick JC, Hreczko TM. Anthropometric growth study of the head. Cleft Palate Craniofac J 1992 Jul;29(4):303-308. [CrossRef] [Medline]
- Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “Reading the Mind in the Eyes” Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry 2001 Feb;42(2):241-251. [Medline]
- Vorstman JAS, Parr JR, Moreno-De-Luca D, Anney RJL, Nurnberger JI, Hallmayer JF. Autism genetics: opportunities and challenges for clinical translation. Nat Rev Genet 2017 Jun;18(6):362-376. [CrossRef] [Medline]
- Virkud YV, Todd RD, Abbacchi AM, Zhang Y, Constantino JN. Familial aggregation of quantitative autistic traits in multiplex versus simplex autism. Am J Med Genet B Neuropsychiatr Genet 2009 Apr 05;150B(3):328-334 [FREE Full text] [CrossRef] [Medline]
- Adolphs R, Spezio ML, Parlier M, Piven J. Distinct face-processing strategies in parents of autistic children. Curr Biol 2008 Jul 22;18(14):1090-1093 [FREE Full text] [CrossRef] [Medline]
- Yucel GH, Belger A, Bizzell J, Parlier M, Adolphs R, Piven J. Abnormal neural activation to faces in the parents of children with autism. Cereb Cortex 2015 Dec;25(12):4653-4666 [FREE Full text] [CrossRef] [Medline]
- Zebrowitz LA, Montepare JM. Social psychological face perception: why appearance matters. Soc Personal Psychol Compass 2008 May 01;2(3):1497 [FREE Full text] [CrossRef] [Medline]
- Zebrowitz L. Reading Faces: Window to the Soul?. Boulder: Westview Press; 1997.
- Little AC, Jones BC, DeBruine LM. Facial attractiveness: evolutionary based research. Philos Trans R Soc Lond B Biol Sci 2011 Jun 12;366(1571):1638-1659 [FREE Full text] [CrossRef] [Medline]
- Ocker M, Kreitler C. Facial symmetry perceptions in college students. CRIUS 2015;3(1).
- Shackelford TK, Larsen RJ. Facial asymmetry as an indicator of psychological, emotional, and physiological distress. J Pers Soc Psychol 1997 Feb;72(2):456-466. [Medline]
- Horwood J, Waylen A, Herrick D, Williams C, Wolke D. Common visual defects and peer victimization in children. Invest Ophthalmol Vis Sci 2005 Apr;46(4):1177-1181. [CrossRef] [Medline]
- Bronfenbrenner U, Ceci SJ. Nature-nurture reconceptualized in developmental perspective: a bioecological model. Psychol Rev 1994 Oct;101(4):568-586. [Medline]
- Bronfenbrenner U. The Ecology of Human Development. Cambridge: Harvard University Press; 1979.
- Erikson E, Erikson J. The Life Cycle Completed (Extended Version). New York: WW Norton & Company; 1998.
- Scherf KS, Behrmann M, Dahl RE. Facing changes and changing faces in adolescence: a new model for investigating adolescent-specific interactions between pubertal, brain and behavioral development. Dev Cogn Neurosci 2012 Apr;2(2):199-219. [CrossRef] [Medline]
- Hendricks DR, Wehman P. Transition from school to adulthood for youth with autism spectrum disorders. Focus Autism Other Dev Disabl 2009 Mar 24;24(2):77-88. [CrossRef]
- Lee A. Virtually Vygotsky: using technology to scaffold student learning. Technol Pedagogy 2014 Apr;20.
- Vygotsky L. Interaction between learning and development. Readings Dev Children 1978;23(3):34-41.
- Ling C, Mak W, Cheng J. Attribution model of stigma towards children with autism in Hong Kong. J Appl Res Intel Disabil 2010;23(3):237-249. [CrossRef]
- Cappadocia MC, Weiss JA, Pepler D. Bullying experiences among children and youth with autism spectrum disorders. J Autism Dev Disord 2012 Feb;42(2):266-277. [CrossRef] [Medline]
- Thornberg R. School bullying as a collective action: stigma processes and identity struggling. Child Soc 2013 Sep 17;29(4):310-320. [CrossRef]
- Evans CBR, Smokowski PR. Theoretical explanations for bullying in school: how ecological processes propagate perpetration and victimization. Child Adolesc Soc Work J 2015 Nov 30;33(4):365-375. [CrossRef]
- Side J, Johnson K. Bullying in schools: why it happens, how it makes young people feel and what we can do about it. Educ Psychol Prac 2014 Jun 10;30(3):217-231. [CrossRef]
- Green JG, McLaughlin KA, Alegría M, Costello EJ, Gruber MJ, Hoagwood K, et al. School mental health resources and adolescent mental health service use. J Am Acad Child Adolesc Psychiatry 2013 May;52(5):501-510 [FREE Full text] [CrossRef] [Medline]
- Dowdy E, Ritchey K, Kamphaus RW. School-based screening: a population-based approach to inform and monitor children's mental health needs. School Ment Health 2010 Dec;2(4):166-176 [FREE Full text] [CrossRef] [Medline]
- Sheftall AH, Asti L, Horowitz LM, Felts A, Fontanella CA, Campo JV, et al. Suicide in elementary school-aged children and early adolescents. Pediatrics 2016 Oct;138(4) [FREE Full text] [CrossRef] [Medline]
- Menesini E, Salmivalli C. Bullying in schools: the state of knowledge and effective interventions. Psychol Health Med 2017 Mar;22(sup1):240-253. [CrossRef] [Medline]
- Chen C, Lee I, Lin L. Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Res Dev Disabil 2014 Nov 08;36C:396-403. [CrossRef] [Medline]
- Locke J, Ishijima E, Kasari C, London N. Loneliness, friendship quality and the social networks of adolescents with high-functioning autism in an inclusive school setting. J Res Spec Educ Needs 2010;10(2):74-81. [CrossRef]
- Deckers A, Muris P, Roelofs J. Being on your own or feeling lonely? Loneliness and other social variables in youths with autism spectrum disorders. Child Psychiatry Hum Dev 2017 Oct;48(5):828-839 [FREE Full text] [CrossRef] [Medline]
|ASD: autism spectrum disorder|
|Glass: Glass Enterprise Edition|
|ZPD: zone of proximal development|
Edited by G Eysenbach; submitted 18.08.17; peer-reviewed by S Shamsuddin, S Clough, I Montagni; comments to author 14.09.17; revised version received 08.10.17; accepted 29.10.17; published 04.01.18
©Ned T Sahin, Neha U Keshav, Joseph P Salisbury, Arshya Vahabzadeh. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.01.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on http://humanfactors.jmir.org, as well as this copyright and license information must be included.