VR und Augmented Reality

Sony SmartEyeGlass

Augmented Reality


1. Augmented Reality

Proof of Concept in 24 hours at the HypoVereinsbank/Unicredit Appathon competition 2015.

For this interesting event the colleagues from Sony have been so kind and have given us a complete SmartEyeglass Developer Kit. 
Please read below.

Team “Osiris”

The Team we have built for this competition:

Christian - Ernst Abbe FH
Eugen - Ernst Abbe FH
Armin – Thinking Machines GmbH

Guests / additional Support:
Christine - CCC
Theresa Marketing
Achim Finanz

Table of contents:

  1. Project name
  2. Elevator pitch
  3. Screenshots
  4. Type of the project
  5. MVP
  6. Target group
  7. Use Case
  8. Challenges & solutions
  9. Scalability
  10. Technology
  11. Deployment link/source code

1. Project name

Osiris (/oʊˈsaɪərɨs/, seat of the eye) was an Egyptian god, usually identified as the god of transition, resurrection, and regeneration.

2. Elevator pitch

“Osiris” is an Application for the developer edition of SonySmartEyeglass. “Osiris” shall provide first banking features on this new “wearable” device by providing access to the own account and an overview over the account balance as well as the last transactions executed.

3. Screenshots

A binocular see-through eyewear with a wired controller that connects to your smartphone

Augmented Reality

You cannot see any display from the front, but from the wearers side you can.

The total privacy!

Augmented Reality

A transparent lens eyewear that superimposes information onto the wearer’s natural field of view.

4. Type of the project

“Osiris” is an Android enduser Application for personalized banking information on wearable devices such as Smart Eyeglasses, based on Sony Smarteyeglass(tm).

5. MVP – Minimum Viable Product

The minimal features of “Osiris” are: Providing the user a real-time view on the personal bank account balance and on last transactions.

6. Target group

“Osiris” is being designed as an application destined to adopters of SmartGlasses and in particular the Sony SmartEyeglasses as early adopters. Assuming the expansion of the use of Smart glasses in future, “Osiris” might turn into a mainstream application for SmartGlasses.  The market for Augmented Reality devices is estimated in reaching a volume of 7,5bn Euros by 2020 (DB Research, p.14)

Hence, the use of “Osiris” is contingent on the possession of smart eyewear as device. By implication, users of smart eyeglasses anticipate getting access to information services and apps in a similar way to what they experienced via Smartphones (see also “Augmented Reality, DB Research, 20. August 2015, S.3). HVB as a premium service provider is expected to full fill these requirements.

7. Use Case

The need for “Osiris” is the need for privacy and control in mobile banking. Whilst former banking applications were limited to devices where the screen had a size that could easily get insight, SmartGlasses provide the user with the advantage of unique and private insight of information. Personal (e.g. financial) information is limited to the person carrying the SmartGlasses only – this guarantees personal and data privacy in public environments and former impediments due to devices are being resolved.

Further, the SmartGlass provides handsfree and instant access of data. First, the access to messages or information is not contingent on prior extraction of the mobile device any more. Secondly, data is (if wished) displayed in the moment of arrival by the user.

Consequently, with information only being displayed on the glasses, intrusion of ongoing processes (such as a working process, a conversation, telephone conference, etc.) can be avoided. The user receives information without any changes of the entourage.

As such, “Osiris” is the first application for clients for HVB using SonySmartEyeglass available on the market and the first banking application that was developed for SonySmartEyeglass globally.

Thus, a typical customer journey could be:

-       Joey, 36, married and 2 children, living in Munich gets up at 6:45 am

-       When being ready for work he leaves the house at 7:30

-       As this is his first time alone this morning he accesses his personal bank account whilst going to the S-Bahn in the morning

-       The first information for him to be retrieved is the actual account balance  - for more information he clicks through to his last transactions as he wants to know whether the withdrawal for his daughter’s school has already been effectuated

8. Challenges & solutions

Impediments due to technical issues:

The preset display settings of SonySmartEyewear is limited to a 4bit green scale and a 138x419 resolution which cannot be obviated.

Functioning of the application is limited to the battery. Thus, battery consumption might become an issue for future applications that are high in battery consumption.

Unfamiliarity of users with smart eyeglasses might impede intuitive use of “Osiris”. Problems of usability were solved by limiting command options to scrolling and the “backward” button. Slides/navigation within the application was adjusted likewise.

Further problems that arose are: Incompatibility between the software releases, e.g. Java and Android in conjunction with the developer edition glasses.

9. Scalability

“Osiris” shows the initial set of functions for a SmartGlass Application. Further features that could be added are transactions execution via SmartGlass, read and pay bills via QR code, calculate credit profitability and the current credit account, etc. to reach to full banking functionality. Command of SmartGlasses shall be extended to its full range (e.g. eye tracking, speech recognition, gesture recognition). Further development of banking applications for wearables is highly recommended. German leadership in automation technology is to be used in developing strong strategies for augmented reality software as backed by DB Research (p.13).

10. Technology

  • First banking app for Sony SmartEyeglass
  • Android mobile phone is used as bridge device complementary to SonySmartEyeglass
  • API „TransactionList“ as an access point to HVB banking data
  • SDK „smarteyeglass-sdk” developer kit for Sony Smartglasses
  • NFC chips for personal authorization

11. Deployment link/source code

Sony SmartEyeGlass SDK

From Appathon API Playground we have used the “Transactions List” API

Authors of this document: Theresa Seidl, Armin Loeffler
Date: 8, November 2015


2. VR Virtual Reality comes soon

We have checked out different VR Glasses




Computer Systems
T: +49 89 2003 193-0
E: i@thinking-machines.com
A: Konrad Zuse Platz 8
     D-81829 München

Thinking Machines GmbH