Difference between revisions of "Catedraproject2012"

From robotica.unileon.es
Jump to: navigation, search
(Catedra Telefónica: Augmented Reality in tele-assitence of elderly people)
m
 
(71 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Catedra Telefónica: Augmented Reality in tele-assitence of elderly people==
+
=Augmented Reality in tele-assitence of elderly people=
  
[http://catedratelefonica.unileon.es/proyectos/realidad-aumentada-para-la-tele-asistencia-a-ancianos/ Offcial Web Page]
+
==Project Presentation==
  
*Resume
+
* '''Project Name:'''
 +
Augmented Reality in tele-assitence of elderly people
  
 +
* '''Official Web Page'''
 +
[http://catedratelefonica.unileon.es/proyectos/realidad-aumentada-para-la-tele-asistencia-a-ancianos/ Catedra Telefónica Web Page]
 +
* '''Staff:'''
 +
Director:Francisco Javier Lera
 +
Co-Director: Juan Felipe García Sierra
 +
Technical Software:Álvaro Botas (Granted)
 +
Technical Hardware:Carlos Rodríguez
  
 +
* '''Other Information:'''
 +
* '''Academic Year:''' 2011-2012
 +
* '''SVN Repositories:''' soon ... Alfa version on demand.
 +
* '''Tags:''' Augmented Reality, Elderly people, Tele-Assistence
 +
* '''Technology:''' c++, svn, OpenCV, cmake, OpenGL, Qt, Aruco
 +
* '''State:''' Development
  
*Robotics
+
=Summary=
  
We are going to adapt part of our software to work with ROS. There are many reasons to that that we are going to present along this page.
+
The main objective of this project is the development of an autonomous system with Augmented Reality ready for real interaction with older people . This will be apply in two differents contexts:
 +
#Day By Day help to elderly people in their home.
 +
#A generic teleassistance system.
  
*Turtlebot and TurtleRoombot
+
The first context, is oriented in a control system drugs. We are going to develop control system for daily medication that a patient, in this case an elderly, needs to be controlled.
  
We bought with part of money assigne to our project one [http://turtlebot.com/ Turtlebot]. The main reason was that it is selled fully mounted and installed, and this will make easy the start of our software integration (that we thought, however ...)
+
The second context, search a solution able to coexist with the red cross telephone. This device, is a typycal phone plus a locket that elderly people could use to have tele-assistance 
  
[[Image:Turtlebot_1.JPG|center|500px]]
+
=Robotics=
  
A few weeks ago and thanks to one collaborator we decided to build our selves the components to communication with a Roomba, the twin robot of iCreate, original base that Turtlebot mounts. And now we have a fully work re-design of official connector.
+
Our first aproach to this project was to implement all of our software to work directly with a tabletPC or with a PC, but our main idea is to deploy our development in a robot.
  
[[Image:TurtleRoomBot.JPG|center|500px]]
+
The robot election was hard. Latetly a few robot systems are available. The main difference between them can be made as:
 +
#Economic solution
 +
#Easy and large group of development
  
 +
First approach, economic solutions. We can afford robots like Rovio WowWee, a toy that during a year we use to make differents final project and robotics courses. The price is almost 300 € by unit. Last year we develop [http://robotica.unileon.es/mediawiki/index.php/HectorQ-RV-proy2 our kernel development] allowing us to avoid low level development an center in a high level projects like augmented reality.
  
Now we can say that it's working
+
The second approach, is based in the use of a robot taken in account the develpment community. Why? because this can improve our development and decrease our low level problems, for instance, problems with hardware - software synchronization.
  
<wikiflv width="300" height="250" logo="true">/videos/roomba_ok.flv</wikiflv>
+
Well, the idea of our project is make an application that could be easily applicable. But we will need to apply in many environments to test and validate our proposal. For this reason an expensive robot solutions can not be used.
 +
 
 +
In last years, [http://www.willowgarage.com/ Willow Garage] has been a reference for most robotics labs. In this way ,their robot [http://www.willowgarage.com/turtlebot turtlebot], seemed to fit our needs. The price of this robot was almost 1.2K € and the software available to development was ROS (Robot Operating System). ROS libraries can allow us to afford developments using common languages like C++ or Python. Also it presents a big robotics community that we can use as a information source and a place where we can present our works
 +
 
 +
<!-- Projects like “Robótica en el tratamiento del Alzhéimer”, leaded by José M. Cañas and Francisco Martín Rico in Universidad Rey Juan Carlos robotics group, [http://www.robotica-urjc.es/ URJC] introduce NAO robot as a possibility in a HRI context. We can find in last journeys of our [http://catedratelefonica.unileon.es/jornadas-catedras/primera-jorna-da-catedra-telefonica-universidad-de-leon/ Catedra telefónica Universidad de León]  a brief presentation.-->
 +
 
 +
Details of '''Turtlebot''' and '''TurtleRoomBot''' (our turtlebot solution following WillowGarage Turtlebot design)
 +
 
 +
[[Catedraproject2012robotics|Technical resume]]
 +
 
 +
=Software=
 +
 
 +
==Myra:First Phase==
 +
 
 +
The code name for this part is MYRA (Mayores y Realidad Aumentada, elderly and augmented reality in spanish). This development comes from an experimental test carried on in our lab last year. The experiment consisted of applying AR (augmented reality) in teleoperation tasks by non-technical users.
 +
 
 +
How we explain before, we want to develop a system to daily control drugs. Showing to camera a tipycal pillbox with a modified front, the patient would know what pills are today. But it is easy to imagine that the digital gap will be hard to fill in this kind of technologies.
 +
 
 +
This system is oriented to people without knowledge in technologies that can found a valious tool in the day by day.
 +
 
 +
[[Image:Basetech.jpg|right|300px]] 
 +
 
 +
From the developer's side, the components by technologies are:
 +
*C++:
 +
*[http://www.uco.es/investiga/grupos/ava/node/26 ArUco:] a minimal library for Augmented Reality applications based on OpenCv.
 +
*Qt:
 +
*OpenCv:
 +
 
 +
Our main goal is to build a simple and intuitive interface. The interface must facilitate interaction between the elderly and the system. The reason is clear, get the desired results with minimal interaction.
 +
 
 +
==Myra:Second Phase==
 +
 
 +
<!-- http://en.wikipedia.org/wiki/Help:Wiki_markup -->
 +
 
 +
In this second phase we have developed the initial software platform for the turtlebot platform. We initially prepared the platform for the MYRA app and also a telepresence system, it should looks like this:
 +
 
 +
[[Image:MYRAFase2a.png|center|300px]]
 +
 
 +
But we wanted to deploy it in a robotic platform, so the first idea of this was:
 +
 
 +
[[Image:MYRAFase2b.jpg|center|500px]]
 +
 
 +
===Software===
 +
 
 +
[[Image:Pillbox1a.png|center|500px]]
 +
 
 +
[[Image:Pillbox2a.png|center|500px]]
 +
 
 +
[[Image:Pillbox2b.jpg|center|500px]]
 +
 
 +
'MYRA Manual'
 +
 
 +
[[Image:HelpMYRA.png|center|500px]]
 +
 
 +
===Experiment===
 +
 
 +
[[Image:Test1Turtlebot.jpg|center|500px]]

Latest revision as of 09:58, 25 June 2014

Augmented Reality in tele-assitence of elderly people

Project Presentation

  • Project Name:
Augmented Reality in tele-assitence of elderly people
  • Official Web Page
Catedra Telefónica Web Page 
  • Staff:
Director:Francisco Javier Lera
Co-Director: Juan Felipe García Sierra
Technical Software:Álvaro Botas (Granted)
Technical Hardware:Carlos Rodríguez
  • Other Information:
* Academic Year: 2011-2012
* SVN Repositories: soon	... Alfa version on demand.
* Tags: Augmented Reality, Elderly people, Tele-Assistence
* Technology: c++, svn, OpenCV, cmake, OpenGL, Qt, Aruco
* State: Development

Summary

The main objective of this project is the development of an autonomous system with Augmented Reality ready for real interaction with older people . This will be apply in two differents contexts:

  1. Day By Day help to elderly people in their home.
  2. A generic teleassistance system.

The first context, is oriented in a control system drugs. We are going to develop control system for daily medication that a patient, in this case an elderly, needs to be controlled.

The second context, search a solution able to coexist with the red cross telephone. This device, is a typycal phone plus a locket that elderly people could use to have tele-assistance

Robotics

Our first aproach to this project was to implement all of our software to work directly with a tabletPC or with a PC, but our main idea is to deploy our development in a robot.

The robot election was hard. Latetly a few robot systems are available. The main difference between them can be made as:

  1. Economic solution
  2. Easy and large group of development

First approach, economic solutions. We can afford robots like Rovio WowWee, a toy that during a year we use to make differents final project and robotics courses. The price is almost 300 € by unit. Last year we develop our kernel development allowing us to avoid low level development an center in a high level projects like augmented reality.

The second approach, is based in the use of a robot taken in account the develpment community. Why? because this can improve our development and decrease our low level problems, for instance, problems with hardware - software synchronization.

Well, the idea of our project is make an application that could be easily applicable. But we will need to apply in many environments to test and validate our proposal. For this reason an expensive robot solutions can not be used.

In last years, Willow Garage has been a reference for most robotics labs. In this way ,their robot turtlebot, seemed to fit our needs. The price of this robot was almost 1.2K € and the software available to development was ROS (Robot Operating System). ROS libraries can allow us to afford developments using common languages like C++ or Python. Also it presents a big robotics community that we can use as a information source and a place where we can present our works


Details of Turtlebot and TurtleRoomBot (our turtlebot solution following WillowGarage Turtlebot design)

Technical resume

Software

Myra:First Phase

The code name for this part is MYRA (Mayores y Realidad Aumentada, elderly and augmented reality in spanish). This development comes from an experimental test carried on in our lab last year. The experiment consisted of applying AR (augmented reality) in teleoperation tasks by non-technical users.

How we explain before, we want to develop a system to daily control drugs. Showing to camera a tipycal pillbox with a modified front, the patient would know what pills are today. But it is easy to imagine that the digital gap will be hard to fill in this kind of technologies.

This system is oriented to people without knowledge in technologies that can found a valious tool in the day by day.

Basetech.jpg

From the developer's side, the components by technologies are:

  • C++:
  • ArUco: a minimal library for Augmented Reality applications based on OpenCv.
  • Qt:
  • OpenCv:

Our main goal is to build a simple and intuitive interface. The interface must facilitate interaction between the elderly and the system. The reason is clear, get the desired results with minimal interaction.

Myra:Second Phase

In this second phase we have developed the initial software platform for the turtlebot platform. We initially prepared the platform for the MYRA app and also a telepresence system, it should looks like this:

MYRAFase2a.png

But we wanted to deploy it in a robotic platform, so the first idea of this was:

MYRAFase2b.jpg

Software

Pillbox1a.png
Pillbox2a.png
Pillbox2b.jpg

'MYRA Manual'

HelpMYRA.png

Experiment

Test1Turtlebot.jpg