... | ... | @@ -54,8 +54,7 @@ The OAK-D camera can be programmed by a very simple python API and has a lots of |
|
|
|
|
|
Use hand trackig, as shown in the image, to control items of the Smart Living Lab by interfacing the OpenHAB REST API.
|
|
|
|
|
|
![](https://raw.githubusercontent.com/geaxgx/depthai_hand_tracker/main/img/hand_tracker.gif)
|
|
|
[OAK-D hand tracking example](https://github.com/geaxgx/depthai_hand_tracker)
|
|
|
![Hands with indicators for tracked fingers](https://raw.githubusercontent.com/geaxgx/depthai_hand_tracker/main/img/hand_tracker.gif)
|
|
|
|
|
|
### Links
|
|
|
|
... | ... | @@ -71,7 +70,7 @@ In computer vision facial landmark algorithms are capable of finding nose, mouth |
|
|
|
|
|
Google provides a very simplified library (mediapipe) tracking facial landmarks in real time. It can be used to control various applications or items. There are many easy youtube tutorials of how to use it.
|
|
|
|
|
|
![](https://google.github.io/mediapipe/images/mobile/face_mesh_android_gpu.gif)
|
|
|
![Face with indicators for tracked face](https://google.github.io/mediapipe/images/mobile/face_mesh_android_gpu.gif)
|
|
|
|
|
|
Tasks of the topic could be:
|
|
|
* Facial gesture based music program
|
... | ... | @@ -85,31 +84,31 @@ Python/Javascript + Mediapipe library, OpenCV |
|
|
### Links
|
|
|
|
|
|
* [Mediapipe library](https://google.github.io/mediapipe/)
|
|
|
* [Murtaza's workshop facial landmark video tutorial](https://www.youtube.com/watch?v=V9bzew8A1tc)
|
|
|
* [Murtaza's facial landmark video tutorial](https://www.youtube.com/watch?v=V9bzew8A1tc)
|
|
|
|
|
|
## [Internship / Bachelorthesis] PupilLabs DIY-Eyetracker
|
|
|
**Selected Topics**: StudyATHome:AI, AT
|
|
|
Write to: <deinhofe@technikum-wien.at>
|
|
|
## [Internship / Bachelorthesis] Plugin and Evaluation of Gazepoint Eyetracker
|
|
|
**Selected Topics**: AT
|
|
|
Write to: <deinhofe@technikum-wien.at>, veigl@technikum-wien.at, klaus@technikum-wien.at
|
|
|
|
|
|
The PupilLabs DIY eye-tracker is open source and provides a python-based API for applications based on a head-mounted eye-tracker. The eye-tracker (in combination with other inputs) could be used for interactions with the environment (e.g. Smart Home Control).
|
|
|
The [Gazepoint eye-tracker](https://www.gazept.com/product/gazepoint-gp3-eye-tracker/) provides an open TCP/XML-based API and can easily be integrated into any application.
|
|
|
|
|
|
Tasks of the topic could be:
|
|
|
* Eye-tracking based Smart Home control (e.g. by gazing onto the light to switch it on/off)
|
|
|
* Detect objects labelled with QR-codes and interact with them
|
|
|
* Detect objects/properties with google Vision API and start a related service
|
|
|
* Implement/Improve AsTeRICS Plugin with TCP client to receive and parse XML data
|
|
|
* Experiment with filter technologies
|
|
|
* Evaluate and compare the eye tracker with State-of-the-Art trackers (e.g. Tobii Eyex 4C/5).
|
|
|
|
|
|
**Technologies / Requirements**
|
|
|
|
|
|
Python, OpenCV, PupilLabs API
|
|
|
Java, XML, TCP
|
|
|
|
|
|
**Links**
|
|
|
|
|
|
* [PupilLabs Eye-tracker](https://pupil-labs.com/products/core/)
|
|
|
* [Google Vision API](https://cloud.google.com/vision/docs/features-list?hl=de)
|
|
|
* [Gazepoint eye-tracker](https://www.gazept.com/product/gazepoint-gp3-eye-tracker/)
|
|
|
* [AsTeRICS Plugin Development](https://www.asterics.eu/develop/plugin/)
|
|
|
* [Tobii Eye Tracker 5](https://gaming.tobii.com/product/eye-tracker-5/)
|
|
|
|
|
|
**Assignee:** offen
|
|
|
|
|
|
|
|
|
## [Internship / Bachelorthesis] Create Accessible AsTeRICS solution
|
|
|
**Selected Topics**: Full Stack Web?, Accessible Web?
|
|
|
|
... | ... | @@ -256,8 +255,7 @@ Write to: <deinhofe@technikum-wien.at> |
|
|
Students selecting the course [User Interface Design Patterns](https://hub.studyathome.technikum-wien.at/courses/user-interface-design-patterns/) are encouraged to do an evaluation of an existing web page or web application and to create a prototype with suggested improvements.
|
|
|
|
|
|
Tasks of the topic could be:
|
|
|
* Evaluate grid.asterics.eu and create a functional prototype with improvements
|
|
|
* Evaluate webacs.asterics.eu and create a functional prototype with improvements
|
|
|
* Evaluate grid.asterics.eu, webacs.asterics.eu, FABI or FLipMouse GUI and create a functional prototype with improvements
|
|
|
|
|
|
**Technologies / Requirements**
|
|
|
|
... | ... | @@ -265,7 +263,7 @@ Web Technologies |
|
|
|
|
|
**Links**
|
|
|
|
|
|
**Assignee:** J.D. (BSA5)
|
|
|
**Assignee:**
|
|
|
|
|
|
## Personalized Video phone (Bildfon)
|
|
|
|
... | ... | |