Welcome to P-E-BO

Your Ultimate Futuristic Desk Companion

Explore Features

Introduction

P-E-BO is a friendly little robot made to keep you company at your desk. It can recognize your face, understand how you're feeling, and respond when you talk. You can ask it to play music, remind you of tasks, or even chat with other P-E-BOs to feel more connected. With features like voice control, touch sensors, and a mobile app, it's always there to help. Whether you're feeling down or just need a buddy, P-E-BO is your smart, caring companion for everyday life.

Project Document

Flip through our interactive project PDF below:

Features

User Identification

Recognizes individual users via biometric data for personalized interactions.

AI Voice Response

Advanced natural language processing for contextual command understanding and execution.

Movement Tracking

Spatial awareness with automatic face-tracking for perfect positioning.

Emotion Recognition

Real-time mood analysis through voice tone and facial expression detection.

Two-Way Voice Communication

Enables real-time audio communication between PEBO devices for seamless connectivity.

Touch Interaction

Responsive touch sensors with haptic feedback for precise gesture controls.

Affection Response

Responds to petting and gentle touches with happy lights, vibrations, and emotive sounds.

Music Playback

Plays songs on voice command for entertainment and relaxation.

Task Management

Organizes and reminds users of tasks and schedules through voice-activated commands.

Solution Architecture

P-E-BO's architecture integrates hardware and software for optimal performance, addressing urban challenges through advanced technology.

High-Level Architecture Diagram Data and Control Flow Diagram

Hardware

P-E-BO's hardware is designed for modularity and efficiency, utilizing a range of components to deliver advanced functionality in a compact form.

Complete PEBO Inside View 3D Design Model

Fabricating the Future: PEBO's Build Process

See the assembly process behind PEBO’s creation!

Mobile App

The P-E-BO mobile app provides a user-friendly interface to control and interact with your desk companion, offering real-time monitoring, configuration, and personalized settings.

Sign-up Page
Sign-in Page
Home Page
Task Control Page
Settings Page

Technology Stack

AWS Rekognition
AWS Rekognition
  • Real-time facial analysis
  • Emotion detection (7 emotions)
  • 95% accuracy in varied lighting
  • Age range estimation
Gemini AI
Gemini API
  • Natural language processing
  • Context-aware responses
  • Multi-turn conversations
  • Knowledge graph integration
Amazon S3
Amazon S3
  • Secure data storage
  • Scalable cloud infrastructure
  • Real-time data syncing
  • 99.9% uptime SLA
Firebase
Firebase
  • Real-time database
  • Inter-device communication
  • Push notifications
  • Authentication services
Mobile Application
Mobile App Screens
  • Cross-platform (iOS/Android)
  • Real-time notifications
  • Device configuration
  • Usage analytics
Robot Face Interface
Robot Face UI
  • Dynamic eye movements
  • Emotion expressions
  • Adaptive animation
  • OLED display powered
Servo Control
  • Pan-tilt mechanism
  • PID control system
Raspberry Pi
Raspberry Pi 4
  • Quad-core ARM CPU
  • 1GB RAM
  • Wi-Fi & Bluetooth
  • GPIO for hardware control
Sensors
  • Microphone Array
  • Touch Sensors
  • Raspberry Pi Camera

Testing

Rigorous testing ensures P-E-BO's reliability and performance across various conditions.

Functional Testing
  • Voice assistant responds accurately via Gemini API.
  • Face and emotion recognition correctly identifies users and emotions.
  • Face tracking ensures smooth movement following.
Performance Testing
  • Optimized response time in edge cases.
  • Operates in low-light and noisy environments.
  • TracksEli>Fast-moving users effectively.
Hardware Testing
  • Ensures all components function as expected.
  • Validates servo motor and sensor reliability.
  • Confirms camera and microphone performance.

Security

P-E-BO prioritizes user data security with robust measures.

Budget

P-E-BO's budget maximizes impact while staying cost-effective.

Item Quantity Unit Price (Rs) All Cost (Rs)
Raspberry Pi 4 B(From Department) 1 25200 25200
0.9" TFT Display 2 890 1780
Servo Motor SG90 5 395 1975
Raspberry Pi Camera 1 1390 1390
USB Microphone Dongle 1 660 660
PWM Servo Motor Drive 1 960 960
Servo-9g-Bracket-PT 1 450 450
4 ohm 2W Speaker 1 190 190
3.3W Stereo Audio Amplifier 1 130 130
TTP223 1-channel Digital Capacitive Touch Sensor 2 60 120
Total 32855

Project Timeline

P-E-BO's development is structured into key milestones to ensure timely progress.

1
Milestone 1

Initial design and prototyping of hardware and software components.

2
Milestone 2

Integration of AI and cloud services with core functionalities.

3
Milestone 3

Testing and refinement of features and performance.

4
Milestone 4

Final deployment and user testing phase.

Challenges

  • Real-time processing latency
  • Hardware-software integration
  • Multi-modal sensor synchronization

Future Roadmap

  • Advanced ML model integration
  • Cross-platform compatibility
  • Enhanced natural language processing

Meet the Team

Project Supervisor

Dr. Supervisor Name

Dr. Isuru Nawinna

Senior Lecturer

Department of Computer Engineering

View Profile

Team Members

Buddhika
Buddhika Ariyarathne

E/20/024

View Portfolio
Yasiru
Yasiru Harinda

E/20/089

View Portfolio
Yohan
Yohan Senadheera

E/20/361

View Portfolio
Bhagya
Bhagya Senevirathna

E/20/366

View Portfolio