AURA
INITIALIZING AURA
3rd-Year Engineering Project · 2025 / 2026

Intelligent Robotic
Dining Platform

Harmonizing Robotics, IoT & Real-Time Intelligence

AURA automates ordering, kitchen communication, billing, and customer interaction - seamlessly reducing waiting times, elevating the experience, and maximizing operational efficiency.

Responsive Interaction
Instant Order & Pay
Voice Commands
Expression Recognition
Interactive Entertainment

AURA Concept
About AURA

Automated Urban
Restaurant Assistant

AURA is an intelligent robotic dining assistant and integrated restaurant management platform designed to modernize the dine-in food service industry. It combines social robotics with IoT connectivity and a real-time software ecosystem.

Through AURA, guests can browse visual menus, customize and place orders instantly, track food preparation, and settle bills - all from their table. Orders transmit directly to the kitchen in real time, eliminating communication delays and human errors.

Human-Robot Interaction

Robot physically turns toward the customer, fostering natural engagement

Conversational AI & Voice

"Hey AURA, what are today's specials?" - hands-free ordering

Social Media Photo Mode

AURA smiles for photos and provides branded digital frames


Capabilities

Key Innovative Features

AURA goes beyond digital ordering - introducing advanced interactive hardware & software capabilities.

Responsive Interaction

Physically turns to face you using advanced touch sensors for a truly personal experience.

Instant Order & Pay

Add items to your order or settle the bill in seconds — right from the table. No waiting for staff, ever.

Voice Commands

Hands-free ordering — just say "Hey AURA" and let the future serve you.

Expression Recognition

Reads your mood in real-time to offer proactive and personalized assistance.

Interactive Entertainment

Mini-games, background music, and an automated Birthday Celebration mode.


Gallery

Project Showcase

A live look at AURA in action, and the 3D chassis design behind the build.

AURA Chassis Render 1
Chassis Concept — Front
AURA Chassis Render 2
Chassis Concept — Side
AURA Chassis Render 3
Chassis Concept — Rear
AURA Chassis Render 4
Chassis Concept — Isometric


System Design

System Architecture

A three-layer IoT architecture - robot nodes, messaging broker, and central intelligence.

High-Level Architecture

AURA High-Level Architecture Diagram

Complete Deployment Diagram

AURA Complete Deployment Diagram

Circuit Diagram

AURA Circuit Diagram

Step-by-Step

How It Works

From sit-down to kitchen notification - a seamless automated flow.

01

Customer Detected

PIR motion sensor wakes AURA. Camera activates, OpenCV begins face detection, servos align toward the customer.

02

Browse & Customize

Touchscreen displays visual menus with categories and prices. Customers customize orders via touch or voice.

03

Order Transmitted

JSON-encoded order with table ID published to the MQTT broker instantly over Wi-Fi - zero manual steps.

04

Kitchen Notified

Backend receives order via MQTT+WebSocket, stores in PostgreSQL, and pushes real-time updates to the kitchen display dashboard. AURA confirms with lights & voice.


Technologies

Our Tech Stack

Every tool, framework, and component powering the AURA ecosystem.

Core Technologies

Python
Java
PostgreSQL
OpenCV
Raspberry Pi
AWS
Spring Boot
React
Docker
Linux

Robot / Embedded

Raspberry Pi 4 OpenCV Python 3

Communication

Paho-MQTT Wi-Fi REST API JSON

Backend & Cloud

Spring Boot PostgreSQL AWS Docker

AI / Vision / Voice

Haar Cascade SpeechRecognition pyttsx3 NLP

Frontend

React Tailwind CSS Responsive UI

Software Environment

OS
Raspberry Pi OS
Python
3.9+
Broker
Mosquitto
Backend
Spring Boot
Database
PostgreSQL
Cloud
AWS EC2

Hardware Specifications

ComponentSpecificationComponentSpecification
ProcessorRaspberry Pi 4B (8 GB RAM)Audio AmplifierTPA3118 BTL 60W Mono Digital
Primary Display5" 800×480 HDMI TFT LCD Touch ScreenMicrophone InputUSB Microphone Dongle
Computer VisionRPi Camera Module V2 (8MP)Touch SensorsTTP223 1-Ch Capacitive Buttons ×5
Status Displays0.96" 128×64 OLED Module ×2Pan-Tilt MovementStepper Motor + ULN2003 Driver (5V)
Head MovementMG90 Metal Servo Motors ×2 Full SetCamera Bracket2-Axis Servo Pan-Tilt Mount
Servo PWM ControlPCA9685 16-Channel I2C DriverPower Supply5V 3A SMPS Power Adapter
Audio Output4Ω 5W 1.5" SpeakerLogic Level Shifting8-Channel Bi-Directional Level Converter

Financials

Project Budget

Final self-funded component cost breakdown for one AURA robotic unit.

# Item Qty Unit Price (LKR) Total (LKR)
15 inch 800×480 HDMI TFT LCD Touch Screen19,950.009,950.00
2HDMI Cable11,400.001,400.00
30.96 inch 128×64 OLED Display Module2600.001,200.00
4Servo Motor Metal Wheel MG90 Full Set2580.001,160.00
5Servo Motor Driver 16-Channel PCA9685 I2C11,060.001,060.00
64 Ohm 5W Speaker 1.5 inch1980.00980.00
7USB Microphone Dongle Raspberry Pi PC1850.00850.00
8Stepper Motor + ULN2003 Driver (5V)1595.00595.00
95V 3A SMPS Power Adapter1570.00570.00
10TPA3118 BTL 60W Mono Digital Audio Amp1520.00520.00
11TTP223 1-Channel Digital Capacitive Touch560.00300.00
122-Axis Servo Bracket (Camera Mount)1270.00270.00
13HDMI Jointer1250.00250.00
148-Channel Bi-Directional Logic Level Converter1170.00170.00
15DC Jack Barrel Connector Female130.0030.00
Previous Total (Incl. Pi & Camera)48,395.00
Raspberry Pi 4B (8GB) - Dept. Provided1− 28,000.00
Pi Camera Module (V2) - Dept. Provided1− 1,190.00
Final Accurate Total (Your Cost)19,205.00
LKR 19,205
Your Final Cost
15
Components
LKR 29,190
Dept. Covered

The People

Meet the Team

3rd-Year Computer Engineering undergraduates, University of Peradeniya.

Amaranga
E/21/024
Amaranga S.G.I.
Team Member
Dissanayake
E/21/113
Dissanayake H.G.K.V.D.C.
Team Member
Madhushan
E/21/245
Madhushan S.K.A.K.
Team Member
Thennakoon
E/21/407
Thennakoon T.M.I.I.C.
Team Member
Academic Guidance

Supervised By

Ms. Yasodha Vimukthi
Ms. Yasodha Vimukthi

Lecturer, Department of Computer Engineering
University of Peradeniya

Mr. Thilina Gunarathne
Mr. Thilina Gunarathne

Lecturer, Department of Computer Engineering
University of Peradeniya

Department of Computer Engineering

Faculty of Engineering · University of Peradeniya · 2025 / 2026