AURA
INITIALIZING AURA
3rd-Year Engineering Project · 2025 / 2026

Intelligent Robotic
Dining Platform

Harmonizing Robotics, IoT & Real-Time Intelligence

AURA automates ordering, kitchen communication, billing, and customer interaction - seamlessly reducing waiting times, elevating the experience, and maximizing operational efficiency.

6+
Smart Features
3
System Layers
<1s
Order Latency
3
Languages
AURA Robot

AURA Concept
About AURA

Automated Urban
Restaurant Assistant

AURA is an intelligent robotic dining assistant and integrated restaurant management platform designed to modernize the dine-in food service industry. It combines social robotics with IoT connectivity and a real-time software ecosystem.

Through AURA, guests can browse visual menus, customize and place orders instantly, track food preparation, and settle bills - all from their table. Orders transmit directly to the kitchen in real time, eliminating communication delays and human errors.

Human-Robot Interaction

Robot physically turns toward the customer, fostering natural engagement

Conversational AI & Voice

"Hey AURA, what are today's specials?" - hands-free ordering

Social Media Photo Mode

AURA smiles for photos and provides branded digital frames


Capabilities

Key Innovative Features

AURA goes beyond digital ordering - introducing advanced interactive hardware & software capabilities.

Responsive Interaction

Advanced touch sensors make the robot physically turn toward the customer upon interaction, creating a natural and engaging dynamic.

Smart AI Upselling

Analyzes cart, time of day, and context to suggest high-margin add-ons - AURA acts as your restaurant's most effective salesperson.

Conversational AI

"Hey AURA, can we get another round of drinks?" - natural language voice commands remove friction and encourage spontaneous ordering.

Facial Expression Recognition

Integrated camera analyzes expressions in real-time - offering assistance for confusion or suggesting items if the customer appears undecided.

Multilingual Interface

Fully localized visual menus in English, Sinhala, and Tamil - all guests navigate comfortably without language barriers.

Entertainment & Engagement

Background music, interactive mini-games while food is prepared, and automated Birthday Celebration Mode with screen animations.


Gallery

Project Showcase

A look at the AURA platform - from concept to prototype.(will be added soon)


System Design

System Architecture

A three-layer IoT architecture - robot nodes, messaging broker, and central intelligence.

System Architecture Diagram
Layer 1 - Robot Nodes

Raspberry Pi 4 (8GB) units at each table with 5" touchscreen, camera, OLED displays, servo motors, and PIR sensors. Handles UI rendering, computer vision, motion control, voice input, and face detection autonomously.

Layer 2 - MQTT Broker

Mosquitto MQTT broker over Wi-Fi coordination. Enables real-time pub/sub messaging between robot nodes, WebSocket communication for live dashboard updates, and Kitchen Display System notifications.

Layer 3 - Central Server

Spring Boot backend on AWS EC2 with PostgreSQL database. Aggregates orders, powers kitchen display, admin dashboard, payment gateway, and REST APIs. Maintains persistent order history and analytics.


Step-by-Step

How It Works

From sit-down to kitchen notification - a seamless automated flow.

01

Customer Detected

PIR motion sensor wakes AURA. Camera activates, OpenCV begins face detection, servos align toward the customer.

02

Browse & Customize

Touchscreen displays visual menus with categories and prices. Customers customize orders via touch or voice.

03

Order Transmitted

JSON-encoded order with table ID published to the MQTT broker instantly over Wi-Fi - zero manual steps.

04

Kitchen Notified

Backend receives order via MQTT+WebSocket, stores in PostgreSQL, and pushes real-time updates to the kitchen display dashboard. AURA confirms with lights & voice.


Technologies

Our Tech Stack

Every tool, framework, and component powering the AURA ecosystem.

Core Technologies

Python
Java
PostgreSQL
OpenCV
Raspberry Pi
AWS
Flask
PyQt5
Spring Boot
React
Docker
Linux

Robot / Embedded

Raspberry Pi 4 OpenCV GPIO Zero Python 3 PyQt5

Communication

Paho-MQTT Wi-Fi REST API JSON

Backend & Cloud

Spring Boot PostgreSQL AWS Docker

AI / Vision / Voice

Haar Cascade SpeechRecognition pyttsx3 NLP

Frontend

React Tailwind CSS Responsive UI

Software Environment

OS
Raspberry Pi OS
Python
3.9+
Broker
Mosquitto
Backend
Spring Boot
Database
PostgreSQL
Cloud
AWS EC2

Hardware Specifications

ComponentSpecificationComponentSpecification
ProcessorRaspberry Pi 4B (8 GB RAM)Audio AmplifierTPA3118 BTL 60W Mono Digital
Primary Display5" 800×480 HDMI TFT LCD Touch ScreenMicrophone InputUSB Microphone Dongle
Computer VisionRPi Camera Module V2 (8MP)Touch SensorsTTP223 1-Ch Capacitive Buttons ×5
Status Displays0.96" 128×64 OLED Module ×2Pan-Tilt MovementStepper Motor + ULN2003 Driver (5V)
Head MovementMG90 Metal Servo Motors ×2 Full SetCamera Bracket2-Axis Servo Pan-Tilt Mount
Servo PWM ControlPCA9685 16-Channel I2C DriverPower Supply5V 3A SMPS Power Adapter
Audio Output4Ω 5W 1.5" SpeakerLogic Level Shifting8-Channel Bi-Directional Level Converter

Financials

Project Budget

Final self-funded component cost breakdown for one AURA robotic unit.

# Item Qty Unit Price (LKR) Total (LKR)
15 inch 800×480 HDMI TFT LCD Touch Screen19,950.009,950.00
2HDMI Cable11,400.001,400.00
30.96 inch 128×64 OLED Display Module2600.001,200.00
4Servo Motor Metal Wheel MG90 Full Set2580.001,160.00
5Servo Motor Driver 16-Channel PCA9685 I2C11,060.001,060.00
64 Ohm 5W Speaker 1.5 inch1980.00980.00
7USB Microphone Dongle Raspberry Pi PC1850.00850.00
8Stepper Motor + ULN2003 Driver (5V)1595.00595.00
95V 3A SMPS Power Adapter1570.00570.00
10TPA3118 BTL 60W Mono Digital Audio Amp1520.00520.00
11TTP223 1-Channel Digital Capacitive Touch560.00300.00
122-Axis Servo Bracket (Camera Mount)1270.00270.00
13HDMI Jointer1250.00250.00
148-Channel Bi-Directional Logic Level Converter1170.00170.00
15DC Jack Barrel Connector Female130.0030.00
Previous Total (Incl. Pi & Camera)48,395.00
Raspberry Pi 4B (8GB) - Dept. Provided1− 28,000.00
Pi Camera Module (V2) - Dept. Provided1− 1,190.00
Final Accurate Total (Your Cost)19,205.00
LKR 19,205
Your Final Cost
15
Components
LKR 29,190
Dept. Covered

The People

Meet the Team

Final-year Computer Engineering undergraduates, University of Peradeniya.

Madhushan
E/21/245
Madhushan S.K.A.K.
Team Member
Dissanayake
E/21/113
Dissanayake H.G.K.V.D.C.
Team Member
Amaranga
E/21/024
Amaranga S.G.I.
Team Member
Thennakoon
E/21/407
Thennakoon T.M.I.I.C.
Team Member
Academic Guidance

Supervised By

Ms. Yasodha Vimukthi
Ms. Yasodha Vimukthi

Lecturer, Department of Computer Engineering
University of Peradeniya

Department of Computer Engineering

Faculty of Engineering · University of Peradeniya · 2025 / 2026