AURA
INITIALIZING AURA
3rd-Year Engineering Project · 2025 / 2026

Intelligent Robotic
Dining Platform

Harmonizing Robotics, IoT & Real-Time Intelligence

AURA automates ordering, kitchen communication, billing, and customer interaction — seamlessly reducing waiting times, elevating the experience, and maximizing operational efficiency.

6+
Smart Features
3
System Layers
<1s
Order Latency
3
Languages
AURA Robot

AURA Concept
About AURA

Automated Urban
Restaurant Assistant

AURA is an intelligent robotic dining assistant and integrated restaurant management platform designed to modernize the dine-in food service industry. It combines social robotics with IoT connectivity and a real-time software ecosystem.

Through AURA, guests can browse visual menus, customize and place orders instantly, track food preparation, and settle bills — all from their table. Orders transmit directly to the kitchen in real time, eliminating communication delays and human errors.

Human-Robot Interaction

Robot physically turns toward the customer, fostering natural engagement

Conversational AI & Voice

"Hey AURA, what are today's specials?" — hands-free ordering

Social Media Photo Mode

AURA smiles for photos and provides branded digital frames


Capabilities

Key Innovative Features

AURA goes beyond digital ordering — introducing advanced interactive hardware & software capabilities.

Responsive Interaction

Advanced touch sensors make the robot physically turn toward the customer upon interaction, creating a natural and engaging dynamic.

Smart AI Upselling

Analyzes cart, time of day, and context to suggest high-margin add-ons — AURA acts as your restaurant's most effective salesperson.

Conversational AI

"Hey AURA, can we get another round of drinks?" — natural language voice commands remove friction and encourage spontaneous ordering.

Facial Expression Recognition

Integrated camera analyzes expressions in real-time — offering assistance for confusion or suggesting items if the customer appears undecided.

Multilingual Interface

Fully localized visual menus in English, Sinhala, and Tamil — all guests navigate comfortably without language barriers.

Entertainment & Engagement

Background music, interactive mini-games while food is prepared, and automated Birthday Celebration Mode with screen animations.


Gallery

Project Showcase

A look at the AURA platform — from concept to prototype.(will be added soon)


System Design

System Architecture

A three-layer IoT architecture — robot nodes, messaging broker, and central intelligence.

System Architecture Diagram
Layer 1 — Robot Nodes

RPi 4 powered units at each table. Handles UI rendering, computer vision, servo control, and PIR detection autonomously.

Layer 2 — MQTT Broker

Paho-MQTT pub/sub messaging over Wi-Fi. Real-time order events flow between all robot nodes and the central server.

Layer 3 — Central Server

AWS-hosted backend with PostgreSQL. Aggregates orders, powers kitchen display, owner dashboard, and exposes REST APIs.


Step-by-Step

How It Works

From sit-down to kitchen notification — a seamless automated flow.

01

Customer Detected

PIR motion sensor wakes AURA. Camera activates, OpenCV begins face detection, servos align toward the customer.

02

Browse & Customize

Touchscreen displays visual menus with categories and prices. Customers customize orders via touch or voice.

03

Order Transmitted

JSON-encoded order with table ID published to the MQTT broker instantly over Wi-Fi — zero manual steps.

04

Kitchen Notified

Flask server receives, stores in SQLite, and pushes to the kitchen display. AURA confirms with lights & voice.


Technologies

Our Tech Stack

Every tool, framework, and component powering the AURA ecosystem.

Core Technologies

Python
Java
PostgreSQL
OpenCV
Raspberry Pi
AWS
Flask
PyQt5
Spring Boot
React
Docker
Linux

Robot / Embedded

Raspberry Pi 4 OpenCV GPIO Zero Python 3 PyQt5

Communication

Paho-MQTT Wi-Fi REST API JSON

Backend & Cloud

Spring Boot PostgreSQL AWS Docker

AI / Vision / Voice

Haar Cascade SpeechRecognition pyttsx3 NLP

Frontend

React Tailwind CSS Responsive UI

Software Environment

OS
Raspberry Pi OS
Python
3.9+
Broker
Mosquitto
Backend
Spring Boot
Database
PostgreSQL
Cloud
AWS EC2

Hardware Components

ComponentSpecificationComponentSpecification
CPURaspberry Pi 4 (4 GB)SensorHC-SR501 PIR
Display7" IPS Capacitive TouchTouchMPR121 Capacitive Controller
CameraRPi Cam V2 — 8 MPPower10 000 mAh Li-ion + UPS
ActuatorsMG90S Servo Motors × 2Audio2W MIT M38 Speaker
LEDsWS2812B RGB StripDisplay 20.9" TFT × 2

Financials

Project Budget

Detailed component-level cost breakdown for one AURA robotic unit.

# Item Qty Unit Price (LKR) Total (LKR)
1Raspberry Pi 4B (4 GB)128,00028,000
27-inch IPS Touch Display115,00015,000
3Raspberry Pi Camera Module (V2)16,0006,000
4Pan/Tilt Servo Mechanism11,5001,500
5Servo Motors (MG90S)21,5003,000
62W Speaker (MIT M38)11,2001,200
7Lithium-ion Battery (10,000 mAh)15,0005,000
818650 UPS Shield X70316,5006,500
90.9" TFT Display28901,780
10MPR121 Capacitive Touch Controller1540540
Grand Total68,520
LKR 68,520
Total Per Unit
10
Components
40.9%
Computing (RPi 4)

The People

Meet the Team

Final-year Computer Engineering undergraduates, University of Peradeniya.

Madhushan
E/21/245
Madhushan S.K.A.K.
Team Member
Dissanayake
E/21/113
Dissanayake H.G.K.V.D.C.
Team Member
Amaranga
E/21/024
Amaranga S.G.I.
Team Member
Thennakoon
E/21/407
Thennakoon T.M.I.I.C.
Team Member
Academic Guidance

Supervised By

Ms. Yasodha Vimukthi

Lecturer, University of Peradeniya

Department of Computer Engineering

Faculty of Engineering · University of Peradeniya · 2025 / 2026