Directio-AR Assisted ShopMate

Abstract

In the expansive aisles of hypermarkets,
locating specific products often proves challenging, leading to
impulsive purchases and budgetary oversights. This app
emerges as an innovative solution, combining augmented
reality technology with machine learning to transform the
shopping experience. The application features an AR way
point using ARcore that shows the route to be taken to help
the users in locating specific products efficiently within the
supermarket. Customers follow the AR way point,
effortlessly finding their desired items, enhancing their
shopping experience. Upon reaching products the products
are identified using real time object detection using YOLO
model. After detecting the products using object detection the
app provides information tabs displaying vital details like
specifications, prices, ingredients, nutritional contents etc.
The app promotes mindful spending by integrating a
dynamic cart feature, allowing real-time expenditure
tracking to ensure adherence to budget constraints. The
system redefines grocery shopping, empowering customers
with precise guidance, informed choices, and a more efficient
and enjoyable retail experience.