Augmented Reality Application: Virtual fitting room
Paparmali 4 – AR SuperHeroe Outfit using Kinect 2 / Azure Kinect DK Body Tracking
NEWS! Support for Azure Kinect DK Added!
You can test this solution by downloading a watermarked demo from here:
- ** For Kinect 2 (DOWNLOAD):
- ** For Azure Kinect DK (DOWNLOAD):
While testing please use full hd (1920×1080) resolution, otherwise, hand tracking (hand icons) might be off.
In case of Kinect 2 / Azure Kinect DK body tracking host PC hardware recommended minimum requirements:
- Seventh Gen Intel® CoreTM i5 Processor (Quad Core 2.4 GHz or faster)
- 4 GB Memory
- NVIDIA GEFORCE GTX 1070 or better
- Dedicated USB3 port
If you have any doubts using the demo – let us know!
Make sure you have Kinect 2 /Azure Kinect DK attached to your PC before trying it out!
Note: Azure Kinect DK project version doesn’t support Speech recognition.
Originally the project is sold with 13 outfits shown below, however, more outfit options are possible on demand for an extra fee. Take a look at the list of 130 outfits here (pdf file) or as a separate screenshot images here.
The project can be expanded to other outfit model. We have nearly over 100 other outfit models that may be adapted in this project it all depends on your needs.
The archived project size is ~10.6 GB.
Unarchived project size is ~20.2 GB.
Originally the project was built using:
- Unity3D 2018.3.14 version (Kinect 2 version alone) and 2018.4.36f1 version (Azure Kinect DK). Both project versions are provided after acquisition. Please note: it is not recommended using 2019.x.x or above versions of Unity3D as characters contains a specific morphing system that is compatible with 2018.x.x versions of Unity3D.
- Body tracking information was used for outfit augmentations.
- Executables provided to test out the project on PC.
- Make sure you have installed Kinect 2 /Azure Kinect DK drivers/SDKs once you will use the solution within Unity3D Editor.
- * Kinect for Windows SDK v2.0 (Windows-only) can be found here.
- * MS Speech Platform Runtime v11 can be downloaded here or here.
- * Kinect for Windows SDK 2.0 language packs can be downloaded here.
Azure Kinect DK:
- * The latest Azure Kinect Sensor SDK (v1.4.0) can be found here.
- * The latest Azure Kinect Body Tracking SDK (v1.0.1) can be found here.
- * Instructions how to install the body tracking SDK can be found here.
After the purchase of the project you will receive:
A full Unity3D project that includes all the assets (scripts, UI elements, 13 3D outfits, documentation) for the prepared scene that you can see in the video or demo itself. Full support for this project is also provided and we will help you with any question(s) you may have.
Support is TOP priority for this project. If you find any bug/weird behavior of the app – let us know and we will fix it as soon as possible. If Unity3D versions evolved and for some reason the project doesn’t work properly anymore – let us know and we will provide the fix to work on the newest Unity3D version you’re working on. At the moment this project should work from Unity3D 2018.2.x version and above.
For any questions please write to: email@example.com
AR solution purpose
This project is a perfect AR Body Tracking solution for a “Virtual Dressing Room” to augment different types of outfits. Speech recognition can be used to trigger different functions in the same manner as triggering UI element with red symbol on the tracked users’ hand. You can trigger next/previous outfits with a smooth effect transition, turn on a cast effect on your hand or whole body (at random). Also, it is possible to change weight/size of the outfit. It is a perfect fit for the events to attract lots of people to you and your brand. This solution works for one user that should stand in the middle of the screen.
AR Solution that is for sale consists of 13 different outfits that may appear on top of users body.
Once the solution is started user has 2 options:
Option 1. User can trigger functions with hands by pointing the red symbol to a specific button:
- “Weight” button – increases or decreases outfit size.
- “Snapshot” button – takes a screenshot after seconds once the button is triggered.
- “Cast Effect” button – lightning/glowing effect appears on hand (only 1 type of effect).
- “Body Effect” button – a random effect appears on body (1 from 11 possible different effects).
- “Next”/”Previous” buttons – changes outfit with a smooth transition effect.
All interactions are visible once the buttons are in a touch zone – it increases and a loader appears. Checkmark indicates that it is selected/applied or absence of checkmark that it was deselected/removed.
Option 2. User can trigger each functions with speech recognition + additional feature to remove or add different outfit parts. Voice commands that are recognized:
- “Next” / “Previous” – the same as in (Option 1).
- “Effect” – turns on or off body effect as described in (Option 1).
- “Weapon” – turns on or off cast effect as described (Option 1).
- “Weight” – the same as in (Option 1).
- “Snapshot” – the same as in (Option 1).
- “All on” or “Reset” – turns on all outfit parts.
- “All off” – removes all outfit parts (outfit is removed), but effects may still be applied.
- “Arms on” / “Arms off” – turns on/off all the assets (gloves, gountlets etc.) from shoulder to fingertips on both arms.
- “Legs on” / “Legs off” – turns on/off all the assets from the stomach to toes on both legs.
- “Helmet on” / “Helmet off” – turns on/off helmets, hats, masks etc depending on the outfit style user has chosen
- “Chest on” / “Chest off” – turns on/off chest armor.
- “Body on” / “Body off” – turns on/off mostly clothing(s) underneath the armor of the whole body outfit.
Note: speech recognition can be expanded in “SpeechGrammar.grxml” file. How the logic of speech recognition works is described in the documentation (scripts section).
Since 2020.05.01 we offer AR Fitting Room “SmARt Mirror” alternative for casual outfit augmentation here!
Augmented Reality Application: Virtual fitting room
Trend in 2020: Augmented Reality as a novel way of shopping
Based on a report from Gartner, at least 100 million users are expected to utilize AR-enabled shopping technologies in 2019, which is one of the hottest retail trends of this year. The boom in mobile devices that employ AR means the sector is now occupied by robust and mature technologies. Developers, retailers and customers are now comfortably using them as part of their daily experience.
A BRP report indicated that 48% of consumers said that they’d be more likely to buy from a retailer that provided AR experiences. Unfortunately, only 15% of retailers currently put AR to use. Only a further 32% of retailers stated they plan to deploy virtual or augmented reality applications over the next three years.
Several companies have gotten out in front of consumer demand for AR shopping. American Apparel, Uniqlo and Lacoste have deployed showrooms and fitting rooms that provide try-before-you-buy options in augmented reality spaces. Smart mirror technologies that scan RFID tags also offer the ability to bring recommendations to the brick-and-mortar shopping experience. IKEA customers have access to an app that permits them to point their phones at spaces and see what different products would look like in their own homes.
Makeup, fashion and lifestyle brands all stand to gain significant appeal with customers by using technologies that handle facial recognition, adapt to local lighting conditions and provide personalized advice. Virtual assistants will also significantly change the shopping experience [source].