Augmented Reality Application: Virtual fitting room
Paparmali 4 – AR SuperHeroe Outfit using Kinect 2 Body Tracking
You can test this solution by downloading executables from here.
Make sure you have Kinect 2 attached to your PC before trying it out!
The project can be expanded to other outfit model. We have nearly over 100 other outfit models that may be adapted in this project it all depends on your needs.
The archived project size is ~10.6 GB.
Unarchived project size is ~20.2 GB.
Originally the project was built using:
- Unity3D 2018.3.14 version
- Kinect 2 plugin (from Unity Asset Store) – Body tracking information was used for outfit augmentations.
- Executables provided to test out the project on PC.
- Make sure you have installed Kinect 2 drivers once you will use the solution within Unity3D Editor:
- * Kinect for Windows SDK v2.0 (Windows-only) can be found here.
- * MS Speech Platform Runtime v11 can be downloaded here. Please install both x86 and x64 versions, to be on the safe side.
- * Kinect for Windows SDK 2.0 language packs can be downloaded here.
Support is TOP priority for this project. If you find any bug/weird behavior of the app – let us know and we will fix it as soon as possible. If Unity3D versions evolved and for some reason the project doesn’t work properly anymore – let us know and we will provide the fix to work on the newest Unity3D version you’re working on. At the moment this project should work from Unity3D 2018.2.x version and above.
For any questions please write to: email@example.com
AR solution purpose
This project is a perfect AR Body Tracking solution for a “Virtual Dressing Room” to augment different types of outfits. Speech recognition can be used to trigger different functions in the same manner as triggering UI element with red symbol on the tracked users’ hand. You can trigger next/previous outfits with a smooth effect transition, turn on a cast effect on your hand or whole body (at random). Also, it is possible to change weight/size of the outfit. It is a perfect fit for the events to attract lots of people to you and your brand. This solution works for one user that should stand in the middle of the screen.
AR Solution consists of 13 different outfits that may appear on top of users body.
Once the solution is started user has 2 options:
Option 1. User can trigger functions with hands by pointing the red symbol to a specific button:
- “Weight” button – increases or decreases outfit size.
- “Snapshot” button – takes a screenshot after seconds once the button is triggered.
- “Cast Effect” button – lightning/glowing effect appears on hand (only 1 type of effect).
- “Body Effect” button – a random effect appears on body (1 from 11 possible different effects).
- “Next”/”Previous” buttons – changes outfit with a smooth transition effect.
All interactions are visible once the buttons are in a touch zone – it increases and a loader appears. Checkmark indicates that it is selected/applied or absence of checkmark that it was deselected/removed.
Option 2. User can trigger each functions with speech recognition + additional feature to remove or add different outfit parts. Voice commands that are recognized:
- “Next” / “Previous” – the same as in (Option 1).
- “Effect” – turns on or off body effect as described in (Option 1).
- “Weapon” – turns on or off cast effect as described (Option 1).
- “Weight” – the same as in (Option 1).
- “Snapshot” – the same as in (Option 1).
- “All on” or “Reset” – turns on all outfit parts.
- “All off” – removes all outfit parts (outfit is removed), but effects may still be applied.
- “Arms on” / “Arms off” – turns on/off all the assets (gloves, gountlets etc.) from shoulder to fingertips on both arms.
- “Legs on” / “Legs off” – turns on/off all the assets from the stomach to toes on both legs.
- “Helmet on” / “Helmet off” – turns on/off helmets, hats, masks etc depending on the outfit style user has chosen
- “Chest on” / “Chest off” – turns on/off chest armor.
- “Body on” / “Body off” – turns on/off mostly clothing(s) underneath the armor of the whole body outfit.
Note: speech recognition can be expanded in “SpeechGrammar.grxml” file. How the logic of speech recognition works is described in the documentation (scripts section).
Augmented Reality Application: Virtual fitting room
Trend in 2020: Augmented Reality as a novel way of shopping
Based on a report from Gartner, at least 100 million users are expected to utilize AR-enabled shopping technologies in 2019, which is one of the hottest retail trends of this year. The boom in mobile devices that employ AR means the sector is now occupied by robust and mature technologies. Developers, retailers and customers are now comfortably using them as part of their daily experience.
A BRP report indicated that 48% of consumers said that they’d be more likely to buy from a retailer that provided AR experiences. Unfortunately, only 15% of retailers currently put AR to use. Only a further 32% of retailers stated they plan to deploy virtual or augmented reality applications over the next three years.
Several companies have gotten out in front of consumer demand for AR shopping. American Apparel, Uniqlo and Lacoste have deployed showrooms and fitting rooms that provide try-before-you-buy options in augmented reality spaces. Smart mirror technologies that scan RFID tags also offer the ability to bring recommendations to the brick-and-mortar shopping experience. IKEA customers have access to an app that permits them to point their phones at spaces and see what different products would look like in their own homes.
Makeup, fashion and lifestyle brands all stand to gain significant appeal with customers by using technologies that handle facial recognition, adapt to local lighting conditions and provide personalized advice. Virtual assistants will also significantly change the shopping experience [source].