Using computer vision to improve the airport lounge experience
Customer:
Global airlineChallenge:
- Optimize the usage and operation of more than 50 airport lounges in 31 airports, worldwide.
- Implement a computer vision solution to improve the overall lounge-customer experience, streamline operations and drive revenue by upscaling the services for members and non-members alike.
- Unify the guest experience and lounge operations by using smart space technology to provide reliable occupancy data that unlocks valuable insights from lounge utilization rates.
Solution:
- The airline’s strong partnership with Microsoft enabled extensive use of their technology, cutting costs and development time of visitor tracking software concepts and prototypes.
- Our customized solution integrated Microsoft computer vision hardware and IoT management software to establish a contactless occupancy monitoring process and a reporting dashboard for decision support tools.
- In just 6 weeks, we had a working prototype which could detect the entry and exit of over 9,500 customers with more than 90% tracking accuracy, enabling lounge operators to enhance the guest experience and unlock new revenue streams.
Results:
- The airline established a platform for the smartspace-enabled airline lounge.
- Real-time utilization rates enabled new capabilities:
- Anticipating and addressing overcrowding
- Improving supply chain and logistics management
- Exploring demand-based pricing for passengers at times of low occupancy
Who, when, where?
Our customer – a global airline handling more than 140 million passengers a year – asked Luxoft to use computer vision techniques to help optimize the usage and operation of more than 50 airport lounges in 31 airports, worldwide. Typically, preregistered passengers (or those with day passes), would make their way to the lounge after checking in. Then, having arrived at the concierge desk and scanned their boarding passes, they would be free to relax, connect to the wifi, have something to eat and drink, read a newspaper, or simply work on their laptops until their flight is called. However, the visitor experience would fluctuate according to how busy the lounge was, whether a favorite food item was available, if the newspapers had already been claimed and so on.
Consequently, the customer needed a visitor tracking software solution to improve the overall lounge-customer experience, streamline operations and drive revenue by upscaling the services for members and non-members alike.
Optimizing occupancy levels
The Luxoft team realized that, before doing anything else, they needed to bring the airline up-to-speed with how many visitors were occupying their airport lounges at any one time. They also needed to understand the impact of different days of the week and times of day on crowd analytics, to be able to predict and avoid overcrowding and improve the management of lounge amenities (e.g., food and beverage inventories). That included operational costs and the inevitable inconvenience associated with a manual check-in/check-out process.
Luxoft realized their idea of a connected, technology-driven smart space, through a series of computer vision concepts and prototypes. While the ultimate objective was to upgrade the lounge-customer experience, our technology roadmap began with the kind of core-enabling capability that often accompanies smart spaces: visitor tracking. While the airline had data for individual passengers entering the lounge, there was nothing to tell them when those passengers left. This blocked valuable insights into lounge utilization rates that could have unlocked a series of downstream capabilities.
In step with the airline’s partnership with Microsoft, Luxoft used as much of their technology as possible to cut both costs and development time, while maintaining a level of accuracy that would underline the benefit of crowd analytics. Later iterations of the technology focused on accuracy and technology optimization.
Smarter spaces
For the initial prototype, the team selected a Microsoft Kinect, a Surface Pro 4 with built-in LTE, Microsoft’s Azure IoT suite for streaming data ingestion and a custom data-visualization dashboard, built as a responsive web app for mobile and fixed kiosk viewing. On the back-end, Luxoft leveraged the Kinect SDK to write a custom algorithm for motion-based feature detection. The Kinect hard-lined to a wall-mounted Surface Pro for processing, real-time occupancy count visualization and data upload via LTE to the customer’s Azure cloud instance. In Azure, the architecture leveraged IoT Hub and DocumentDB, with APIs exposing the data for downstream consumption. Through these APIs, historical data was integrated into a manager dashboard for status visualization and trend analysis.
Main features:
- Visitor tracking
- Real-time reporting on nationwide lounge occupancy
- Data visualization and reporting
- Manager dashboard for decision support tools
Partner technologies:
- Microsoft Xbox Kinect
- Microsoft Azure IoT Suite
- Microsoft Power BI
- Microsoft Surface Pro 4 with LTE
An impressive track record
In just 6 weeks, Luxoft launched a working prototype at Chicago’s O’Hare International Airport (one of their busiest lounges) prior to the holiday season, which tracked the entry and exit of over 9,500 visitors with over 90% accuracy. This set the stage for future development and scalability across a network of international locations, establishing a platform for the smart-space-enabled airline lounge.
With real-time utilization rates at the discrete lounge level, the airline unlocked several new capabilities, including:
- Knowing when to anticipate and how to address overcrowding (in line with capacity limitations). With future improvements, the solution aims to proactively reduce overcrowding through machine learning and trend analytics. For example, in airports with multiple lounges, the airline can hand-off balances to lounges with lighter utilization
- Improving supply chain and logistics management for food, beverages and other lounge amenities, plus reducing waste and costs by not carrying any more inventory than strictly necessary
- Exploring demand-based pricing for passengers at times of low occupancy
This concept can be applied to many other industries. Any location with reasonable footfall can benefit from accurately tracking and analyzing variables like staffing, revenue, operational performance and overall efficiency. It enables deeper visitor engagement through the gathering of richer data and more-specific visitor tracking solutions.
Are you ready to use computer vision techniques and watch your business really take off? Contact us to speak to one of our experts.