Virtual Drive Testing Toolset - Case Study
Virtual Drive Testing Toolset
Leading European Mobile Operator Uses Virtual Drive Testing
To cost-effectively roll out new technology and achieve superior Quality of Experience
A leading European mobile operator with operations in more than a dozen markets and almost a quarter of a billion mobile subscribers was looking to cost-effectively improve the end-user experience as well as deploy new technology without interrupting the live network.
A key part of their strategy included offering their subscribers mobile broadband services with access to the latest technology whilst maintaining a high quality of experience. In order to do so, they needed to identify network parameters that played a significant role in improving interoperability. These parameters had to be optimized for a multi-RAT environment and under various handover and mobility scenarios.
It was also important for them to find a cost and time efficient method of evaluating the performance subscribers experience when using new technology features such as Carrier Aggregation, VoLTE, IMS and new MIMO schemes.
Highly Realistic Field-to-Lab Testing Experience
The leading mobile operator selected Virtual Drive Testing (VDT) Toolset to enable quick and cost-effective benchmarking of mobile devices and network infrastructure in a controlled laboratory environment.
VDT Toolset allowed them to use data captured in the field to build tests and replay drive or indoor test routes in the lab by emulating real-world RF propagation conditions.
Its integrated solution offered them a highly realistic ‘field-to-lab’ experience for reliable and repeatable testing across a wide range of conditions and mobility scenarios.
The straightforward access to ready-to-run performance and interoperability test case packages gave them automatic evaluation of Quality of Experience metrics. This significantly simplified and accelerated test case planning and scheduling.
VDT Toolset's automation capability creates defined key performance indicators from wireless virtual drive tests, leading to quick and easy test case analysis.
"Virtual Drive Testing Toolset has proven very powerful in reproducing the end-user experience in a controlled environment. It helps us deliver the best products to our customers.
We are able to test and validate new concepts and features to solve network issues and assess performance in a cost and time effective way. The toolset helps us improve the quality of our network and our competitiveness in the market."
Mobile Operator Test Engineer
Automated testing of devices and network infrastructure
Keysight’s Virtual Drive Testing Toolset is an automated, lab-based performance and interoperability test solution for cost-effective assessment of mobile devices and network infrastructure.
It uses field data derived from drive test logs to build virtual test routes that mimic specific end-user scenarios.
"VDT Toolset users, such as the mobile operator in this case study, really benefit from its realistic and seamless playback of a real-world RF environment.
Its built-in automated interoperability and performance test cases accelerate product rollouts and reduce testing costs."
Juha Määttä, Product Manager, Channel Emulators
VDT Toolset integrates all needed components for seamless automated drive testing in the laboratory including KPI analysis.
The toolset executes automated test campaigns based on typical usage scenarios. This enables the user to readily assess Quality of Experience from an end-user’s perspective.
Integrated solution for seamless automated drive testing in the laboratory
VDT Toolset enables the user to replicate drive test conditions in the lab
Flexible testing across a wide range of scenarios and technologies
VDT Toolset offers flexible testing capabilities
Comprehensive Inter-RAT and Intra-RAT handover testing
The high capacity solution enables the user to connect the Propsim F32 channel emulator with multiple base stations equipped with different radio access technologies. For example, the system can support a lab set-up consisting of 2 LTE cells, 3 UTRAN cells, 2 GERAN cells and radio channel profiles for each lab cell that are mapped from applicable field recorded live network cell from drive test data.
This capability allows the user to evaluate mobile device performance and assess best available radio access utilization in mobility conditions. It also enables the user to optimize the network infrastructure configuration and parameters with multi-layered network infrastructure.
VDT Toolset accurately replicates the real-world environment
Wide-ranging end-user scenario testing
VDT Toolset enables the user to verify Key Performance Indicators (e.g. download data rates, VoLTE call success rate and call drop rate) relevant to verifying the end-user experience of accessing different applications.
The testing is conducted under various mobility scenarios such as handover between radio access technologies and between multiple radio base station cells.
Automated testing with a single test run for all user scenarios and KPIs
The automated capability allows the user to set up a single test campaign that covers every user scenario and provides results for all requested KPIs.
Data intensive application testing
VDT Toolset offers the user the ability to test data intensive applications such as video or voice calls supported by VoLTE, SRVCC and CSFB technologies. The user is able to easily measure data download rate, call success rate and call drop rate under various mobility conditions such as urban city environments, highways, railways and road tunnels.
The user is also able to simultaneously evaluate the use data intensive applications and voice call performance,which can reveal significant performance gaps between various devices due to different processing capacity and design optimization.
Interoperability testing of network infrastructure from multiple vendors
VDT toolset creates a controlled laboratory environment that enables the user to cost-effectively perform interoperability testing of network infrastructure from multiple vendors using a ‘golden reference’ device.
Benchmarking of high-end smart phones
VDT Toolset allows the user to benchmark high-end smart phones in regard how well they perform by measuring mobile data performance and call drop rates KPIs under various mobility scenarios such as in a handover between base station cells in a multi-RAT network.
Video: Key Features & Capabilities in Virtual Drive Testing Toolset
Efficient and reliable device benchmarking
In a controlled, repeatable and automated test environment
Do you have a need to benchmark or performance test:
- Mobile devices?
- Network equipment?
- End-user experience of accessing different applications?
VDT Toolset’s automation capability enabled this leading mobile operator to run testing 24 hours a day, seven days per week, which led to significantly improved test efficiency.
The toolset’s user centric QoS measurements revealed key differences between high-end devices, which helped them advise enterprise customers in the selection of mobile devices for business use where performance and reliability requirements are essential for fluent use of enterprise applications.
VDT Toolset allowed the mobile operator to evaluate parameters in a controlled laboratory environment with few variables, which reduced the need for performing ad hoc testing in the field and therefore also minimized the risk for interrupting service to end-users.
VDT Toolset with its sophisticated KPI reporting allowed them to evaluate parameters in a systematic and time efficient way and gave them immediate access to performance comparison and analysis.
Click here to view our Virtual Drive Testing Toolset brochure: