For most people, ‘5G’ – the fifth generation of cellular connectivity technology since 1979 – is associated with telecommunications. Since the deployment of 5G networks in South Korea in April 2019, the technology has been adopted in many countries. Malaysia launched the network at the end of 2021 and by December 2022, 50% coverage of populated areas nationwide was achieved, according to Digital Nasional Bhd.
While 5G may seem to be mainly applicable to mobilephones and internet connectivity, it actually has a far wider scope of application which includes the auto industry. While cars already have connectivity to the internet (and therefore the World Wide Web) and can receive software updates ‘over the air’ (OTA), the much faster speed of 5G transmissions will expand the capabilities of cars in not just driving but also safety.
At CES 2020 (the major consumer electronics trade show in Las Vegas), the Sony Group announced that it would be venturing further into the mobility business, with a sleek prototype car called the VISION-S. At that time, though, what it displayed seemed to be a concept car to show off various technologies, which is also done by other electronics companies
However, the company was actually going further with the concept car and began quietly developing it into a running prototype. By CES 2021, it revealed that there was a running prototype and it was being tested on public roads and on a test track in Austria. Engineers also started verification tests of the safety and user experience of the imaging and sensing technology installed inside and outside the vehicle, along with the human-machine interface (HMI) system.
The VISION-S 02 concept (left) joins the original VISION-S 01 prototype.
Second prototype displayed
At CES 2022 this week, Sony has not only provided an update on the progress of the project but is also displaying a second prototype, the VISION-S 02. This has a SUV design as a new form factor and rides on the same EV/cloud platform as the original VISION-S 01 prototype. By offering entertainment experiences utilizing the large interior space and variations of a 7-seater, this new prototype will promote the accommodation of a large variety of lifestyles within a society where values are becoming increasingly diversified.
The VISION-S 02 measures almost 4900 mm long and 1930 mm wide, which is about the size of a Lexus RX300. It has 200 kW electric motors powering the front and rear wheels so there’s all-wheel drive and the claimed top speed is expected to be over 180 km/h.
Advanced sensor system
Electronics are obviously one of Sony’s strengths and it has been developing a sensors system to support the driver. The system recognizes and analyzes the surrounding environment in real-time, using sensors installed to cover all around the vehicle. These sensors include high-sensitivity, high-resolution, wide dynamic range CMOS image sensors and LiDAR sensors that accurately sense 3-dimensional space.
In addition, the system provides intuitive driver interaction in conjunction with the vehicle’s sound system and HMI system, so that the driver can accurately judge the status of the surrounding environment, such as the presence of emergency vehicles, even from inside the vehicle.
Time-of-Flight (ToF) sensors are used to provide monitoring functions for driver authentication and to watch over passengers. They also support intuitive gesture and voice commands that are intended to enhance usability of the car interface. Additionally, in order to deliver an environment that suits each user’s preferences, the vehicle will include a new function that allows users to customize the display theme and the acceleration and deceleration sounds of the vehicle.
Vehicle settings, key locks, and user settings can be synchronized by linking the vehicle to the cloud using mobile communication, including 5G communication, which features low-latency, high-capacity, and high-speed capabilities. In addition, since updates are reflected in the vehicle via over the air (OTA), it is possible to provide security and evolve service functions and value-added offerings continuously.
5G connectivity
5G driving tests were also conducted from April 2021, the next-generation network connectivity enabling a continuous connection between the in-vehicle systems and the cloud, in order to synchronize data and control signals, and update the systems OTA (Over The Air).
“Real time mobile communication turns cars into databases on wheels. In our 5G Mobility Lab, the VISION-S Prototype learns to communicate in real time. Together with Sony, we are preparing the first prototype for 5G so that in the future new features can be imported into the car over the air and with a simple software update,” said Hannes Ametsreiter, CEO of Vodafone Germany, which is collaborating with the Japanese company.
Utilizing Sony’s in-house technologies and knowledge of communication technology and security cultivated through the development of smartphones, it has positioned remote operation as an important technology in anticipation of the arrival of the autonomous driving era.
Enriching the mobility entertainment space
The seat speakers, which create a three-dimensional sound field, and the streaming service compatible with ‘360 Reality Audio’ provide an immersive music experience. The high quality would only be expected from Sony, which has a strong reputation in this field.
In addition, to provide a high-quality movie experience, the VISION-S models include the fully integrated digital video service ‘BRAVIA CORE for VISION-S’. The service enables shared or individual video playback on the front panoramic screen and individual rear-seat displays. Further extending the possibilities of in-vehicle entertainment, gaming capabilities have expanded to being able to play PlayStation games through a remote connection to a console at home, in addition to the ability to play streaming games through the cloud.
To make the best use of AI and robotics technologies, Sony will soon establish an operating company called Sony Mobility Inc., through which the company intends to explore entry into the EV market.
BMW’s iDrive interface has been around for some 20 years now and with each version, users – primarily the driver although it is also designed for passenger use – have gained better interaction and ‘intelligence’ with the system. Soon iDrive8 will make its debut in the new iX and i4 models with a new generation of displays, controls, software, and extremely powerful connectivity and data processing.
The new iDrive 8 can constantly process large amounts of not only self-generated data but also data collected from the BMW Group vehicle fleet to implement the driver’s wishes in a context-related way. Paving the way for greater personalization is BMW ID, a system which recognizes repetitive situations, learns from them and provides suggestions on how functions can be activated accordingly. Remote Software Upgrade allows the new iDrive to benefit from regular over-the-air improvements, integrate additional functions and stay up to date – without the owner having to bring the car to the service centre.
The integration of third-party apps is more comprehensive than ever too. The most important applications in each individual market around the world can be imported seamlessly into the vehicle’s operating system. The display and operation of these apps will be familiar to customers from their smartphones, expanding the functionality of in-car systems.
Simplifying management of systems
BMW’s iDrive appeared in 2001 with the 7-Series of that model year. It ushered in a new era of in-car operating technology with the aim of getting a grip on the constantly expanding array of functions. As more and more electronic systems could be incorporated for safety, comfort or convenience, it was important that the driver manage them easily and intuitively.
The original iDrive Controller in the 2001 7-Series.
A second Controller was also provided for rear occupants to manage the iDrive, with a screen between the seats,
BMW’s paradigm shift with the iDrive minimized the buttons and controls throughout the cockpit and in their place was a colour screen in the centre of the instrument panel (the control display) and a rotary dial on the centre console (the iDrive Controller). This multifunctional system allowed drivers to control a large number of vehicle settings, entertainment, navigation and telecommunications functions with a single operating tool. Within the space of a few years, iDrive effectively became the new industry standard and proved to be extremely future proof.
20 years later, the developers and designers focusing on user interaction and on the user experience have faced a new set of challenges – a constant stream of new functions is joining the fray, functions are gaining in complexity all the time, and operating them needs to become easier and more natural.
The BMW cars of today are intelligent and able to build a detailed picture of their surroundings and make sense of it using modern sensors and data processing. They are permanently connected to the BMW Cloud and therefore benefit from the combined computing power, long-term and real-time data, machine learning, and swarm intelligence generated by the 14 million connected BMW vehicles out on the roads.
The developers of the new iDrive have carried over the car’s expanded technical abilities into an all-embracing user experience distinguished by its intelligent symbiosis of hardware and software. Looking ahead, the car will become an increasingly smart and automated device which maintains a natural dialogue with the user. This interaction will involve the user simply making iDrive aware of their wishes and requests, while the system learns how its user behaves, comes up with suggestions in real time (based on an extensive pool of detailed knowledge) and actively proposes them to the driver – who then only needs to confirm.
What began with the introduction of a rotary dial and a digital display is now an all-encompassing, intelligent, multi-sensory experience tailored to the user. It brings about another paradigm shift – this time to a natural dialogue between the user and their vehicle: more intuitive, personal, but also engaging.
The new iDrive 8
The first BMW vehicle to receive the new iDrive 8 system will be the iX all-electric Sports Activity Vehicle (SAV). In order to provide an improved interactive experience with this more technologically sophisticated and complex product, voice control and touch functions of the BMW Curved Display are prioritized. The number of buttons and switches has been reduced by almost half compared to current vehicles. At the same time, control clusters for relevant and frequently used basic functions are retained where customers expect to find them.
The control panels on the center console and instrument panel have an all-new minimalist design. The familiar iDrive Controller is the central control element. The Touch Controller is designed in an extremely smart glass-effect finish while the colour and materials used for the centre console give it a very sophisticated appearance.
The Controller is enclosed by a panel with a High-gloss Black frame, a glass-effect surface and white backlit buttons. On the centre console, the control surface with active haptic inputs subdivided by feeler bars is used to select the iDrive menus, My Modes and other functions. The Controller, the rocker switch for gear selection, the audio roller control and the seat adjustment buttons can also be specified in an optional polished crystal finish.
The new generation of iDrive brings with it a new design language with eye-catching graphics, modern colors, futuristic textures and forms and expanded use of light to create an immersive visual experience. At the same time, the user interface has been optimized to present just the right amount of information in an easy-to-understand way.
The extensive individualization options available for the screens in the instrument display can be accessed quickly via the function keys on the steering wheel. The two-axis operating system enables user-friendly vertical list navigation of on-screen content with the rotating key, as well as toggling between menus by tilting the key horizontally.
BMW Intelligent Personal Assistant
The new generation of iDrive also brings additional abilities for the BMW Intelligent Personal Assistant. For a more personal interaction, users can still give the system a name of their choice, which they then use as a prompt. The BMW Intelligent Personal Assistant has an important role to play in creating a natural dialogue between the user and their vehicle. The personal assistant is the central interaction interface with the user – the ‘face’ of the in-car intelligence.
To also enable non-verbal communication with the vehicle occupants in the future, the user experience designers gave the BMW Intelligent Personal Assistant a visual form that also allows it to display gestures. This was based on studies with test persons who were asked to answer selected questions non-verbally. Their movements were recorded, and patterns were established in how certain moods and activities were expressed. These patterns were carried over to the new geometry of the BMW Intelligent Personal Assistant’s visual image with the help of insights from art, as used in the making of animated films.
The personal assistant follows the shy tech principle of design in terms of how and where it is visible. When it is spoken to, it appears in a fluid animation on the relevant screen (information or center control) area and spreads out over the displays. The BMW Intelligent Personal Assistant can distinguish who is talking to it. If the driver is actively engaged, the Intelligent Personal Assistant’s visual image appears in the right-hand area of the information display or in the BMW Head-Up Display and signals its readiness to accept spoken instructions. If prompted by the front passenger, the assistant’s image appears in the right-hand area of the BMW Curved Display
When interacting with the BMW Intelligent Personal Assistant and using the new iDrive 8, drivers benefit from increased personalization of the user experience based on the BMW ID. Current BMW ConnectedDrive customers are able to use their existing credentials to access their BMW ID. In future, it will be possible to securely store more personalized settings in the BMW ID and transfer them between vehicles. Once the BMW ID has been loaded, the driver will receive a personal greeting which will include the customized profile image that can be uploaded in the My BMW App.
Technology and connectivity
The iDrive 8 is the most powerful and encompassing technology ever created by BMW. In recent years, there has been a huge increase in the software scopes for the iDrive system. Today, BMW’s iDrive handles a wide array of tasks that extend far beyond a conventional display and operating concept. These range from integrating telematics and connected services to data processing and preparation, connecting to devices and deep integration of third-party apps or projected modes, as well as seamless integration of cloud-based services like BMW Maps.
The BMW Group has been developing the central control unit and software integration platform in-house, entirely on Linux since 2013. Having complete control over software is crucial for creating a stable, upgradeable, high-quality system that distinguishes the brand. In the past, the BMW display and iDrive system has been overhauled on average every 3 years, a cycle that is roughly half as long as the complete product development cycle for a vehicle.
In the era of fast-paced digital development, it is no longer enough to completely update a model’s digital features every three years, and this resulted in a fundamental change of approach in 2018. The arrival of Remote Software Upgrade means owners have been able to keep their vehicle up to date with the latest software at all times. New functions can be imported quickly and easily over the air, either using the car’s built-in SIM card or via the My BMW App. Remote Software Upgrade has a crucial role to play in the new iDrive 8 by offering the possibility of performing extremely complex and large software updates in areas such as driving assistance and partial automation.
5G mobile technology
The iX will be the first premium model available worldwide that is compatible with 5G mobile technology. 5G offers extremely high data bandwidth and low latency – meaning fast data transmission – and also expands the possibilities for connectivity between the vehicle and its environment. It forms the basis for real-time reception and transmission of large volumes of data and sensor system information to the BMW Cloud. Together with the quality of service offered by the 5G network, this will bring about significant enhancements and innovations in the areas of entertainment, infotainment, automated driving and road safety. The iDrive 8 has been prepared for making optimum use of the data speeds offered by 5G.
BMW iX, an all-electric SAV, will be the first model to have the new iDrive 8 system.
The fifth generation of broadband wireless networking is eagerly being awaited by mobilephone users who expect communication speeds up to 3 times faster than current 4G LTE performance. Larger data volumes can be transmitted more efficiently and therefore reduce the time it takes to load and view pages on a screen.
But it’s not just millions of mobilephone users who are waiting as the auto industry is also looking forward to using 5G because it enables secure and instantaneous data transmission between machines. This also benefits fully automated driving functions, which place high demands on the flow of information with the infrastructure and other vehicles.
The data volumes being transmitted via wireless networks are rising, due primarily to increasing machine-to-machine communication (M2M communication). In the automotive field, it is primarily fully automated driving that is spurring on this development. While the data volumes per hour in current highly networked vehicles are in the gigabyte range today, the figure will be multiple terabytes by 2025.
Another advantage compared to 4G is that 5G can also serve a larger number of end devices per network cell. The network prioritizes the applications and adjusts the transmission—if necessary—to the load situation. The data for time-critical applications is conducted through the network faster than other data, such as the video streams of private users.
For safety reasons, automated driving functions must naturally be designed in such a way that all eventualities that may arise during the drive can be recognized and safely handled entirely with the vehicle’s own assistance systems. That applies in equal measure on highways, rural roads, and urban roads. In borderline situations such as poor visibility or complicated traffic situations, additional information drawn from the exchange of data with the infrastructure or other vehicles—what is known as C2X communication—can substantially enhance the control accuracy of the onboard systems.
Taking the complete route into account
“Currently, the sensor technology on the vehicle only covers a range of a maximum of 300 metres around it. Using the sensor data from other vehicles and the infrastructure, information from all along the entire route can be taken into account,” explained Jaime Arveras, responsible for Connected Car functionality at Porsche Engineering. “Driving manoeuvres can be much more effectively adapted to requirements and hazard situations detected at an early stage.”
This, in turn, opens up entirely new possibilities for driver assistance systems. Turn assistance systems, for example, can, with the aid of a C2X connection, detect even before the turn that pedestrians are on the road after the turn-off or that the route is blocked by an accident.
In enclosed spaces such as parking garages, C2X communication enables automated valet parking. The driver exits the vehicle at the garage entrance and hands over the vehicle to the parking garage control system. It then drives the vehicle, completely automatically, to the parking space and later returns it in like fashion.
Another example application based on C2X communication is currently being tested: coordinated driving of multiple vehicles in a line with minimal gaps between them. This ‘platooning’ makes better use of the slipstream and could reduce fuel consumption, particularly in highway caravans of commercial vehicles driving in formation. Without fast communication, it is simply impossible; if one vehicle in the platoon brakes, the signal must be transmitted to the following vehicles without delay and braking immediately initiated there in order to avoid rear-end collisions.
“C2X communication via 5G will, in many cases replace the coordination between drivers that we see today, which cannot be represented by sensors,” said Kai Schneider, who works on 5G-based C2X concepts as a development engineer with Porsche AG. “This applies, for example, to the smooth and rapid merging procedure on the highway. To achieve fully automated driving with a high comfort level, which can also be integrated into existing traffic, there is therefore definitely a need for communication between the vehicles.”
But even before any fully automated driving functions have been implemented in vehicles, the high speed of 5G communication makes it possible to introduce new assistance functions. For example, to provide greater clarity in complex situations, such as when visibility of oncoming traffic is limited. A truck driving in front could transmit its video image of the road to the display of the following vehicle in real time. The driver of that vehicle would then be able to see what’s happening in front.
Cross-industry alliance to advance 5G
The use of 5G technology for automated driving is being studied by a cross-industry alliance of telecommunications providers, automobile manufacturers and research institutes in a variety of different projects. “Only through the interaction of various technologies and together with partners in and around the vehicle can the vehicle drive in an anticipatory manner, detect hazards in good time and efficiently carry us from A to B,” said Dr. Johannes Springer, director of the automotive 5G program at Deutsche Telekom.
Compared with the 3G and 4G networks, the 5G standard currently slated for use in Germany works with higher frequencies of 2 and 3.6 GHz. They can handle larger data rates, though they have the physical limitation of a smaller range. Building the network will therefore require the installation of many more cell towers than for 3G and 4G. It is—unless prescribed by legislation for the required network coverage—controlled by the network operators on the basis of local requirements. Where large data exchange volumes are required and it is economically viable, they install the base stations. For automated driving, an ultrafast high-performance data network will take shape along the traffic arteries (on highways, on federal and state roads, and in urban areas).
To ensure the international compatibility of 5G components, binding standards must be introduced worldwide. Here, too, an important milestone has already been reached. In June 2018, the first 5G standards were passed by the competent authority, the 3rd Generation Partnership Project (3GPP).
Almost all (97%) of residents in Malaysia who participated in a survey think that owning a car is important and 67% still see the car as the ideal mode of transport. However, more than half (51%) said that they would consider giving up car ownership and rely on long-term car rental if it was convenient and easy for them.
This is the finding of ‘The Road Ahead: The Future of Mobility’, a new report by Avis Budget Group which examines the way in which the mobility landscape is changing around the world, how it is likely to look in the future and, how people in different countries view these changes.
In the research conducted across 16 countries in Europe and Asia, including Malaysia, respondents revealed that over the next decade, consumers are likely to move to an access-driven and on-demand model as their favourite mode of transportation.
Technology drives transport revolution
The single biggest factor leading the transport revolution is technology, specifically 5G networks. Most recently, the Malaysia government has started a nationwide demonstration of 5G projects that indicated it was on track to becoming one of the first Asian countries to launch the technology. Once implemented, the large amounts of data provided by the 5G networks will enable mobility companies to collect and mine data for insight, which can be used to improve travel experiences.
To this point, the Avis Budget Group’s research revealed that 73% of respondents feel comfortable having their data accessed and shared for the implementation of smart infrastructure and better travel experience. More than 4-in-5 (81%) of respondents also expect driving to become easier in the coming years.
“Driven by technology advancements and the influence of services like Amazon, Netflix and Spotify, people today want to consume and access products and services at the click of a button. The expectation for an on-demand service has impacted the mobility industry and resulted in the evolution we’re seeing today – from being able to book a taxi instantly to hiring a car for a week-long holiday – all from your smartphone. However, our report reveals that we are now seeing a rise in this demand for instant access and flexibility, resulting in changing behaviours towards car ownership,” said Keith Rankin, President, International, Avis Budget Group.
“Changing needs and the expansion of the sharing economy offer both challenges and opportunities for the mobility industry. Our research has shown that whilst consumers are expectant of connected, integrated and on-demand services, they still want convenience at a reasonable price.
“It’s imperative that different mobility players work together to ensure the future needs of consumers are met. We have demonstrated the success of collaboration, as shown with our fleet management as a service (FMaaS) partnerships with Via and Lyft, and our agreements with Ford and Continental in providing connected cars,” he added. “Our partnerships demonstrate well how the sector can work together to provide the on-demand and connected services that customers want. These can range from a technology giant delivering 5G, or local governments working with the private sector for improved, urban electric vehicle access for residents.”
