Back in 2020, at the Consumer Electronics Show, Sony displayed a concept car which was assumed to be just for the purpose of showing off its latest technologies. There was no indication the company wanted to start making cars as well and after the event, nothing more was heard. But during the 12 months until the next show – and it should be remembered the world was going through the COVID-19 pandemic – Sony actually had a running prototype and by CES 2021, it showed a short video of a car – known as Vision-S – being tested on public roads and on a test track in Austria.
At CES 2022, Sony revealed a SUV prototype as a second model and it became clear that the company, better known for its electronic devices, was moving into the mobility business. However, it sought a partner with automotive experience and that partner was Honda. The companies announced a joint-venture company called Sony Honda Mobility Inc (SHM) which would ‘engage in the joint development and sales of high value-added battery electric vehicles (BEVs) and commercialize them in conjunction with providing mobility services’.
“SHM strives to become a Mobility Tech Company that will pursue innovation in mobility by combining cutting-edge technology and passion along with people who pioneer the future with their creativity, based on our corporate purpose ‘Move people, through the pursuit of innovation with diverse inspirations’,” said Yasuhide Mizuno, CEO of Sony Honda Mobility (incidentally, Mr. Mizuno was a former Managing Director/CEO of Honda Malaysia 12 years ago).
Car manufacturers are constantly introducing new technology in their models, often (but not always) starting at the top end due to the high initial cost. The innovative technology may be unique to the manufacturer and is described in detail but gets lost as the model it is in may also be significant as well. But over time, the innovative technology starts to spread to other models and becomes a standard feature. Two examples would be the Mercedes-Benz MBUX and Peugeot’s i-Cockpit which can be found in every new model each manufacturer launches.
Renault too has a new breakthrough in on-board technology that it is now introducing, and it would be worthwhile remembering that it first appeared at the beginning of 2022. It’s called OpenR and takes the touchscreen to a new level. In time, it will surely start to appear in other new models to come.
Evolution of displays over 35 years
The first production car with a touchscreen was the Buick Riviera some 35 years ago. Since then, in-vehicle electronics have come a long way, with the hardware becoming more efficient, the experience smoother, and screens getting larger and having higher resolution. Navigation is now effortless and intuitive, and the applications can be easily updated ‘over the air’, so they always perform at their best.
And one thing hasn’t changed much recently: multimedia systems in vehicles are looking more and more like smartphones. The main challenge for Renault when developing its new Megane E-TECH Electric was to offer an even better interface enabling customers to find everything they need very fast and intuitively.
Totally new electronic architecture
To achieve this, an electronic architecture like nothing the market has seen before was developed. It modernises driver assistance systems and enhances viewing comfort, and the Megane E-TECH Electric is the first car to get it.
From where the driver is sitting, the striking feature of Open R is its sweeping digital display made of up two screens forming an ‘L’. The vertical 12-inch screen is on the car’s centre console, with a horizontal 12.3-inch screen is built into the dashboard, behind the steering wheel.
Together, the two screens span 774 sq. cm. and maximise the display area to provide an immersive experience. They are the biggest screens Renault has ever built into a vehicle, with the glass panels blending into the cockpit’s lines. They are in the best position for the driver to see it and operate easily, to take full advantage of the multimedia capabilities without taking their eyes off the road.
CMF-EV platform
The technical feat overlaps with the arrival of the all-new CMF-EV platform for electric vehicles. Thanks to it offering new design flexibility, the engineers were able to move the air-conditioning unit into what used to be called the ‘engine bay’ (but now has only an electric motor). This freed up more space in the cockpit which, in turn, allowed the centre console to have a large and flush screen. The shifter and MULTI-SENSE interface are also transferred to the steering wheel, improving ergonomics and opening up more space in the middle of the passenger compartment and on the centre console.
While touchscreens and digital displays have allowed many functions to be placed on the screens, Renault’s designers have not been ‘excessive’ in this trend. They maintain some physical buttons – for example, to adjust the air-conditioning – in a subtle way beneath the central screen. This line of chrome-plated buttons looks natural in the cockpit and avoids the ‘fake’, unused buttons beneath the console that previous vehicle generations often had.
Like the latest smartphones, the OpenR screen (made by Continental) uses aluminosilicate-based Gorilla-type glass. It is tempered, ultra-resistant to shocks, scratch-proof and estimated to last 15 years. It comes with anti-reflective and anti-smudge coating. The ultra-fine contouring protects the screen’s edges. The HD quality of the TFT panel and finish combine to yield crystal-clear images.
The dashboard screen also has anti-reflective coating, and uses advanced micro-blinds technology (the technology that privacy screens for computers use). This means the ‘visor’ that usually shields the meters from sunlight is no longer needed – so the interior design is even sleeker. As for brightness, the panels adapt to outdoor light levels, so they are easier to read and don’t tire the eyes of the driver.
With OpenR, the user experience is said to be a lot like having a smartphone built into the car. This is a good approach since most people would be very familiar with their smartphone. That way, they don’t have to learn to use a whole new system.
Linked to Google ecosystem
Android Auto and Apple CarPlay are available but the interface is designed to avoid having to use a phone altogether. All the features are at users’ fingertips, and the OpenR Link system runs on the Android OS, so all the familiar apps are there. Being associated with the Google ecosystem means that drivers can have all the classic and favourite apps brought into the car, and they also enjoy customisation like on their smartphone. And being plugged into Google’s ecosystem also means that the car can be part of their ‘digital life’.
These include the popular Google Maps which, on a screen that is 6 times bigger than an average smartphone screen, will give a much better user experience. Google Maps has also been optimised for electric cars and includes a route planner specifically for such zero emission vehicles. The planner can factor in real-time vehicle data, weather information and other variables to suggest a stop at a charging station, tell the driver what the battery charge level will be on arrival at that charging station, and tell them how long it will take to charge the battery. It can also estimate the battery charge level when the car reaches its destination.
As many drivers have found, using Google Maps means that they can get updated maps as millions of users help contribute and improve Google’s database. So unlike earlier on-board navigation systems where owners had to periodically obtain new digital maps (for a fee), Google Maps is constantly updated – and it’s free.
On the hardware side, Renault chose American specialist Qualcomm which has supplied its third-generation Snapdragon Automotive Cockpit platform. This is built around an ultra efficient processor that has plenty of extra capacity to handle future applications. As a result, the motion on the screen is 7 times smoother than with the previous generation. Qualcomm will also offer its expertise in connectivity, digital cockpits and visualisation, its service platform, as well as driver assistance – including autonomous driving.
However, the screens, computing power and system also require some form of ‘intelligence’ behind the human-machine interface (HMI). For that, Renault approached South Korea’s LG Electronics, which developed the software platform to pair the two screens so the driver can display the navigation maps on the display behind the steering wheel.
Ever since the radio could be installed in a car, entertainment while motoring has been constantly evolving in tandem with the technologies of different decades. What used to be audio systems before are now called infotainment systems – providing a combination of information and entertainment of different kinds.
In time, we’ll be travelling in cars that can operate on their own, driving safely to wherever we want to go. Without the need to control the car or even pay attention to the road ahead, the driver will have more time to do other things – read a book, watch a movie, listen to music or even play videogames. Such a scenario means that infotainment systems in cars will have to change and provide even more features and capabilities.
Volvo is already starting on this evolution and is developing next-generation infotainment systems that can be offered in the near future. For example, using Qualcomm Technologies’ Snapdragon Cockpit Platforms takes the carmaker’s Google Android Automotive-based infotainment system to the next level. By leveraging Volvo Cars’ and technology firm Qualcomm’s in-house R&D competence, the companies will improve the overall capability of Volvos powered by Google Android to become faster and more responsive.
Qualcomm’s Snapdragon Cockpit Platforms is designed to be a central hub for high-performance computing. It is capable of fulfilling highly demanding graphics, audio and artificial intelligence requirements in the forthcoming Polestar 3 SUV and Volvo Cars’ upcoming fully electric SUV, all while having a very low power consumption. Using the latest Snapdragon Automotive Platforms, the next generation infotainment system will be more than twice as fast, while graphics generation will be up to 10 times faster.
The continued partnership between Volvo Cars and Google will also see Volvo being the first carmaker to directly integrate its cars with Google Assistant-enabled devices. This integration basically turns cars into smart devices.
This planned direct integration allows for a seamless connection between Google Assistant and cars to date, letting Volvo drivers control functions in their car by issuing voice commands to Google Assistant-enabled home and mobile devices. By pairing their car with their Google account, drivers can directly talk to Google in their car and remotely control a variety of functionalities, such as cooling it down on a hot day or just locking the doors in case they forgot to do so.
“Volvo Car Group was first to introduce Google technology and services in our cars and we are now looking to be the first to integrate fully with Google Assistant-enabled devices – it is a natural next step in our partnership with Google,” said Henrik Green, Chief Product Officer at Volvo Cars. “This integration allows us to improve the customer experience immensely, as it gives customers the possibility to easily and securely manage their car while at home or on the go, through any personal device that has Google Assistant.”
Finally, YouTube video playback will also come to all Volvo cars with Google built-in. YouTube will be the first video platform to be featured and available for download in Volvo cars on Google Play. This is the beginning of enabling video streaming in cars. Volvo is providing YouTube video as an enjoyable way to pass the time during stop with an EV to recharge. However, mindful of safety, videos will be allowed to be played only when the car is fully stationary.
“Allowing our customers to watch videos while charging or when waiting to pick up their children from school is part of our promise to make their lives better and more enjoyable,” said Green. “With YouTube and other major streaming services coming soon, our customers can enjoy their charging break instead of seeing it as just a hassle – making electric car ownership that bit easier.”
“The car is a great venue for enjoying video and audio, so I would not be surprised if this means that people spend more time in their Volvos, even when they are not going anywhere!” added Green.
Unlike its predecessor which was developed long before the electronic age, the new Land Rover Defender is filled with advanced technologies, particularly in the area of connectivity. At CES 2020 in Las Vegas, the world’s largest consumer electronics show which is on this week, Land Rover is displaying the 4×4 model as the first vehicle with two embedded LTE modems for enhanced connectivity, while the vehicle’s new Pivi Pro infotainment system shares electronic hardware with the latest smartphones.
SOTA technology
The fast and intuitive Pivi Pro system allows customers to make full use of the Software-Over-The-Air (SOTA) technology in the New Defender without compromising the system’s ability to stream music and connect to apps. With its own designated LTE modem and eSIM, the SOTA technology can operate in the background without affecting the day-to-day connectivity provided by the separate modem and eSIM in the infotainment module.
The always-on, connected Pivi Pro setup sits at the heart of the cabin. A 10-inch high-resolution touchscreen allows customers to control numerous aspects of the vehicle using the same processing hardware as the latest smartphones. In addition, customers can connect two mobile devices at once using Bluetooth.
“With one LTE modem and eSIM dedicated to the Software-Over-The-Air (SOTA) technology and the same set-up looking after music streaming and apps, New Defender has the digital capacity to keep customers connected, updated and entertained at all times anywhere in the world,” said Peter Virk, Director of Connected Car and Future Technology at Jaguar Land Rover. “You could liken the design to a brain, with each half enjoying its own connection for unrivalled and uninterrupted service. Like the brain, one side of the system looks after logical functions, like SOTA, while the other takes care of more creative tasks.”
The LTE connectivity behind the Jaguar Land Rover infotainment system also allows the New Defender to roam across multiple networks in different regions to help optimize connectivity. In addition, the cloud-based architecture provided by CloudCar is designed to make it easy to access and use content and services.
Expanded SOTA capability
Land Rover has also confirmed the first New Defender SUVs will feature more SOTA capability than originally projected. At its Frankfurt Motor Show launch in September 2019, it was announced that 14 individual electronic control modules would be able to receive remote updates. However, the first production vehicles will feature 16 control units capable of receiving SOTA updates.
Land Rover engineers estimate that in-dealer software updates will be a thing of the past for Defender customers before the end of 2021 as additional SOTA modules come online, rising from the current 16 to more than 45.
Qualcomm Technologies
Powering the Defender’s Pivi Pro infotainment and Vehicle Domain Controller are two high-performance Qualcomm Snapdragon 820Am Automotive Platforms, each with an integrated Snapdragon X12 LTE modem. The Snapdragon 820Am Automotive Platform delivers unprecedented performance and technology integration designed to support highly advanced telematics, infotainment and digital clusters.
With its power-efficient CPU cores and state-of-the-art GPU performance, integrated machine learning and powerful video processing capabilities, the Snapdragon 820Am Automotive Platform will enhance connected in-car experiences, including responsive interfaces, immersive 4K graphics, high-definition media streaming, and immersive audio.
Two X12 LTE modems provide parallel high-bandwidth downlink and uplink connectivity across multiple networks, ultra-fast connectivity and lower latency for secure, reliable communications. Additionally, the X12 LTE modem features an integrated global navigation satellite system (GNSS) and automotive dead reckoning, increasing the vehicle’s capability to accurately keep track of its location and position.
BlackBerry QNX
The New Defender is the first Land Rover vehicle to include a domain controller that consolidates a number of Advanced Driver Assistance Systems (ADAS) and driver convenience functions built on top of the QNX Hypervisor. Consolidating more systems onto fewer ECUs is integral to the future of automotive electrical design and will be the model for the Land Rover brand’s next-generation vehicle architecture.
Within the New Defender, the Blackberry QNX operating system helps deliver a smartphone-like experience for Pivi Pro infotainment users. The technology also powers the operating system for the latest generation TFT Interactive Driver Display, which can be configured to show vehicle instrumentation, navigation instructions and mapping information or a combination of the two.
BlackBerry QNX technology is embedded in more than 150 million vehicles on the road today and used by top automakers for their ADAS, digital instrument clusters, connectivity modules, hands-free, and infotainment systems.
CloudCar
Jaguar Land Rover is the first global car maker to use CloudCar’s latest cloud-based services platform. Working with the world-leading developer of connected driver experiences brings new levels of customer convenience to the Pivi Pro infotainment fitted to the New Defender. The CloudCar system supports a variety of service and content functionalities and recognizes dial-in numbers and codes, as well as locations, stored within calendar meeting invites. Customers can then navigate to or dial-in to meetings and conference calls with a single touch of the central touchscreen.
Bosch ADAS
Land Rover is on the road to a connected and autonomous future and the New Defender features a variety of technologies developed with Bosch to enhance the driving experience. Alongside the latest Advanced Driver Assistance Systems (ADAS), which include Adaptive Cruise Control and Blind Spot Assist, Bosch has supported the development of the Land Rover brand’s innovative 3D Surround Camera System, which gives drivers a unique view of the vehicle’s immediate perimeter using four wide-angle HD cameras, each providing a 190-degree field-of-view.
Connected using a 3Gbit/s video backbone and fused with 14 ultrasonic sensors, the clever technology gives drivers a choice of vantage points including a top-down plan view and seamless perspective view. It even performs as a virtual scout, allowing customers to pan around the vehicle on screen for the ultimate Command Driving Position on and off-road.