by Future Transport-News
20 Sep 2022
Challenges of Sensor Fusion and Perception for ADAS/AD and the Way Forward
Sensor fusion is the merging of data from at least two sensors. Perception refers to the processing and interpretation of sensor data to detect, identify and classify objects. Sensor fusion and perception enables an autonomous vehicle to develop a 3D model of the surrounding environment that feeds into the vehicle control unit. Today’s available perception solutions use architectures and sensor data fusion methods that limits their performance, scalability, flexibility, and reliability. Let’s look into these challenges into more details.
Current sensor fusion solutions perform object-level fusion wherein each sensor (e.g., radar, camera, LiDAR) with its inherent limitations identifies and classifies objects individually. This results in poor performance and is not optimal because no single sensor is capable by itself of detecting all objects under all conditions. Furthermore, when sensor data is not fused, the system may get contradicting inputs from sensors and is unable to determine with a degree of certainty on the next action.
Existing sensor fusion and perception solutions are camera-centric and possess limited ability to incorporate other sensor architectures within the same platform. This results in poor performance, lack of scalability and reliability and hardware dependency.
To accelerate ADAS and AD adoption, sensor fusion and perception solutions must provide the requisite performance, flexibility, scalability and reliability.
Performance: Higher autonomy levels demand higher levels of accuracy and precision in object detection, classification and tracking and environmental modeling. The preferred technique to achieve this is raw data sensor fusion, which combines raw data from all available sensors on the vehicle and provides rich data for a perception system to accurately detect and classify an object.
Flexibility: While traditional and existing perception solutions are camera-centric, future perception solutions need the capability to incorporate other sensor architectures on the same platform based on the level of autonomy desired. Solutions must be able to work with any sensor set without rewriting perception algorithms.
Scalability: Vehicles with varying autonomy levels will co-exist as ADAS and AD continue to evolve in the future. The ability to build sensor fusion and perception solutions for L2 to L5 on a common platform is critical to ensure consistency in technical specifications, product quality and driving experience. A scalable perception solution accelerates ADAS and AD adoption.
Reliability: Confidence in autonomous solutions is based on safety and performance. Sensor fusion and perception solutions must pass stringent quality and performance requirements.
LeddarVision™ is a raw data sensor fusion and perception platform that generates a comprehensive 3D environmental model with multi-sensor support for camera, radar, and LiDAR configurations for advanced driver assistance systems (ADAS) and autonomous vehicles.
Performance Advantage: LeddarVision’s raw data sensor fusion capabilities, sensor synchronization and upsampling underlie LeddarVision’s superior object detection performance, resulting in an accurate 3D RGBD environmental model. Of all the submissions made between 2019 and 2021 to nuScenes, LeddarVision’s RCF360v2 is the top-ranking radar/camera solution for 3D object detection. LeddarVision’s upsampling technique provides richer environmental data, which results in:
Flexibility Advantage: LeddarVision is a hardware agnostic sensor fusion and perception solution that decouples the software from hardware and provides opportunities for OEMs, Tier 1, and Tier 2 automotive suppliers to develop multiple sensor architectures on a common platform and reduce hardware costs by diversifying hardware sourcing.
Scalability Advantage: LeddarVision’s ability to integrate with multitudes of sensor architectures, raw data sensor fusion capabilities, upsampling techniques and deep learning algorithms enable LeddarVision to provide superior performance at L2 as well as higher autonomy levels.
Reliability Advantage: LeddarVision has built-in redundancy and a safety health module within its software stack. LeddarTech’s robust quality management system follows guidelines towards achieving functional safety (FuSA), safety of intended functionality (SOTIF) and cybersecurity. LeddarTech’s domain expertise, strong work processes and robust quality management systems are geared towards ushering in an era of reliable and safe ADAS and AD.
This article was originally published by LeddarTech Inc..
Schunk offers 4 technical solutions to make E-mobility more attractive: Increased efficiency, reliability, user-friendliness & safety.
Siemens and Skyway have announced a collaboration to develop electrical and digital infrastructure for vertiport operations.
The UK government is providing 30 million GBP in funding for seven projects that will help decarbonise the nation's highways.
Padam Mobility discusses the challenges of agile project management in the world of public transportation.
WMoD is merging with the Coventry Ring-and-Ride service and consolidating both services under one DRT umbrella - managed by weDRT.
Hitachi Rail has published a new report exploring attitudes to public transport and smart mobility in eight cities around the world.
Pod Point introduces the OZEV Grant, a scheme to make EV charging more accessible for renters and people who own a flat.
SkedGo explores five of the most prominent trends driving the constantly evolving future of transport in the years to come.
InstaVolt is expanding its ultra-rapid EV charging hub in Banbury, Oxfordshire – doubling the number of chargers that currently exist onsite.
OVO Energy and Kaluza are partnering with Volkswagen UK and smart charging company, Indra to launch a Vehicle-to-Everything (V2X) trial.
bp pulse has launched Europe's first charging corridor for electric trucks along on the Rhine-Alpine corridor in Germany.
LeddarTech look to understand the testing requirements for new vehicles regarding ADAS under new car assessment programs (NCAP).
Liverpool City Council has selected Shell's subsidiary, ubitricity to install a network of 300 EV charging points into existing lampposts.
ZeroAvia has successfully tested its 19-seat Dornier 228 aircraft, powered partly with a full-size hydrogen-electric engine.
Kapsch TrafficCom will install a new tolling system on the highway between the Brazilian megacity Rio de Janeiro and Santos.
On 19 January 2023, Micromobility Industries hosted Micromobility World to explore how small vehicles will reshape our cities.
WiTricity and VTT will collaborate to install WiTricity’s wireless charging technology, supporting the EU-funded REFLECTIVE project.
WeDRT look at lessons to be learnt from transit approaches utilised in the fictional African nation of Wakanda.
The City of London has announced that restrictions on Britain’s first 24/7 ‘zero-emission street' could be introduced permanently.
The Indian State of Maharashtra has partnered with Gogoro and Belrise Industries to establish a network of battery-swapping infrastructure.
The UK government and Ofgem have released a plan that would benefit drivers by making it cheaper for them to run their electric vehicles.
NewMo, the Via-powered Boston area on-demand public transit service, recently celebrated its 100,000th ride.
SINTRONES’ ultra-mini fanless computer, the VBOX-3131, is equipped with an Intel® Celeron processor, which provides robust connectivity.
Lambeth Council plans to transform kerbside parking in the London borough into areas such as bus lanes and EV charging points.
The City of Paris and RiverCat France have announced that a river transport line using electric shuttles will open on the Seine in 2024.
Brightline and Uber have announced a new partnership to improve connections to rail transport in South Florida.
EVBox has fulfilled the security requirements of German calibration law for its public fast charging station, EVBox Troniq Modular.
AT CES Las Vegas 2023, ASKA debuted a full-scale, functional prototype of its ASKA A5 drive & fly eVTOL aircraft.
Leclanché SA has been selected to provide the battery technology for two hybrid vessels that will be operated by Brittany Ferries.
Yulu is a vertically-integrated solution with the potential to change the face of shared, enterprise and personal mobility in many countries.
TransLink customers can now pay for transit using Interac® Debit on every bus and at every fare gate throughout Metro Vancouver.
Micro-Mobility for Europe (MMfE), has published a first-of-its-kind factsheet on incident data involving shared e-scooters in Europe.
Oxbotica has raised US$140 million in Series C investment to deploy its operating system for Universal Autonomy™ around the world.
Ky Sealy, Engineering Fellow at WiTricity, discusses why standards in the automotive industry are important.
The Biden-Harris Administration has released the first US National Blueprint for Transportation Decarbonization.
From 5-8 January, CES 2023 took place in Las Vegas, debuting the latest micromobility vehicles from brands such as OKAI and Brightway.
HyNet partners, Progressive Energy Ltd, Cadent Gas Ltd and Vertex Hydrogen have become event partners with Foresight Hydrogen Live 2023.
Stellantis and Archer Aviation have announced a partnership to manufacture Archer’s eVTOL aircraft, Midnight.
The UK government has announced 7 million GBP in funding to decarbonise and improve freight transportation through emerging technologies.
Advisors from Biobío, Chile paid a visit to Optibus’ headquarters to discuss transportation technology and how it supports their future plans.
Yulu reflects on 2022, a year that saw the company's 5th anniversary, its 2nd Generation of purpose-built EVs and more.
NEXCOM’s in-vehicle AI-aided telematics computer, VTC 7260-xC4, is used as the core of vehicles to help deploy a wide range of applications.
At CES 2023, ZF unveiled its latest autonomous shuttle and announced a new partnership with Beep to deliver thousand of units to the US.
Sidra Collins chats with Boris Surets, CISO at Optibus to understand the benefits of using cloud-based servers, as opposed to local servers.
Enterprise has signed an agreement to become an authorised Geotab Reseller in the UK, France, Germany, Spain and the Republic of Ireland.
Siemens Mobility, the University of York and British Solar Renewables have won funding to develop new ways of powering UK railways.
The German Federal Ministry of Economics and Climate Protection has given €9.1 million for the SAFESTREAM autonomous driving project.
2022 saw WeDRT achieving a lot of big wins in future transport, seeing further gains in the push towards modal shift.
Hyundai Motor Group's subsidiary, Supernal has announced a collaboration with Microsoft to run advanced air mobility on Microsoft cloud.
Yulu Bikes Safe Rider Program is India’s first Traffic Safety Awareness certification programme for delivery executives.
OLEDWorks will be exhibiting automotive lighting and flexible panel capabilities of OLED technology at CES 2023.
London: A new regulation has come into force meaning private-hire vehicles licensed for the first time must now be 'zero emission capable'.
Active Travel England is investing 32.9m GBP in establishing a network of experts to improve high streets for pedestrians and cyclists.
The Stertil Group has taken over the business activities of Beissbarth Automotive Testing Solutions GmbH.
The United States Postal Service (USPS) intends to purchase at least 66,000 battery-electric delivery vehicles between now and 2028.
Voi is partnering with Battery-as-a-Service (BaaS) provider, Swobbee to install battery swapping stations for e-scooter fleets in Europe.
A delegation from Victoria, Australia visited Optibus’ headquarters to discuss technological solutions for improving public transportation.
While EVs come in different shapes and sizes, Yulu is moving to a new age of e-mobility revolution dominated by purpose-built vehicles.
Fastned and EVBox will install one of the first 400 kW EV Fast Chargers in Europe, enabling charges up to 100 km of range in just 3 minutes.
New York recently sped up its traffic with the award-winning cashless tolling system by Kapsch TrafficCom.
A recent survey has revealed that the most commonly reported barriers to cycling in Melbourne relate to riding alongside motor vehicles.
Germany's BMDV aims to establish Hamburg as a 'Metropolitan Mobility Model Region,' with up to 10,000 autonomous vehicles by 2030.
Aurora closes out 2022 with the fifth quarterly beta release of its Aurora Driver on the journey to being feature complete.
Grupo GA Brasil has partnered with Optibus to digitally transform its operation serving the states of Minas Gerais and Paraná.
Aqua superPower, Indra, Cenex and the University of Plymouth are developing a UK demonstrator of bi-directional boat charging.
Ficosa and LeddarTech have signed a development and commercialisation agreement for the development of a smart automatic parking assistant.
Glendale, Arizona has launched the brand-new on-demand transit app, Glendale OnBoard, made possible by Via.
With constantly changing travel patterns, Beate Kubitz poses the question: Is it time to flex the business model?
The British Transport Police (BTP) is now operating its first electric response vehicle ahead of deploying an all-electric fleet by 2025.
Redwood has announced that it will construct a Battery Materials Campus in the US 'Battery Belt' near Charleston, South Carolina.
In a European first, the autonomous shuttles deployed as part of the Navetty project are operating in Yvelines without an operator onboard
The US Department of Transportation has made 1.5 billion USD available in grant funding through the RAISE grant programme for 2023.
The UK government has provided funding to Virgin Atlantic to operate the world's first net zero transatlantic flight in 2023 using 100% SAF.
Optibus present 5 key takeaways from the discussions of its first ever Optibus Hub EMEA User Conference at Paddington Station, London.
SkedGo argues the case for the power of localising MaaS solutions, tailoring them to reflect specific geographic markets.
WeDRT analyse a case study for the implementation of DRT in Market Lavington in the first of its Scenario Series.
The ORR has published its first report on safety on the strategic road network and says National Highways must deliver better performance.
Engineering Fellow at WiTricity, Ky Sealy, argues the importance of standards for the wireless charging of electric vehicles.
The Highlands and Islands Transport Partnership (HITRANS) has added NorthLink Ferries to its mobility-as-a-service (MaaS) app, Go-Hi.
A Traffic Management System implemented by the Austrian company Kapsch TrafficCom has begun operating on the Monterrey – Saltillo highway.
EasyMile and Keolis are remotely supervising two fully driverless shuttles, without any human supervisor on board, at France’s CNTS.
LeddarTech has announced its participation at CES 2023, where it will showcase its automotive-grade software enabling ADAS and AD.
The MobiBrasil Group is rolling out Optibus’ Planning and Scheduling software across its Recife and São Paulo operations.
New research from the University of Minnesota outlines how planning for autonomous vehicles (AV) could help make US cities more liveable and equitable.
Micromobility provider, Voi has announced that its cooperation with Swiss rail company, BLS AG has revealed positive results.
UK Transport Minister, Jesse Norman, has responded to a question in UK Parliament on whether the DfT will legalise the use of helmets.
The BJCTA is joining the City of Birmingham to expand the hours of Birmingham’s microtransit service using software from Via.
The UK government has launched a new round of funding to help develop technologies for an improved future transport network.
Pod Point has announced a new three-year partnership with McCarthy Stone, the UK’s leading developer and manager of retirement communities.
Yulu recently held the first edition of Yulu Crunch, a 42-hour internal hackathon held in its office premises from December 1-3, 2022.
Pacific Gas and Electric Company (PG&E) is seeking customers interested in joining its upcoming Vehicle-to-Everything (V2X) pilot programmes.
EVBox will introduce its DC fast charging solution, EVBox Troniq Modular, to the North American market at CES.
The BRT system for the city of Sorocaba is the latest network to implement Optibus’ software platform for planning and scheduling.
SFMTA has approved the continuation of the Slow Streets programme to encourage people in San Francisco to use active transportation.
Carrefour and Goggo Network are trialling the use of autonomous delivery vehicles in the Plateau de Saclay, France.
Aurora shares a closer look at the work that underpins its development of safe self-driving technology and autonomous vehicles.
Via launches Remix Scheduling, an intuitive transportation planning platform that makes scheduling smarter and easier for transit agencies.
Gogoro continues expanding in Asia by partnering with Globe’s 917Ventures and Ayala Corporation to offer battery swapping in the Philippines.
Eve Air Mobility has signed a LOI with Volatus Infrastructure to supply a vertiport automation software to manage eVTOL vehicles.
Use the form opposite to get in touch with LeddarTech directly to discuss any requirements you might have.