Orion is an open source end-to-end (E2E) autonomous driving framework developed by Xiaomi Labs, focusing on enhancing the decision-making and planning capabilities of autonomous driving systems through advanced AI technologies. Its core technical features include:
- Visual Language Modeling (VLM) Integration: Combining large-scale language modeling (LLM) for scenario reasoning to solve the problem of insufficient causal reasoning in complex environments by traditional methods
- generative planner: Support multimodal trajectory prediction (e.g., acceleration, steering) to improve path planning accuracy
- QT-Former Module: Processing long-term historical contextual information for more comprehensive scene awareness
These technologies enabled Orion to achieve a Driving Score (DS) of 77.74 and a Success Rate (SR) of 54.621 TP3T in closed-loop testing, significantly outperforming comparable programs.
This answer comes from the articleOrion: Xiaomi's Open Source End-to-End Autonomous Driving Reasoning and Planning FrameworkThe
May not be reproduced without permission:AI productivity tools " What is Orion and what are its core technical features?
English 
简体中文 
日本語 
Deutsch 
Português do Brasil