AI基盤モデルと自動運転向けインテリジェントコンピューティングセンター（2023年）

当レポートでは、AI基盤モデルと自動運転向けインテリジェントコンピューティングセンターについて調査分析し、開発動向や企業の情報を提供しています。

目次

第1章 AIファンデーションモデルとインテリジェントコンピューティングセンターの概要

• AI基盤モデルの定義
  • AI基盤モデルの開発経緯
  • AIの開発における基盤モデルの役割
  • AI基盤モデルのビジネスモデル
  • AI基盤モデルの実装における課題と今後の開発動向
  • 自動運転に利用されるAI基盤モデルの利点
• インテリジェントコンピューティングセンターの定義
  • 中国のインテリジェントコンピューティングセンターの開発経緯
  • インテリジェントコンピューティングセンター2.0
  • インテリジェントコンピューティングセンターの建設
  • インテリジェントコンピューティングセンターの産業チェーン
  • 自動運転向けインテリジェントコンピューティングセンターを設立する理由
  • 自動運転向けインテリジェントコンピューティングセンターの建築コスト
  • 自動運転向けインテリジェントコンピューティングセンターの建築における問題
• 基盤モデルとインテリジェントコンピューティングセンターを持つ自動車関連企業の概要

第2章 自動運転企業

• 自動運転企業間の基盤モデルとインテリジェントコンピューティングセンターの比較
• Haomo.ai
• QCraft

第3章 プロバイダー

• プロバイダー間の基盤モデルとインテリジェントコンピューティングセンターの比較
• Baidu
• Inspur
• SenseTime

第4章 OEM

• OEM間の基盤モデルとインテリジェントコンピューティングセンターの比較
• Xpeng
  • プロファイル
  • Transformer基盤モデル
  • データ処理
  • Fuyao Intelligent Computing Center
• Geely
  • プロファイル
  • Geely Xingrui Computing Center
  • Geely Xingrui Computing Centerの先端技術
  • Geely Xingrui Computing Centerの能力
  • Geely-Baidu ERNIE Foundation Model
• Tesla
  • プロファイル
  • データ駆動型システム
  • Transformer基盤モデル
  • Tesla Dojo Supercomputing Center

New infrastructures for autonomous driving: AI foundation models and intelligent computing centers are emerging.

In recent years, the boom of artificial intelligence has actuated autonomous driving, and the troika of artificial intelligence is: data, algorithm, and computing power. This report highlights the research on new infrastructures for autonomous driving algorithms and computing power: AI foundation models and intelligent computing centers.

Large AI model, or foundation model, internationally known as pre-trained model, refers to a model trained on a vast quantity of unlabeled data at scale resulting in a model that can be adapted to a wide range of downstream tasks. The Transformer networks Google proposed in 2017 laid the foundation of mainstream algorithm architecture for current foundation models. The ViT (Vision Transformer), introduced by Google in 2020, first applied the Transformer architecture to the image classification task in the field of computer vision (CV). And then Tesla's introduction of Transformer foundation models into autopilot started the adoption of large AI models in autonomous driving.

Key features of AI foundation models:

1. Generalization capability is strong.

AI foundation models can capture knowledge from a mass of labeled and unlabeled data, and fine-tunes specific tasks by storing knowledge into enormous parameters.

For example, Baidu ERNIE Foundation Model learns from large knowledge graphs and massive unstructured data, and then works with companies to build industry foundation models. Up to now, ERNIE Model has released 11 industry models. Wherein, Geely-Baidu ERNIE, a large automotive industry model co-built by Baidu and Geely in November 2022, uses Baidu ERNIE Foundation Model 3.0 for fine-tuning and verification in three tasks: intelligent customer service knowledge base expansion, short answer generation for vehicle speech systems, and knowledge base construction in automotive field.

2. Have self-supervised learning capability, reducing training and development costs

The self-supervised learning method of AI foundation models can reduce data annotations, and partly solve the problems of high cost, long cycle and low accuracy of manual annotations. For example, the video self-supervised foundation model, unveiled by Haomo.ai in January 2023, first builds a large model based on data clips, and adjusts the model using a part of manually annotated clip data, in which only 10% of the key frames are manually annotated, and the other 90% are not; and then trains the entire model to guess the content of the next frame according to the current frame, and automatically annotates the remaining 90% frames, so as to achieve 100% automatic annotation and lower the cost of annotation.

3. AI foundation models can break the accuracy limitations of existing model structures.

The experimental researches in recent years show that larger models and data scale may break the existing accuracy limitations. For example, the INTERN Foundation Model 2.0 SenseTime released in September 2022 has been a leading performer in model support in more than 40 visual tasks in 12 categories, outperforming world-renowned institutions in related fields.

The use of AI foundation models can not only greatly expedite algorithm iteration, but also directly shorten the iteration cycle of autonomous driving systems. To match large-scale parameters and mass data calculations in models, some OEMs and autonomous driving technology developers have begun to build data computing centers that can provide large computing power and train foundation models, namely, intelligent computing centers.

Intelligent computing center refers to the infrastructure for building intelligent computing server clusters based on chips (e.g., GPU and FPGA) to provide intelligent computing power. For intelligent computing centers need long construction period and huge initial investment, only some powerful OEMs and companies make layout of construction at present. Examples include Geely which launched the Xingrui Intelligent Computing Center in January 2023, with total investment of RMB1 billion and 5,000 cabinets planned. The facility currently boasts total cloud computing power of 810 petaflops per second, which is expected to expand to 1,200 petaflops per second in 2025. It covers such services as intelligent connectivity, intelligent driving, new energy safety, and trial production experiments, improving Geely's overall R&D efficiency by 20%.

Furthermore, China is also encouraging rapid development of intelligent computing centers. In 2022, the State Council issued the 14th Five-Year Plan for the Development of the Digital Economy, suggesting promoting the orderly development of intelligent computing centers and building new intelligent infrastructures that integrate intelligent computing power, general algorithms, and development platforms. In February 2022, the East-Data-West-Computing Project was fully launched. National computing power hub nodes started construction in 8 regions, i.e., Beijing-Tianjin-Hebei, Yangtze River Delta, Guangdong-Hong Kong-Macao Greater Bay Area, Chengdu-Chongqing, Inner Mongolia, Guizhou, Gansu, and Ningxia, and 10 national data center clusters were planned. So far, there have been more than 30 cities in China building or proposing to build intelligent computing centers, some of which have become operational.

Table of Contents

1 Overview of AI Foundation Model and Intelligent Computing Center

• 1.1 Definition of AI Foundation Model
  • 1.1.1 Development History of AI Foundation Model
  • 1.1.2 Role of Foundation Model in Development of Artificial Intelligence (AI)
  • 1.1.3 Business Models of AI Foundation Model
  • 1.1.4 Challenges in Implementation of AI Foundation Model and Future Development Trends
  • 1.1.5 Advantages of AI Foundation Model Applied to Autonomous Driving
• 1.2 Definition of Intelligent Computing Center
  • 1.2.1 Development History of Intelligent Computing Center in China
  • 1.2.2 Intelligent Computing Center 2.0
  • 1.2.3 Construction of Intelligent Computing Centers
  • 1.2.4 Intelligent Computing Center Industry Chain
  • 1.2.5 Reasons for Establishing Intelligent Computing Centers for Autonomous Driving
  • 1.2.6 Cost of Building An Intelligent Computing Center for Autonomous Driving
  • 1.2.7 Problems in Building An Intelligent Computing Center for Autonomous Driving
• 1.3 Summary of Automotive Companies with Foundation Models and Intelligent Computing Centers

2 Autonomous Driving Companies

• Comparison of Foundation Models and Intelligent Computing Centers between Autonomous Driving Companies
• 2.1 Haomo.ai
  • 2.1.1 Profile
  • 2.1.2 Data Intelligence System - MANA System
  • 2.1.3 Intelligent Computing Center - MANA OASIS
  • 2.1.4 Research and Application of Foundation Models
  • 2.1.5 Five Models of MANA
  • 2.1.6 Separate Introduction of Five Models
  • 2.1.7 Real Scene Simulation System
  • 2.1.8 Data Sources
  • 2.1.9 Assistance of the Five Foundation Models and the Intelligent Computing Center to Haomo.ai
• 2.2 QCraft
  • 2.2.1 Profile
  • 2.2.2 Feature and Timing Fusion Foundation Model - OmniNet
  • 2.2.3 OmniNet Foundation Model Promotes the Implementation of Production Solutions
  • 2.2.4 Autonomous Driving R&D Toolchain - QCraft Matrix

3 Providers

• Comparison of Foundation Models and Intelligent Computing Centers between Providers
• 3.1 Baidu
  • 3.1.1 Introduction to Baidu AI Cloud
  • 3.1.2 Introduction to Baidu Apollo
  • 3.1.3 ERNIE Foundation Model
  • 3.1.4 Application of ERNIE Foundation Model in Automotive Industry
  • 3.1.5 ERNIE Foundation Model Improves Baidu's Perception Algorithm Capabilities
  • 3.1.6 Baidu Intelligent Computing Center
• 3.2 Inspur
  • 3.2.1 Profile
  • 3.2.2 Three Highlights of Huaihai Intelligent Computing Center
• 3.3 SenseTime
  • 3.3.1 Profile
  • 3.3.2 Cornerstone of SenseAuto
  • 3.3.3 SenseTime Intelligent Computing Center AIDC
  • 3.3.4 Application of SenseTime Artificial Intelligence Data Center (AIDC) in Intelligent Vehicles
  • 3.3.5 INTERN Foundation Model
  • 3.3.6 INTERN Foundation Model 2.0
  • 3.3.7 SenseTime Data Closed-loop Product Solution - SenseAuto Empower

4 OEMs

• Comparison of Foundation Models and Intelligent Computing Centers between OEMs
• 4.1 Xpeng
  • 4.1.1 Profile
  • 4.1.2 Transformer Foundation Model
  • 4.1.3 Data Processing
  • 4.1.4 Fuyao Intelligent Computing Center
• 4.2 Geely
  • 4.2.1 Profile
  • 4.2.2 Geely Xingrui Computing Center
  • 4.2.3 Leading Technologies of Geely Xingrui Computing Center
  • 4.2.4 Capabilities of Geely Xingrui Computing Center
  • 4.2.5 Geely-Baidu ERNIE Foundation Model
• 4.3 Tesla
  • 4.3.1 Profile
  • 4.3.2 Data Driven System
  • 4.3.3 Transformer Foundation Model
  • 4.3.4 Tesla Dojo Supercomputing Center