Zenseact Open Dataset: A large-scale and diverse multimodal dataset for autonomous driving

被引:0
|
作者
Alibeigi, Mina [1 ]
Ljungbergh, William [1 ]
Tonderski, Adam [1 ]
Hess, Georg [1 ]
Lilja, Adam [1 ]
Lindstrom, Carl [1 ]
Motorniuk, Daria [1 ]
Fu, Junsheng [1 ]
Widahl, Jenny [1 ]
Petersson, Christoffer [1 ]
机构
[1] Zenseact, Gothenburg, Sweden
关键词
D O I
10.1109/ICCV51070.2023.01846
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing datasets for autonomous driving (AD) often lack diversity and long-range capabilities, focusing instead on 360 degrees perception and temporal reasoning. To address this gap, we introduce Zenseact Open Dataset (ZOD), a large-scale and diverse multimodal dataset collected over two years in various European countries, covering an area 9x that of existing datasets. ZOD boasts the highest range and resolution sensors among comparable datasets, coupled with detailed keyframe annotations for 2D and 3D objects (up to 245m), road instance/semantic segmentation, traffic sign recognition, and road classification. We believe that this unique combination will facilitate breakthroughs in long-range perception and multi-task learning. The dataset is composed of Frames, Sequences, and Drives, designed to encompass both data diversity and support for spatio-temporal learning, sensor fusion, localization, and mapping. Frames consist of 100k curated camera images with two seconds of other supporting sensor data, while the 1473 Sequences and 29 Drives include the entire sensor suite for 20 seconds and a few minutes, respectively. ZOD is the only large-scale AD dataset released under a permissive license, allowing for both research and commercial use. More information, and an extensive devkit, can be found at zod.zenseact.com.
引用
收藏
页码:20121 / 20131
页数:11
相关论文
共 50 条
  • [1] OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving
    Zhang, Xinyu
    Li, Zhiwei
    Gong, Yan
    Jin, Dafeng
    Li, Jun
    Wang, Li
    Zhu, Yanzhang
    Liu, Huaping
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 2437 - 2447
  • [2] IDDA: A Large-Scale Multi-Domain Dataset for Autonomous Driving
    Alberti, Emanuele
    Tavera, Antonio
    Masone, Carlo
    Caputo, Barbara
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) : 5526 - 5533
  • [3] DrivingStereo: A Large-Scale Dataset for Stereo Matching in Autonomous Driving Scenarios
    Yang, Guorun
    Song, Xiao
    Huang, Chaoqin
    Deng, Zhidong
    Shi, Jianping
    Zhou, Bolei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 899 - 908
  • [4] MultiSubs: A Large-scale Multimodal and Multilingual Dataset
    Wang, Josiah
    Figueiredo, Josiel
    Specia, Lucia
    [J]. LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 6776 - 6785
  • [5] Large Scale Interactive Motion Forecasting for Autonomous Driving : The WAYMO OPEN MOTION DATASET
    Ettinger, Scott
    Cheng, Shuyang
    Caine, Benjamin
    Liu, Chenxi
    Zhao, Hang
    Pradhan, Sabeek
    Chai, Yuning
    Sapp, Ben
    Qi, Charles
    Zhou, Yin
    Yang, Zoey
    Chouard, Aurelien
    Sun, Pei
    Ngiam, Jiquan
    Vasudevan, Vijay
    McCauley, Alexander
    Shlens, Jonathon
    Anguelov, Dragomir
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9690 - 9699
  • [6] BjTT: A Large-Scale Multimodal Dataset for Traffic Prediction
    Zhang, Chengyang
    Zhang, Yong
    Shao, Qitan
    Feng, Jiangtao
    Li, Bo
    Lv, Yisheng
    Piao, Xinglin
    Yin, Baocai
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 18992 - 19003
  • [7] A DIVERSE LARGE-SCALE DATASET FOR EVALUATING REBROADCAST ATTACKS
    Agarwal, Shruti
    Fan, Wei
    Farid, Hany
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1997 - 2001
  • [8] A Large-Scale Chinese Multimodal NER Dataset with Speech Clues
    Sui, Dianbo
    Tian, Zhengkun
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    [J]. 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 2807 - 2818
  • [9] MINION: a Large-Scale and Diverse Dataset for Multilingual Event Detection
    Ben Veyseh, Amir Pouran
    Minh Van Nguyen
    Dernoncourt, Franck
    Thien Huu Nguyen
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 2286 - 2299
  • [10] DMDD: A Large-Scale Dataset for Dataset Mentions Detection
    Pan, Huitong
    Zhang, Qi
    Dragut, Eduard
    Caragea, Cornelia
    Latecki, Longin Jan
    [J]. TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2023, 11 : 1132 - 1146