├── LICENSE.md └── README.md /LICENSE.md: -------------------------------------------------------------------------------- 1 | CC0 1.0 Universal 2 | 3 | Statement of Purpose 4 | 5 | The laws of most jurisdictions throughout the world automatically confer 6 | exclusive Copyright and Related Rights (defined below) upon the creator and 7 | subsequent owner(s) (each and all, an "owner") of an original work of 8 | authorship and/or a database (each, a "Work"). 9 | 10 | Certain owners wish to permanently relinquish those rights to a Work for the 11 | purpose of contributing to a commons of creative, cultural and scientific 12 | works ("Commons") that the public can reliably and without fear of later 13 | claims of infringement build upon, modify, incorporate in other works, reuse 14 | and redistribute as freely as possible in any form whatsoever and for any 15 | purposes, including without limitation commercial purposes. These owners may 16 | contribute to the Commons to promote the ideal of a free culture and the 17 | further production of creative, cultural and scientific works, or to gain 18 | reputation or greater distribution for their Work in part through the use and 19 | efforts of others. 20 | 21 | For these and/or other purposes and motivations, and without any expectation 22 | of additional consideration or compensation, the person associating CC0 with a 23 | Work (the "Affirmer"), to the extent that he or she is an owner of Copyright 24 | and Related Rights in the Work, voluntarily elects to apply CC0 to the Work 25 | and publicly distribute the Work under its terms, with knowledge of his or her 26 | Copyright and Related Rights in the Work and the meaning and intended legal 27 | effect of CC0 on those rights. 28 | 29 | 1. Copyright and Related Rights. A Work made available under CC0 may be 30 | protected by copyright and related or neighboring rights ("Copyright and 31 | Related Rights"). Copyright and Related Rights include, but are not limited 32 | to, the following: 33 | 34 | i. the right to reproduce, adapt, distribute, perform, display, communicate, 35 | and translate a Work; 36 | 37 | ii. moral rights retained by the original author(s) and/or performer(s); 38 | 39 | iii. publicity and privacy rights pertaining to a person's image or likeness 40 | depicted in a Work; 41 | 42 | iv. rights protecting against unfair competition in regards to a Work, 43 | subject to the limitations in paragraph 4(a), below; 44 | 45 | v. rights protecting the extraction, dissemination, use and reuse of data in 46 | a Work; 47 | 48 | vi. database rights (such as those arising under Directive 96/9/EC of the 49 | European Parliament and of the Council of 11 March 1996 on the legal 50 | protection of databases, and under any national implementation thereof, 51 | including any amended or successor version of such directive); and 52 | 53 | vii. other similar, equivalent or corresponding rights throughout the world 54 | based on applicable law or treaty, and any national implementations thereof. 55 | 56 | 2. Waiver. To the greatest extent permitted by, but not in contravention of, 57 | applicable law, Affirmer hereby overtly, fully, permanently, irrevocably and 58 | unconditionally waives, abandons, and surrenders all of Affirmer's Copyright 59 | and Related Rights and associated claims and causes of action, whether now 60 | known or unknown (including existing as well as future claims and causes of 61 | action), in the Work (i) in all territories worldwide, (ii) for the maximum 62 | duration provided by applicable law or treaty (including future time 63 | extensions), (iii) in any current or future medium and for any number of 64 | copies, and (iv) for any purpose whatsoever, including without limitation 65 | commercial, advertising or promotional purposes (the "Waiver"). Affirmer makes 66 | the Waiver for the benefit of each member of the public at large and to the 67 | detriment of Affirmer's heirs and successors, fully intending that such Waiver 68 | shall not be subject to revocation, rescission, cancellation, termination, or 69 | any other legal or equitable action to disrupt the quiet enjoyment of the Work 70 | by the public as contemplated by Affirmer's express Statement of Purpose. 71 | 72 | 3. Public License Fallback. Should any part of the Waiver for any reason be 73 | judged legally invalid or ineffective under applicable law, then the Waiver 74 | shall be preserved to the maximum extent permitted taking into account 75 | Affirmer's express Statement of Purpose. In addition, to the extent the Waiver 76 | is so judged Affirmer hereby grants to each affected person a royalty-free, 77 | non transferable, non sublicensable, non exclusive, irrevocable and 78 | unconditional license to exercise Affirmer's Copyright and Related Rights in 79 | the Work (i) in all territories worldwide, (ii) for the maximum duration 80 | provided by applicable law or treaty (including future time extensions), (iii) 81 | in any current or future medium and for any number of copies, and (iv) for any 82 | purpose whatsoever, including without limitation commercial, advertising or 83 | promotional purposes (the "License"). The License shall be deemed effective as 84 | of the date CC0 was applied by Affirmer to the Work. Should any part of the 85 | License for any reason be judged legally invalid or ineffective under 86 | applicable law, such partial invalidity or ineffectiveness shall not 87 | invalidate the remainder of the License, and in such case Affirmer hereby 88 | affirms that he or she will not (i) exercise any of his or her remaining 89 | Copyright and Related Rights in the Work or (ii) assert any associated claims 90 | and causes of action with respect to the Work, in either case contrary to 91 | Affirmer's express Statement of Purpose. 92 | 93 | 4. Limitations and Disclaimers. 94 | 95 | a. No trademark or patent rights held by Affirmer are waived, abandoned, 96 | surrendered, licensed or otherwise affected by this document. 97 | 98 | b. Affirmer offers the Work as-is and makes no representations or warranties 99 | of any kind concerning the Work, express, implied, statutory or otherwise, 100 | including without limitation warranties of title, merchantability, fitness 101 | for a particular purpose, non infringement, or the absence of latent or 102 | other defects, accuracy, or the present or absence of errors, whether or not 103 | discoverable, all to the greatest extent permissible under applicable law. 104 | 105 | c. Affirmer disclaims responsibility for clearing rights of other persons 106 | that may apply to the Work or any use thereof, including without limitation 107 | any person's Copyright and Related Rights in the Work. Further, Affirmer 108 | disclaims responsibility for obtaining any necessary consents, permissions 109 | or other rights required for any use of the Work. 110 | 111 | d. Affirmer understands and acknowledges that Creative Commons is not a 112 | party to this document and has no duty or obligation with respect to this 113 | CC0 or use of the Work. 114 | 115 | For more information, please see 116 | 117 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Awesome Self-Driving Cars [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome) 2 | > We wanted flying cars, instead we got 140 characters. - *Peter Thiel* 3 | 4 | > We want self-driving cars, and we want them with an awesome list. - Not *Peter Thiel* 5 | 6 | ## Introduction 7 | A curated list of all awesome things related to self-driving car. 8 | 9 | ## Contributing 10 | Contributions are highly appreciated. Please send me pull request. Make sure the stuff you add is actually awesome. We are **not** trying to include everything here, only awesome stuff. 11 | 12 | ## Table of Contents 13 | - [Datasets](#datasets) 14 | - [Simulators](#simulators) 15 | - [Courses](#courses) 16 | - [Papers & Blogs](#papers-blogs) 17 | - [Big Players](#big-players) 18 | - [Legislation](#legislation) 19 | 20 | 21 | 22 | ## Datasets 23 | * [KITTI Vision Benchmark Suite [Images]](http://www.cvlibs.net/datasets/kitti/) - Large vision benchmark dataset with [objection detection](http://www.cvlibs.net/datasets/kitti/eval_object.php) evaluation training/testing images and leaderboard on cars and pedestrians. 24 | * [Cityscapes](https://www.cityscapes-dataset.com/) - Semantic, instance-wise, dense pixel annotations of 30 classes. 25 | * [comma.ai's Driving Dataset [Videos]](https://github.com/commaai/research) - Seven and a quarter hours (~ 80 GB) of largely highway driving. With this dataset, comma.ai's founder [George Hotz](https://twitter.com/realgeorgehotz) trained a self-driving car [all by himself](https://www.bloomberg.com/features/2015-george-hotz-self-driving-car/). 26 | * [Udacity's Driving Dataset [Videos]](https://github.com/udacity/self-driving-car/tree/master/datasets) - Eight hours (over 280 GB) of driving data collected for their [open source self-driving car challenges](https://www.udacity.com/self-driving-car). Udacity also provides convenient [scripts](https://github.com/rwightman/udacity-driving-reader) to port the data. 27 | * [German Traffic Sign [Images]](http://benchmark.ini.rub.de/?section=gtsrb&subsection=dataset) - More than 50,000 images and 40 classes of traffic signs. Excellent resource to benchmark your traffic sign classifier. 28 | * [Washington DC's Lidar Data](https://aws.amazon.com/blogs/publicsector/lidar-data-for-washington-dc-is-available-as-an-aws-public-dataset/) - Lidar point cloud of the entire Washington DC area is made available by the District of Columbia’s Office of the Chief Technology Officer (OCTO). 29 | * [Apolloscape](http://apolloscape.auto/scene.html#) - Apolloscape provides images with 10x higher resolution and pixel-level annotation. And also Provides multiple levels of scene complexity. 30 | 31 | 32 | 33 | ## Simulators 34 | * [Udacity's Self-Driving Car Simulator](https://github.com/udacity/self-driving-car-sim) - This simulator is built for Udacity's Self-Driving Car Nanodegree to teach students how to train cars how to navigate road courses using deep learning. It is used for the project of [Behavioral Cloning](https://github.com/udacity/CarND-Behavioral-Cloning-P3). 35 | * [Microsoft's AirSim](https://github.com/Microsoft/AirSim) - An open-source and cross platform simulator built for drones and other vehicles. AirSim is designed as a platform for AI research to experiment with deep learning, computer vision and reinforcement learning algorithms for autonomous vehicles. 36 | * [MIT's Moral Machine](http://moralmachine.mit.edu/) - Moral machine provides a *"platform for 1) building a crowd-sourced picture of human opinion on how machines should make decisions when faced with moral dilemmas, and 2) crowd-sourcing assembly and discussion of potential scenarios of moral consequence"*. If you are a fan of the [trolley problem](https://en.wikipedia.org/wiki/Trolley_problem), you can't miss this. 37 | * [MIT's Google Self-Driving Car Simulator](https://scratch.mit.edu/projects/108721238/) - Self-driving car simulated completely by visual programming language [Scratch](https://en.wikipedia.org/wiki/Scratch_(programming_language)). 38 | * [BARK](https://github.com/bark-simulator/bark) - An open-source, semantic simulator built to develop and benchmark novel behavior planners. Runs on multiple platforms and can easily be installed via PyPi. 39 | 40 | 41 | 42 | 43 | ## Courses 44 | * [Udacity Self-Driving Car Nanodegree](https://www.udacity.com/course/self-driving-car-engineer-nanodegree--nd013) - Udacity's flagship program is sponsored by many self-driving car hiring partners. The nanodegree program includes 3 terms: 1) [Term 1: Computer Vision and Deep Learning](https://medium.com/self-driving-cars/term-1-in-depth-on-udacitys-self-driving-car-curriculum-ffcf46af0c08#.k5745vhdw), 2) [Term 2: Sensor Fusion, Localization, and Control](https://medium.com/udacity/term-2-in-depth-on-udacitys-self-driving-car-curriculum-775130aae502#.oh8xi152p), and 3) Term 3: Path Planning, Elective, and Systems. Each term costs $800. 45 | * [MIT 6.S094: Deep Learning for Self-Driving Cars](http://selfdrivingcars.mit.edu/) - This class is an introduction to the practice of deep learning through the applied theme of building a self-driving car. It is open to beginners and is designed for those who are new to machine learning, but it can also benefit advanced researchers in the field looking for a practical overview of deep learning methods and their application. By the way, it's *free*! 46 | * [BitTiger Build Your Own Autonomous Vehicle Mastery Program](https://www.bittiger.io/livecourses/2yG3CYMWRdAgDguzK) - Two weeks of live classes in Bay Area taught by engineers from [Vector.ai](http://vectorai.io/) on building a self-driving mini car from ground up. Topics include deep learning, ROS, sensors, computer vision, localization, mapping and control. The program costs $7,000. 47 | 48 | 49 | 50 | ## Papers & Blogs 51 | * [Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art](https://arxiv.org/pdf/1704.05519.pdf) - State-of-the-art survey on computer vision-related problems datasets and methods for self-driving cars. 52 | * [End to End Learning for Self-Driving Cars](https://arxiv.org/abs/1604.07316) - Nvidia's ground breaking paper on using end to end learning (i.e., raw camera images as the input and steering commands as the output) with a Convolutional Neural Network (CNN) for behavioral cloning. 53 | * [Learning a Driving Simulator](https://arxiv.org/abs/1608.01230) - [comma.ai](http://comma.ai/)'s approach for self-driving cars is based on an agent that learns to clone driver behaviors and plans maneuvers by simulating future events in the road. This paper investigates variational autoencoders with classical and learned cost functions using generative adversarial networks for embedding road frames. A transition model is learned in the embedded space using action conditioned Recurrent Neural Networks (RNNs). 54 | * [The Third Transportation Revolution](https://medium.com/@johnzimmer/the-third-transportation-revolution-27860f05fa91#.ga97y7w86) - Awesome blog post by [John Zimmer](https://twitter.com/johnzimmer) on [Lyft](https://www.lyft.com/)'s vision for self-driving cars. *Spoiler alert*, John predicts self-driving cars will account for the majority of Lyft rides within 5 years. And by 2025, private car ownership will all-but end in major U.S. cities. 55 | * [16 Questions About Self-Driving Cars](http://a16z.com/2017/01/06/selfdriving-cars-frank-chen/) - [a16z](http://a16z.com/)'s [Frank Chen](https://twitter.com/withfries2) goes over the 16 most commonly asked questions, *technical* and *non-technical*, about self-driving cars. 56 | * [Ways to think about cars](http://ben-evans.com/benedictevans/2015/7/27/ways-to-think-about-cars) - Awesome blog post by [a16z](http://a16z.com/)'s [Benedict Evans](https://twitter.com/BenedictEvans) on electric cars, on-demand car services, and self-driving cars. 57 | * [Cars and second order consequences](http://ben-evans.com/benedictevans/2017/3/20/cars-and-second-order-consequences) - [Benedict Evans](https://twitter.com/BenedictEvans) on the impact of electric and autonomy on cars and beyond. 58 | * [An Introduction to LIDAR](https://news.voyage.auto/an-introduction-to-lidar-the-key-self-driving-car-sensor-a7e405590cff) - Awesome introduction by [Voyage](http://voyage.auto/) about the key sensor of self-driving cars. 59 | 60 | 61 | 62 | ## Big Players 63 | * [comma.ai](comma.ai/) - *The Android of self-driving cars (with the iPhone being Tesla)* claimed by their founder George Hotz. They open sourced their [dataset and software](https://github.com/commaai/research), [driving agent](https://github.com/commaai/openpilot), and [research platform](https://github.com/commaai/neo) after some disagreement with the [NHTSA](https://techcrunch.com/2016/10/28/comma-ai-cancels-the-comma-one-following-nhtsa-letter/). 64 | * [Cruise Automation](https://www.getcruise.com/) - San Francisco-based startup was acquired by GM for $1B. They regularly post their self-driving videos on their [*YouTube*](https://www.youtube.com/channel/UCP1rvCYiruh4SDHyPqcxlJw) channel. 65 | * [drive.ai](drve.ai/) - Silicon Valley startup founded by former lab mates out of Stanford University’s Artificial Intelligence Lab. Working on creating AI software for autonomous vehicles with deep learning. See their impressive drive demo [here](https://www.youtube.com/watch?v=GMvgtPN2IBU). 66 | * [Ford](http://www.ford.com/) - Invested $1B in an artificial intelligence startup [Argo AI](https://www.argo.ai/), Ford plans to have [self-driving cars in commercial operation](https://shift.newco.co/fords-road-to-full-autonomy-36cb9cca330#.t03u8ir4c) for a ride-hailing service by 2021. 67 | * [GM](https://www.gm.com/) - [Invested $500M in Lyft](https://www.nytimes.com/2016/01/05/technology/gm-invests-in-lyft.html) and [bought Cruise Automation for $1B](https://www.nytimes.com/2016/03/12/business/general-motors-to-buy-cruise-automation-in-push-for-self-driving-cars.html), GM is [expanding its R&D to Silicon Valley](https://www.nytimes.com/2017/04/13/business/gm-expands-self-driving-car-operations-to-silicon-valley.html) and targeting to soon test self-driving taxis on public roads. 68 | * [nuTonomy](http://nutonomy.com/) - Startup spun out from MIT launched [world's first self-driving taxi service](https://techcrunch.com/2016/08/24/mit-spinout-nutonomy-just-beat-uber-to-launch-the-worlds-first-self-driving-taxi/) in Singapore. nuTonomy is currently expanding its self-driving car road test to Boston. 69 | * [NIO](http://www.nio.io/) - electric car startup formerly known as NextEV, demonstrated [world's fastest (top speed of 160 mph) autonomous lap](http://www.nio.io/news/nio-sets-new-record-fastest-autonomous-car-world) with their EP9. 70 | * [NVIDIA](http://www.nvidia.com/page/home.html) - NVIDIA is in a market dominant position for the use of their GPU for deep learning. Naturally self-driving car is a huge opportunity for them. NVIDIA already demonstrated their own self-driving car [BB8](https://blogs.nvidia.com/blog/2017/01/04/bb8-ces/). They also build their [open AI car computing platform](http://www.nvidia.com/object/drive-px.html) and [software development kit](https://developer.nvidia.com/driveworks). 71 | * [Otto](http://ot.to/) - Self-driving truck startup acquired by Uber for $680M. Made to the awesome list by delivering beer from Denver to Colorado Springs with [120 miles of highway self-driving](https://www.youtube.com/watch?v=Qb0Kzb3haK8). Since the acquisition, Uber has [reportedly](https://backchannel.com/has-uber-killed-off-its-self-driving-trucks-3ebd2eb0e51) terminated the testing on self-driving turck and directed the talent of Otto to the development of their self-driving ride-sharing service. 72 | * [Tesla](https://www.tesla.com/autopilot) - Currently the only automobile manufacturer sells hardware-ready vehicles. With thousands of self-driving capable vehicles already on the road and millions of miles driven, Tesla is using [fleet learning](https://electrek.co/2015/10/30/the-autopilot-is-learning-fast-model-s-owners-are-already-reporting-that-teslas-autopilot-is-self-improving/) to make their autopilot smarter and smarter. 73 | * [Uber](http://uber.com) - Since self-driving cars are [existential crisis](http://www.recode.net/2017/2/20/14665438/self-driving-cars-uber-alphabet-google-waymo-brad-stone-upstarts-recode-podcast) to Uber, they have been actively building and testing their self-driving cars in [Pittsburgh, PA](https://newsroom.uber.com/pittsburgh-self-driving-uber/) and [Tempe, Arizona](https://www.bloomberg.com/news/articles/2017-02-21/uber-launches-self-driving-cars-in-arizona-after-california-ban). They also bought [Otto](http://ot.to/) and teamed up with [Volvo](http://www.theverge.com/2016/10/25/13404306/uber-volvo-self-driving-car-pittsburgh-spotted) and [Daimler](http://www.theverge.com/2017/1/31/14453704/uber-daimler-partnership-self-driving-cars-mercedes-benz-volvo) on deployment of self-driving cars. 74 | * [Udacity](https://www.udacity.com/) - Founded by self-driving car pioneer [Sebastian Thrun](https://twitter.com/SebastianThrun), Udacity is democratizing education and providing the best self-driving car education program through their [nanodegree](https://www.udacity.com/course/self-driving-car-engineer-nanodegree--nd013). 75 | * [Waymo](https://waymo.com/) - Google's self-driving car company has driven way more miles than any other companies also with a much smaller [disengagement rate](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/disengagement_report_2016). 76 | 77 | 78 | 79 | ## Legislation 80 | * **Arizona** - [Executive order 2015-09](http://azgovernor.gov/file/2660/download?token=nLkPLRi1) was signed to direct all state agencies to *undertake any necessary steps to support the testing and operation of self-driving vehicles on public roads within Arizona*. The executive order also specifies that in Arizona the operator of a self-driving vehicle does *not* have to be physically inside the vehicle. The vehicle can be directed remotely in self-driving mode. 81 | * **Colorado** - Colorado [passes first law](http://www.denverpost.com/2017/06/01/colorado-law-regulate-driverless-vehicles/) to regulate self-driving cars. Companies who plan to test self-driving cars in Colorado need to first check in with the state Department of Transportation and State Patrol. 82 | * [**California**](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/bkgd) - Application required for [testing self-driving cars](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/testing). Manufacturers are required to provide [accident reports](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/autonomousveh_ol316+) and [disengagement reports](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/disengagement_report_2016). The regulations for [post-testing deployment](https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/auto) of self-driving cars have been drafted and will establish the requirements for manufacturers to meet prior to operation on California’s on public roads. 83 | * **New York** - It is [announced](https://www.governor.ny.gov/news/governor-cuomo-announces-autonomous-vehicle-testing-begin-new-york-state) on May 10, 2017 that the state is accepting application for self-driving car testing. The pilot testing program is included in FY 2018 and can be further extended. 84 | * **Texas** - Bill [SB 2205](http://www.capitol.state.tx.us/Search/DocViewer.aspx?ID=85RSB022051A&QueryText=%22SB+2205%22&DocType=A) is proposed to implement minimum safety requirements and accelerate testing of self-driving cars on public roads. The bill passed the Texas Senate Transportation Committee and it is currently pending Senate debate and referral to the House. 85 | * **Virginia** - Arguably the most friendly state to self-driving cars with no application or permit required and [$25M per year fund](https://www.washingtonpost.com/local/trafficandcommuting/virginia-wants-to-steal-some-of-californias-driverless-thunder/2017/04/23/a4bc6b54-206c-11e7-a0a7-8b2a45e3dc84_story.html?utm_term=.cfaac3ec962d) set to facilitate self-driving cars. [Virginia Automated Corridors](https://governor.virginia.gov/newsroom/newsarticle?articleId=8526) is announced to offer self-driving car developers the opportunity to *test their technologies on Virginia roads covering more than 70 miles of interstates and arterials in the Northern Virginia region*. 86 | --------------------------------------------------------------------------------