Sidewalk extraction using aerial and street view images

A reliable, punctual, and spatially accurate dataset of sidewalks is vital for identifying where improvements can be made upon the urban environment to enhance multi-modal accessibility, social cohesion, and residents’ physical activity. This paper develops a synthetically new spatial procedure to extract the sidewalk by integrating the detected results from aerial and street view imagery. We first train neural networks to extract sidewalks from aerial images, and then use pre-trained models to restore occluded and missing sidewalks from street view images.

By combining the results from both data sources, a complete network of sidewalks can be produced. Our case study includes four counties in the U.S., and both precision and recall reach about 0.9. The street view imagery helps restore the occluded sidewalks and largely enhances the sidewalk network’s connectivity by linking 20% of dangles.


This study focuses on developing an automatic method to extract sidewalks from aerial and street view imagery. We extract sidewalks from aerial images, then restore the occluded segments from street view images. Aerial imagery is the primary data source for sidewalk extraction because its data volume is relatively small, and it can cover the entire area of interest. Street view imagery has high discrimination but brings more data volume and computation, and the location of the result needs sophisticated workflow to be restored. In addition, the full coverage of the area of interest is difficult to obtain, especially private properties where the street image mapping car cannot access.

Therefore, we treat the street view image as supplementary data and use it for the occluded or other missing sidewalks in aerial images. The extracted result of sidewalks can be polygon or polyline, depending on the resolution of the aerial image. If the resolution is no better than 0.3 m, sidewalks are represented as linear objects in areal images. We use aerial images of 0.3 m in the study case, so the extracted sidewalks will be converted to polylines.

The paper is: Ning, Huan, Xinyue Ye, Zhihui Chen, Tao Liu, and Tianzhi Cao. “Sidewalk extraction using aerial and street view images.” Environment and Planning B: Urban Analytics and City Science (2021): 2399808321995817.

Translate ยป