Tutorial: Using Equator and ArcGIS Pro to Detect Objects Using Deep Learning

In this tutorial, you will learn how to use Equator to source an orthoimage, then use ArcGIS Pro and the tools in the Image Analyst Extension to detect and identify objects through deep learning.

Step 1: Source Orthoimage
Step 2: Add Orthoimage to ArcGIS Pro
Step 3: Classify Objects for Deep Learning
Step 4: Train Deep Learning Model
Step 5: Use Model to Detect New Objects

Video Tutorial of Detecting Objects Using Deep Learning in ArcGIS

Step 1: Sourcing Orthoimagery

If you already have an orthoimage, jump down to Step 2. If you need an orthoimage for your project site, follow these steps:

  1. Sign-in or create an account in Equator
  2. Search for your site location by using the search bar or zooming into your site
  3. Create a site boundary using the +NEW SITE button. Select from the default rectangle options or create your own boundary. Do not forget to name your site!
  4. Go to the Layers menu, select the orthoimage, and click the down arrow to download your orthoimage.
  5. Your orthoimage will be saved to your downloads folder or whichever folder your downloads save to.
Detecting Object Through Deep Learning in ArcGIS - Download Orthoimage from Equator

Orthoimage Download from Equator

Step 2: Add Orthoimage to ArcGIS Pro

In this step you will open ArcGIS Pro, create a new map, and add the orthoimage you just downloaded from Equator.

  1. Open ArcGIS Pro
  2. In the menu, select New Map > Assign a Name > Select a Location or By Default
  3. On the top menu, select View > Catalog View, Fix the Panel > Create a Folder to save your Orthoimage
  4. The dialogue box for Calculating Statistics for the Orthoimage will appear. Click Yes. Statistics are required for your raster and mosaic datasets to perform certain tasks, such as applying a contrast stretch or classifying your data.
Detect Objects through Deep Learning in ArcGIS Pro - Inputing Orthoimage into ArcGIS Pro

ArcGIS Pro Dialog Box for Calculating Statistics for the Orthoimage

Step 3: Classify the Objects for Deep Learning

In this step, you will identify the objects that you will use to train the model through deep learning.
  1. On the top Menu > Select Imagery > Symbology > Classification Tools > Label Objects for Deep Learning
  2. From the Image Classification menu, select any form to create objects or create new classes. In this example we are going to identify pine trees

Step 4: Train Deep Learning Model

In this step, you will actually train the deep learning model in ArcGIS Pro.
  1. In the Image Classification menu, go to Export Training Data tab. Change your Output Folder

  2. Click Run

Step 5: Use Model to Detect New Objects

In this step, you will use the trained model to detect new objects.
  1. View > Catalog View > Labeled Objects > Orthoimage_GeoTiff_tif > Create a New Folder

  2. Go to View > Geoprocessing > Image Analyst Tools > Deep Learning > Train Deep Learning Model
  3. Identify your Input Training Data folder and the folder to save your Output Model (the folder that was just created above). Under Model Parameters, select MaskRCNN (Object Detection)
  4. Click Run
  5. Go to View > Geoprocessing > Image Analyst Tools > Deep Learning > Detect Objects Using Deep Learning
  6. Finally, we are ready to inference new object from our images – Pine Tree. To do that, we will use the Detect Objects Using Deep Learning tool. For the Input Raster, use the Feature Class with Image Attachments that we created in the first step and for the Model, we will use what we created in the Train Deep Learning Model section.
  7. Click Run
Detect Objects through Deep Learning in ArcGIS Pro - How to Run the Training Model

Detect Object Using Deep Learning

Detect Objects through Deep Learning in ArcGIS Pro - Results of the Training Model

New Objects Detected from Deep Learning Model

AI, or Artificial Intelligence, is the science of making machines think and perform complex tasks that were previously exclusive to humans.

GeoAI is an emerging field that combines geospatial data, science, and technologies with artificial intelligence techniques.


Deep Learning
is a subset of machine learning characterized by the utilization of neural networks with three or more layers. Neural networks, which are designed to simulate the behaviour of the human brain, learn from large datasets and have proven to be instrumental in various applications. The network has the ability to engage in “end-to-end” learning, which enables it to process raw data and independently acquire knowledge about a particular task, such as classification.

Deep learning capabilities are available in ArcGIS Pro for imagery and point clouds through several tools and capabilities. Deep Learning Analysis requires ArcGIS Pro and the ArcGIS Image Analyst Extension.

Ready to Use ArcGIS Pro’s Deep Learning Tools? Download your sites orthoimage from Equator.