Object Detection for Bing Visual Search Launched

Bing Visual Search with Object Detection make visual explorations much more streamlined with auto detecting several objects and marks them.

Share online:

Bing Object Detection Model Structure Chart

Back in June, Bings' new visual search functionality begun to let users manually mark an object in the image and search for similar items, has today, step forwarded with a new "Object Detection" feature added to the visual search, so you don't need to draw the boxes manually anymore.

With Object Detection, now when you ends up on Bing Image Details Page, Bing will automatically detects several objects and mark them for you. Clicking on the hotspot over an object of interest, will automatically position the bounding box in the right place for that object, and search will trigger with results appearing on "Related Products" and "Related Images" sections of the page. To explore more, adjust the box or try clicking other hotspots.

See the image below, the 3 hotspots with light grey background and white boundary – the second image below draws a box around an object of interest:

Bing Object Detection Model Hotspots
Bing Object Detection Model draws a box around an object

Since, the functionality is still an early version, it currently has limited coverage with certain fashion categories. But, Bing is on work to scaling up beyond the initial fashion categories, as well as expanding to other domains, says bing.

Also, the Object Detection is currently only available on desktop, with mobile support is expected to be releasing in coming months.

Finally, Bing also supports Celebrity Recognition, however it's based on a "Face Detection Model," but will later covered by Object Detection Model as well.

To learn more about how the Object Detection was made possible, head over to Bings' coverage here.

Here's also a short video showing a live demo of Visual Search and Object Detection:

Update 09/21: Microsoft has today open sourced its Bing Maps .NET Spatial Data Services Toolkit on Github. The Bing Maps Spatial Data Services (SDS) is another type of REST based service provided Bing Maps that provides following key features:

  • Batch forward and reverse Geocoding of up to 200,000 rows of data in a single request.
  • Spatial data hosting and services: Upload a two-dimensional table of data as a data source and expose it as a spatial REST service.
    • Perform spatial queries against data sources using:
      • Find Nearby (radial)
      • Find in bounding box
      • Find by Property
      • Find along a route
      • Intersection search (i.e. search within a custom shape.)
  • Public Data sources: Access public data sources that contain information such as points of interest and census data.
  • Boundary Data: Access to administrative boundary data via the Geodata API. Boundary data types available vary from country to country. Supported boundary types; zip/postal codes, neighborhoods, cities, counties, states/provinces, countries, and continents.

About The Author

Deepak Gupta is a IT & Web Consultant. He is the founder and CEO of diTii.com & DIT Technologies, where he's engaged in providing Technology Consultancy, Design and Development of Desktop, Web and Mobile applications using various tools and softwares. Sign-up for the Email for daily updates. Google+ Profile.