项目作者: zalkikar

项目描述 :
Boundary box creation using a GradCAM heat-map from a pre-trained image classification model.
高级语言: Jupyter Notebook
项目地址: git://github.com/zalkikar/BBOX_GradCAM.git
创建时间: 2019-10-18T03:36:26Z
项目社区:https://github.com/zalkikar/BBOX_GradCAM

开源协议:MIT License

下载


BBoxerwGradCAM

This class forms boundary boxes (rectangle and polygon) using GradCAM outputs for a given image.

The purpose of this class is to develop Rectangle and Polygon coordinates that define an object based on an image classification model.

The ‘automatic’ creation of these coordinates, which are often included in COCO JSONs used to train object detection models, is valuable because data preparation and labeling can be a time consuming task.

This class takes 5 user inputs:

  • Pretrained Learner (image classification model)
  • GradCAM Heatmap (heatmap of GradCAM object - formed by a pretrained image classification learner)
  • Source Image
  • Image Resizing Scale (also applied to corresponding GradCAM heatmap)
  • BBOX Rectangle Resizing Scale
  • Class is compatible with google colab and other Python 3 enivronments

update

Weights for Grad-CAM are formed in the final convolutional layer, can a seperate model can be introduced on the Grad-CAM heatmap, or possibly leverage the contouring and gradient strategies used here, to increase IoU after Grad-CAM or CHIP (Channel-wise Disentangled Interpretation of Deep Convolutional Neural Networks)?
Relevant Paper: https://arxiv.org/pdf/1902.02497.pdf