Spatial relation reasoning and representation for image matching

The spatial relationship in the paper means the spatial adjacency relation between the objects in word space, and the paper proposes a novel image matching method based on analyzing the spatial adjacency relation between the object contained in the image pair. In the method, the feature extraction network is first trained based on comparison mechanism, and the well-trained model could produce the deep features for the objects, which could effectively match the consistent objects across images. Then the priori images are employed to deduce the spatial adjacency information between different objects, which is further represented by the spatial adjacency graph. Finally, the spatial relation matching between the image pair is conducted by calculating the spatial adjacency score based on the spatial adjacency graph. The experimental results demonstrate that the spatial adjacency scores of the non-matched image pairs generally equal to 0, and those of the matched pairs are generally greater than 0. As several objects are involved, the proposed spatial relation matching method could achieve high robustness, it outperforms other methods in the comparison experiments, and it could effectively complete the image matching task with high efficiency.