Under the big data and the deep learning, the problem of multi-source heterogeneous information fusion is discussed, and a universal deep-learning model of multi-source image data fusion is designed on the basis of basic fusion framework, and it applies deep learning to extracting and mining information from multi-source heterogeneous data.