To systematically explore the influence of aromatic polycarboxylate ligands on building Zn II –BMP (1,5-bis(2-methylbenzimidazol) pentane) coordination polymers, four coordination polymers, namely {[Zn 2 (BMP)(PHSA) 2 ]·H 2 O} n ( 1 ), [Zn 4 (BMP) 2 (BTEC) 2 (H 2 O)] n ( 2 ), [Zn 2 (BMP)(BTRC)(OH)] n ( 3 ), {[Zn 3 (BMP)(TCI) 2 (H 2 O)]·H 2 O} n ( 4 ) (H 2 PHSA = 2-phenylsuccinic acid, H 4 BTEC = benzene-1,2,4,5-tetracarboxylic acid, H 3 BTRC = benzene-1,3,5-tricarboxylic acid, H 3 TCI = Tris (2-carboxyethyl) isocyanurate) are synthesized by varying aromatic polycarboxylate ligands. Systematic structure analysis shows that 1 – 4 are comprised by one or more Zn II dimer in which carboxylate ligands bridge two metal ions forming dinuclear cores, and BMP links these cores. In 1 , PHSA 2− bridges Zn II ions to generate paddle-wheel dimer [Zn 2 ( η 1 -COO) 4 ] and these dimers are further linked by BMP to form 2D structure. 2 exhibits a layer with two different dimers: [Zn 2 ( η 1 -BTEC 4− ) 2 ] and [Zn 2 ( η 1 -BTEC 4− )( μ 2 -H 2 O)] indicating that bridge water have subtle influences on the coordination geometry. [Zn 2 ( η 1 -BTRC 3− )( μ 2 -OH)] dimers in 3 are further linked by two kind of wavelike layers constructing the 2-fold interpenetrated 3D architecture. 4 shows a 2-fold interpenetrated 3D architecture with dimeric centre. Notably, besides Zn II dimer [Zn 2 ( η 1 -TCI 3− ) 3 ], a monuclear Zn II ion exists as a terminal of ligand BMP enhancing photoluminescence intensity of 4 subtlely.