In this paper, we present a high-order conservative semi-Lagrangian (SL) hybrid Hermite weighted essentially nonoscillatory (HWENO) scheme for linear transport equations and the nonlinear Vlasov--Poisson (VP) system. The proposed SL hybrid HWENO scheme adopts a weak formulation of the characteristic Galerkin method and introduces an adjoint problem for the test function in the same way as the SL discontinuous Galerkin (DG) scheme [W. Guo, R. D. Nair, and J. M. Qiu, Monthly Weather Rev., 142 (2014), pp. 457-475]. Comparing with the original SL DG scheme, we introduce a hybrid moment-based HWENO reconstruction operator in space, bringing at least two benefits. Firstly, with the same order of accuracy, such a reconstruction allows lower degrees of freedom per element in the evolution process. Secondly, it naturally possesses a nonoscillatory property when dealing with discontinuity. In addition, we derive a novel troubled cell indicator which can effectively detect the discontinuous regions for the reconstruction operator. To apply the scheme for 2-D transport equations and the nonlinear VP system, we adopt a fourth-order dimensional splitting method. Positivity-preserving limiters are applied to enforce the positivity of the solution for the system having positive solutions. Finally, we show extensive numerical tests to validate the effectiveness of the proposed SL hybrid HWENO scheme. [ABSTRACT FROM AUTHOR]