In Bangladesh, private university sectors have observed several modifications with the initiation of Communicative Language Teaching (CLT). The communicative approach is expected to form such an ambience in the language classrooms where anxiety, fear and boredom are minimized and students are not under the influence of the affective factors in a tertiary level. This paper intends to explore the reasons that the students' background and affective factors affect highly on the speaking skills of the undergraduate level learners and it aims to find the solutions to these problems from the students’ perspectives. To collect the data, researchers used a questionnaire to specify major problems faced by the tertiary level learners in speaking English and strategies to overcome those from their viewpoints. The survey shows, in many cases, anxiety, fear and hesitation and performance pressure hinders the speaking of individuals, whereas, if the speaking situation is friendly and provide a platform to uninterrupted speaking with constructive feedback, it may facilitate learners speaking. In the end, analyzing the results, the researchers have discussed some effective solutions from their experiences to overcome these affective states among adult learners.