In faith and practice, Pentecostals put emphasis on practical issues as well as spiritual experience in their theological understanding and doctrinal teachings. The Pentecostals take their doctrine from certain empirical events. One of the spiritual experiences often underlined is the baptism of the Holy Spirit. In interpreting the Book of Acts , Pentecostals tend to emphasise the theological character of the narratives and seldom their historical uniqueness. That is why Pentecostals stress the normative theological intent of the historical record for contemporary Christian experience. This article therefore examines critically Pentecostal paradigm of the baptism of the Holy Spirit, deriving examples from the Acts of the Apostles. It is concluded that the practice of the baptism of the Holy Spirit carried out by Christians today, arguably, has no biblical basis. This is because, there is nowhere the Bible commands people to seek baptism in the Holy Spirit. The observation is that, all the events or experiences of Christians baptised in the Holy Spirit in Acts are not necessarily universal normative for every Christian and for this reason, there is no need to be dogmatic. Contribution: This article challenges the practice of the baptism of the Holy Spirit in church today. This study supports the fact that the baptism of the Holy Spirit is not a universal experience for every Christians and there is no need to be dogmatised. [ABSTRACT FROM AUTHOR]