The Engineer-in-Training (EIT) exam is the first step to licensure as a professional engineer in the United States. Currently, the EIT Computer Based Testing (CBT) is generally perceived as a positive trend towards a more innovative and constructed response assessment task, which evaluates understanding in disciplinary knowledges, providing accessibility, unbiasedness and speedier test delivery for state-wide assessment. This paper describes the interface design of a Computer Based Testing environment (FEBooth) as a testing modality at Morgan State University (MSU), its implementation, advantages over the paper based assessment (PBA) testing and evaluation or analysis of  performance and, where appropriate, additional issues such as student’s perception of this method of assessment. To provide reliable measurements of student performance which, as well as having predictive value for the real Civil EIT exam, a total of 20 questions with short answers (SA) and multiple choices (MC) were administered to 90 graduating seniors in 2016. Strong influence on performance resulted from student learning gain from subjects in classroom and perceived ability to use FEbooth successfully which affected their behavioral response. Findings revealed preference to the paper based testing; however, 65% of the students exhibited computer anxiety resulting in slower task completion and poor performance. The study identified 35% and 55% of the students passed at first attempt while the likelihood of success increased to 56% and 68% in their second attempt of the CBT FEBooth and PBA, respectively