Quantitative reasoning is an important skill set that educators work tirelessly to develop, yet evidence is beginning to show a downward trend in performance among university students over the past few decades. The rise of technology in everyday life has undoubtedly affected the cognition of younger generations of students. Of particular interest is the increasing availability of calculators (e.g., on cell phones). In this experiment, we programmed a calculator to lie to students in certain conditions as well as alter the presentation of problems. We also collected numeracy scores. The effects of these variables on reports of suspicion towards the calculator and overall accuracy on problems were analyzed to see whether students tended to be disengaged from math problems while using a calculator (Disengagement Hypothesis) or whether calculators do not substantially affect how students engage in problems and variation in performance is more attributable to general numeracy (Engagement Hypothesis). The Engagement Hypothesis was supported.