BSMBench is an open source supercomputer benchmarking tool (with a custom license designed to credit the original research work at its basis) derived from simulation code used for studying novel strong interactions in particle physics. Over traditional parallel benchmarking tools (e.g. Linpack), BSMBench has the advantage of being able to tune the ratio of communication over computation. Three examples are provided that show the performance of the system for a problem that is computationally dominated, a problem that is dominated by communication and a problem in which communication and computational requirements are balanced.