MySQL-bench-3.23.51-1.rpm to install as it complains about MySQL-DBI-perl-bin . But I'm sure I have that installed from the default redhat 7.2 install as I can do queries from Perl all day long. Sigh. So instead I worked off the source distrubution.
test database, re-create it. Just a blank one. ( mysql> create database test )
sql-bench directory
.sh files executable ( chmod +x *.sh )
perl -p -i -e 's!^#\!\@PERL\@$!#\!/usr/bin/perl!g' *.sh
test-___.sh files. The run-all-tests.sh command for me did not work, it happily says it's done after doing nothing!