Jason Riddle says he rejected pardon because ‘it happened. I did those things, and they weren’t pardonable’