Once you have a reference on the phone, thank them for connecting with you. Tell them you need just 15 minutes and that everything will be held in confidence — you’re not going to share their feedback with the candidate (and honor this, of course). Tell them you’re looking for themes and patterns. You can say, “I’ve almost made my decision. This phone call is a good way for me to confirm my decision and learn the best ways to get the most out of him.” That disarms the interaction and allows for a more candid reference.
Here are the questions I recommend, in order:
Reference checking must be done in a phone call. People will not put negative things in writing, so don’t try to cut corners with a reference check via email. Keep the call to 15-20 minutes and offer to return the favor any way you can.