I think it depends on how many innings he can get before the playoffs. If he can only get 2 starts and no more then 3 innings in AAA, then it's worth a conversation at least.
I'm guessing he has never pitched in relief in his entire life though. Getting used to a day or two of rest while also learning how to get warmed up quick is tough for some guys.
It would be cool though to see him come in and start blowing 100 past guys.