I'd like to do the same - just carefully pry it off as opposed to removing the airbag to access it. However my concern is if it's pried off, the two mounting tabs will stay behind underneath the front of the steering wheel / airbag cover. No way to remove them then, Two concerns then: first, the two tabs might rattle around there. Second, more important, if the airbag is deployed, one or both of those tabs could become inbedded in your face or eyes.
I may be totally wrong, but it sounds logical to me.