STOP playing with him. You said you have times during the day when you do play with him. Just stop it. He is expecting it. Play is the kid's job - not yours. Keep tell him to "go play" and do NOT play with him at all.
I think it is a sad state where we have gotten ourselves into a position where now kids don't know how to self-entertain.