could of, should of, would HAVE?

Oh blogging world....

If whoever wrote the English Grammar could be alive, he wished he'd be dead.

What's with the OF after  could, would and should?

I mean, I know it sound like OF - but it's not OF!!!!

It's HAVE!