Anybody have experience with modifying certer bore sizes/grinding down front "hub" to fit wheels?

Here's the dilio: The stock wheel has a center bore of more or less 100mm, and the center caps are aesthetic, not structural, because the front hub is built like a brick sh*t house.

Some wheels I own have a center bore of about 80MM with structural caps, meaning that the hub underneath can be as thin as tinfoil if need be.

So the question is this: Can I start grinding down the front hub nub (where those huge alan bolts are) to fit my smaller center bore wheels? I don't have much room to start increasing the center bore size on the wheels.

Thanks in advance people.