You shouldn't just "disconnect" your EGR valve, if you want to disable it. You need to block the flow between the exhaust and intake. This can be done with a plate or with a simple gasket that lacks holes for exhaust gas to travel. The simplest way to make such gasket is to cut one from Coke can! This will surely cause a permanent CE light.
I do not know what you are "feeling", it typically take 10% of power to feel the difference without using instrumentation, and I can't imagine EGR making THAT much difference.
96 Eclipse Spyder GSX (already turbo, AWD swap)
93 Eagle Summit AWD (4G63 turbo swaps)