Hate to say this, but Harold's is so overrated.
Without the sauce, it's almost tasteless, and with the sauce it's still not that good but way too soggy.
Since Harold died, many of the restaurants have taken liberties with the recipe. I only go to two of 'em in the city, that have been around since I was a kid, for the exact reasons you state. My order is always, "salt and pepper, mild sauce on the side."