The buttons sit in a rubbery, spongy mesh. The buttons tend to fly off the mesh with every vibration.
The rumble feedback feature of the Wii Remote is apparently generated by the speaker, which acts like a very small subwoofer.