Insert the new rivets into the new holes and add several layers of tape to hold them in place AND protect the sill plate.