I've found the most effective patching material for such exterior applications to be a two-part auto-body filler ... back-brushing to get the paint everywhere it needs to go. Finish with a final roll ...