How to Remove Old Profile Pictures
I recently changed my profile photo on Win10.. and wanted to remove all my previous ones. Seems the UI doesnt allow for that. You can find the location of the profile photos here:
%appdata%\Microsoft\Windows\AccountPictures
Go there, and delete the ones you dont want.