On my mac (SU2020,1) , I’m looking to clean the library folder.
There should be a plist somewhere, but I don’t know the location. You can select the list you want to remove from ‘favorites’ and than click on the little blue details icon:
and choose ‘Remove from favorites’
one by one…