I'm thinking there needs to be some clarification of what's going on with your pictures. Excuse me if I'm just repeating what you already know:
The idea of Photos is to keep the Original Picture file forever unchanged. When you edit a picture, annotate it, or put it into a folder, nothing happens to the Original. Photos keeps a database, like an Excel spreadsheet, that connects the original picture to each of the things you've done to it. Photos makes thumbnail images and small preview images to allow smooth scanning through pictures, and those, too, are connected to the originals with the database. When you zoom in, or edit, or print a picture, Photos goes back to the original files and re-applies all the edits on the fly to make the picture you thought you had. The original is never actually changed, and full edited pictures aren't stored.
Usually people have Photos store the originals inside the Photos Library so Photos will always know exactly where they are. That's called a Managed Library. But sometimes, people want to keep their pictures in Finder folders rather than inside the Library, then called a Referenced Library. The downside of a Referenced Library is that Photos can lose track of the Originals. We always advise against a Referenced Library. Somehow, unfortunately, some of your pictures are Referenced, and the connection to some of them is lost.
Your problem is that Photos has the thumbnails and some Previews, but it can't connect them with the Original files. That's why you can see the pictures, but you can't do much with them. So you need to find those originals and re-connect. In Photos' menu File there is the choice "Consolidate" which can help with that. It copies the referenced files into the Library. You have 8000 of these "Referenced" pictures that are lost because they were not copied into the Library. Some of your Referenced pictures may not be lost-- they may still be available to Photos. So you should try the Consolidate command. Then check your Smart Album and see if the number has gotten smaller, as some Referenced files have gotten connected.
If you can find any of those old files, on a CD or DVD or an old hard drive, you may be able to point Photos to where it should find the pictures, and let it Consolidate more.