When I was young, I used to read a book called Crispin's Castle by Kathleen M. Duncan. Since we still have it, I read it again even though it is supposed to be for kids. I still found it to be very interesting.
It's about a boy who was an orphan who was being sent to boarding schools by a lady who didn't spend a lot of time with him. "Crispin" goes to stay with some relatives of the lady for a time, and that family has just moved to Dover (Kent, England, U.K.). There is a castle nearby that "Crispin" admires. So, I looked up a castle in Dover and found a video where you can not only watch the video about the castle which tells some of its history, but you can also scroll around for different angles to viewing it and its surroundings. It seems to fit the description of the castle in the book. The boy has one thing that was found on him when he was discovered that had some letters/initials on it, and so those initials along with an interesting new elderly neighbor lead to a discovery about his identity.