It would be helpful if you could be more descriptive and ideally post images of what you mean.
Are you trying to create the windows out of actual geometry and then use a material/texture to show the frames and glass. Or do you want to add a window in as a flat texture?
There are no textures for ‘windows’ but there are materials for ‘wood’ and ‘glass’ etc.