My windows are stained, what is the best cleaner to remove what feels like over spray and acid rain marks?

These are regular double pane tempered windows (andersen I believe). When I clean them with windex, some of them actually feel rough like there is overspray and they don't look quite clean even though nothing more comes up on the paper towel. Help!