Richard,
I have cut many windows in coaches while converting Accucraft J&S to various EBT style coaches, and I haven’t found a good method!
I usually start by drilling out the 4 corners, which is fairly easy. In theory you can use a coping saw or similar band saw to cut between the corner holes. Most fast saws, like a Dremel disk, will melt the plastic.
There is a general purpose rotary cutter available for your Dremel, the 561 Multipurpose Cutting bit. If you drill out the 4 corners, you can use this tool to cut between the holes. HOWEVER it wanders and wanders all over the shop unless you have the drill firmly supported and the coach clamped down. I found it difficult to clamp the coach body (or the end, in the Accu case) and to provide a straight guide surface for the cutter. The cutter tends to pull the work (coach) through and wander past the end.
A router table is probably the proper tool - a flat bench with the router mounted underneath and adjustable up through the top. They are designed so you can put a straight edge to guide the work, like a table saw. Rather a big, specialized device just for your windows!
Maybe you could mount the Dremel with the cutting bit pointing upwards, then figure out a jog to stop the bit from cutting anywhere except inside your window frame.

The other technique is to re-frame the window after you have rough-cut the opening, like this EBT #3.