The Rear Window Defogger is a bit more involved than the Lighter.
With the Ignition Switch 'ON', does the indicator light for the Defogger switch come on when you push the switch? If so, the Integrated Control Unit is probably good, a very good sign. That also indicates the switch is good, as well as the fuses #4 and #5 in the underdash fuse box. The next thing to check is whether there is voltage going to the Defogger wire in the window. On 23-276 ('92 manual), there is a picture showing where to measure the voltage at the window wiring. No voltage at this point indicates a bad relay, or wiring associated with the relay, or wiring going to the rear window. You can carefully jump the contacts of the relay in the engine compartment fuse box. I use a short test lead with alligator clips on the ends, with paper clips partially uncurled stuck in the alligator clips. Stick the uncurled ends of the paper clips in the relay terminals. See the A-B terminals on P. 23-274. Then, re-measure the voltage at the rear window. Good voltage there points to a bad relay, assuming the indicator light came on as in the first sentence of this paragraph. You can check the relay coil as you can with any relay, using the 'Ohms' function on the multimeter, replacing the relay if the coil is open, or infinite resistance.
If everything now looks good up to the terminals on the rear window wiring, then the chances are that your window is at least partially defrosting. If a partial defrost pattern is indicated, then check each wire in the window for a broken conductor as shown on 23-276.
Going back to the beginning, assume that the indicator light did not come on, that the fuses are good, and that all the other functions of the Integrated Control Unit are working. This strongly points to a bad Defogger Switch, or a partially failed ICU.
Direct testing or replacement of either of these items gets somewhat involved. See pages 23-156 and 159, also pages 23-273 and 275. I hope it doesn't go that far. I have been into the switch cluster, which is bad enough, but not the ICU.
Let me know if this helps. Good luck.
Bill