The Observer can be spotted in the Fringe episode Olivia. In The Lab. With The Revolver., at the very beginning of the episode in front of Miranda Greene's Jeep, just before she dies of cancer.
You can see all of The Observer's other appearances here.
* Thanks to the guys at Fringe LIVE for spotting this!