So it goes out when the engine is on, thats fine, that means its charging, so when you turn off the ignition, and take the key out its still on?
When you turn the key two clicks, the oil and battery light should come on and stay on, going out only, if you switch everything off, or turn on the engine and everythings working.