[John N.]

Definitely don't submerge your equipment. Soapy water on a rag, and wipe around the connections. You'll see a little bubble form indicating a leak.

Are you using a washer between regulator and cylinder? Most leaks are between this connection.

-John N.