http://www.worldwidewords.org/qa/qa-joy1.htm
Joystick is indeed recorded as a slang term for the penis, but it appears in writing for the first time in 1916; this might suggest it was borrowed from the aviation term, not the other way round, though the dates of slang terms are notoriously unreliable.
