I will present results from our on-going high-precision infrared radial velocity survey of late-type stars, based on spectra obtained with NIRSPEC at Keck. Our technique achieves a record breaking precision of 50 m/s, which is finally sufficient to begin identifying planets at infrared wavelengths. Using this technique, we are surveying a sample of young (1-10 Myr) stars to search for hot Jupiters; their discovery at these ages would put much needed constraints on the planet formation and migration timescales. I will present results from this work, including newly discovered young companions and an initial assessment of the planet frequency at these ages. I will also discuss the potential for infrared radial velocities to assess more completely the planet frequency of our nearest low mass stellar neighbors.