ATLAST is a particular realization of the Large Ultraviolet Optical Infrared telescope (LUVOIR), a diameter space telescope being defined for consideration in the 2020 Decadal Review of astronomy and astrophysics. ATLAST/LUVOIR is generally thought of as an ambient temperature () system, and little consideration has been given to using it at infrared wavelengths longward of . We assess the scientific and technical benefits of operating such a telescope further into the infrared, with particular emphasis on the study of exoplanets, which is a major science theme for ATLAST/LUVOIR. For the study of exoplanet atmospheres, the capability to work at least out to is highly desirable. Such an extension of the long wavelength limit of ATLAST would greatly increase its capabilities for studies of exoplanet atmospheres and provide powerful capabilities for the study of a wide range of astrophysical questions. We present a concept for a fiber-fed grating spectrometer, which would enable spectroscopy on ATLAST with minimal impact on the other focal planet instruments. We conclude that it is technically feasible and highly desirable scientifically to extend the wavelength range of ATLAST to at least .