Camera spectral sensitivity (CSS) establishes the connection between scene radiance and device-captured RGB tristimulus values. Since the spectral sensitivity of most color imaging devices typically deviates from that of human vision or a standard color space and also noise is often introduced during the process of photoelectric signal conversion and transmission, the design of an efficient CSS with noise robustness and high color fidelity is of paramount importance. In this paper, we propose a CSS optimization method with noise consideration that designs theoretically an optimal CSS for each noise level. Additionally, taking practical considerations into account, we further extend the proposed method for a universally optimal CSS adaptable to diverse noise levels. Experimental results show that our optimized CSS is more robust to noise and has better imaging performance than existing optimization methods based on a fixed CSS. The source code is available at https://github.com/xyu12/Joint-Design-of-CSS-and-CCM-with-Noise-Consideration-EI2024.