Safe and comfortable travel on the train is only possible on tracks that are in the correct geometric position. For this reason, track tamping machines are used worldwide that carry out this important track maintenance task. Turnout-ta.mping refers to a complex procedure for the improvement and stabilization of the track situation in turnouts, which is carried out usually by experienced operators. This application paper describes the current state of development of a 3D laser line scanner-based sensor system for a new turnout-tamping assistance system, which is able to support and relieve the operator in complex tamping areas. A central task in this context is digital image processing, which carries out so-called semantic segmentation (based on deep learning algorithms) on the basis of 3D scanner data in order to detect essential and critical rail areas fully automatically.