Is it true that feedback systems are in closed loop by definition?

Correct. The controller can be considered as "System 1" whereas the plant (e.g. vehicle) as "System 2" on page 5 of the slides.

--Shuo