The key is that it does it with the engine off too. The clutch z-bar is probably hitting something as you push down the clutch - usually it hits the exhaust pipe. The clutch spring can also make a noise somewhat similar to the untrained ear.

Have someone press the clutch pedal while you look at the clutch linkage from underneath.