Ok. You've left me no option but to bust out MS-Paint.
There are two ways you can accelerate flow under a car. The first is to create a low pressure area behind the car, which encourages more air to go under the car and ultimately fill that low pressure area. The other is a big nozzle that redirects more air under the car, thus accelerating it.
Marekk and Shelley are explaining the former case, whereas N Smikle seems to be focused on the latter.
Of course, you can simulate ground effect by mirroring the body. I think this will help some people visualize why a diffuser drives the floor. The diffuser affects the air that is ahead of the leading edge of the floor. The low pressure area reaches quite far forward. Since the air needs to fill that big diffuser/expansion area, more air needs to flow under the floor. More air under the floor? It must have to accelerate... and we all know accelerated air = lower pressure.
Case 1:
1) This part of the streamline has just "felt" the low pressure region under the floor, so it accelerates down toward the floor.
2) It reaches the floor, the curve to where it goes straight again creates a localized low-pressure area (first suction peak).
3) The accelerated air reaches the diffuser, curves up a bit (giving another suction peak), and slows down, filling that big void.
4) Air has slowed back down to ambient.
Case 2:
5) big nozzle accelerates air by redirecting it under the floor
6) accelerated air shoots out the back, all pissed off because it wasn't diffused.
Case 3 (flat floor with no diffuser; I didn't want to draw a straight line by itself!):
It's not going to create any downforce because nothing will accelerate the air (other than boundary layer expansion, but lets leave that alone for now). There is no diffuser that sucks more air under the car due to the big volume at the back that needs to be filled, nor is there a nozzle that accelerates more air under the car.
So basically, with the diffuser case, you end up with the diffuser driving the entire floor. If it wasn't there, there would be no reason for the air to accelerate as there is no nozzle, and therefore it wouldn't need to be returned to ambient pressure/velocity.
Therefore, the diffuser doesn't create downforce, but merely makes the rest of the floor create downforce.
Note: similar idea to adding elements onto a wing; the latter flaps create little-to-no downforce, but they drive the main-plane of the wing to create much more downforce than if it was just there by itself.
That make sense?