If the casters have a fairly large plate, putting 3 appropriately sized screws into the center of the 2x4 and the fourth into the plywood will be very strong.
Quality screws that go all the way thru the 2x4 and a tee nut for the fourth in the plywood can exceed the capacity of a decent caster.