Yes! The 1% milk is the most likely problem. You must use the correct dairy with Rose’s recipes; It’s very important for the texture of the cake. If you use low-fat diary, there is not enough fat in the cake to balance the formula. This is the most likely reason for the dry and crumbly texture.
Also, make sure your oven is accurate before baking, as that is the second most likely reason.