How to Smooth a Concrete Floor (5 Steps) | eHow. Smoothing down a concrete floor may seem like a daunting task, but the ... Grind down small humps or rough spots with a handheld cup wheel grinder. ... Pour it into the low spots on the floor and use the trowel to smooth it .