My player can stand on the top of the stone ground but walks through its side.
Theres 2 types of default tiles: those with every side solid (left) and those with only the top solid (right).
This is a dirt tile, but the same logic applies to stone tiles. If it still not works, you can place a invisible barrier over your tiles.