Soak the floor with water and use a thin flexible putty knife to gently work under the first couple. After that a stiff putty knife wil pop off the rest. Water dissolves compound so any remaining compound can be removed by soaking the compound and letting it soak in. A coarse brick sponge will be helpful.