Sweep up the broken pieces of tile on the ground. Once you’ve detached the tiles from the floor, you’ll likely be left with smaller broken pieces scattered around. Use a broom and dustpan to collect these broken pieces and throw them away. Keep your safety attire on for this step so that you don’t cut your hands or injure yourself. If necessary, you can vacuum up the dust and smaller pieces.
Hit the chisel with the mallet to scrape off the adhesive. You’ll likely have leftover grout or glue that needs to be removed. This should come off the same way the tiles were removed by positioning a chisel or hand maul against the grout and scraping it off with the help of the mallet. Depending on the size of your floor, you may want to use a bigger chisel to reach a wider surface area at once.
Leave a super thin layer of the adhesive, if necessary. If you can’t remove all of the grout or glue, that’s okay. Use the chisel or hand maul to remove as much of it as possible, leaving just a thin layer (no more than 0.125 in (0.32 cm)) on the floor that can be filled in and covered up easily.
Remove any remaining dust using a vacuum. Use a Shop Vac or similar vacuum to pick up any extra pieces of tile, grout, or dust from the floor and surrounding surfaces. Go slowly when vacuuming to ensure you get everything.
Apply thin-set mortar to the floor to make it level. Thin-set mortar will help fill in the holes and uneven surfaces of the floor so that the removal of the tile and grout no longer looks bad. Apply a 0.125 in (0.32 cm) layer of thin-set mortar with a flat or square-notched trowel depending on whether you’ll be re-tiling the floor. Follow the directions to mix the mortar properly before applying it. A square-notched trowel is helpful in making grooves in the mortar so that you can easily place new porcelain tile.