Unless the chisel is entirely too soft to be a decent chisel,you will not be able to file it. As David said,get a more coarse abrasive.