Make sure to have padding beneath the chuck to prevent it from breaking. Then take a hammer and tap it in until the drill chuck falls. The easiest way to remove a drill press chuck is to insert your drill chuck removal tool into the slot on the spindle above the drill chuck. It should also be removed if it becomes damaged in any way.
A drill press chuck should be removed to clean off sawdust or grease every once and a while.