Would a pencil rolling off a desk be kinetic energy?
yes. A pencil sitting on the desk in potential energy.
While the pencil is rolling or falling, it HAS kinetic energy. Once it hits the floor and stops moving, it has no more kinetic energy.