We present a novel theoretical framework for online adaptation of Control Barrier Function (CBF) parameters, i.e., the class K functions, under input constraints. To this end, we propose the concept of locally validated CBF parameters, where adapting these parameters ensures that the system trajectories remain safe within the finite horizon. (a) A candidate inner safe set defined via an Input Constrained CBF cannot be rendered forward invariant using the given CBF parameter. (b) With locally validated CBF parameters, the trajectory remains within the inner safe set over the finite horizon, ensuring safety for that interval. By adapting the CBF parameters, the corresponding inner safe set is reshaped dynamically, alleviating conservatism by allowing the trajectory to extend beyond a fixed, globally verified inner safe set.