Connect as the Follow Up Boss account owner.
When you connect, Callingly adds a routing rule for each lead source on your 100 newest people, so new leads from those sources get called from the start. A lead source you add later needs its own rule. To stop the calls to one lead, for example once an appointment is set, add the "Callingly - Stop Calls" tag.